-- Logs begin at Mon 2022-07-25 07:54:41 UTC, end at Mon 2022-07-25 09:15:24 UTC. -- Jul 25 08:30:46.583722 dv-cinder-850858-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 25 08:30:46.592382 dv-cinder-850858-1-iscsi devstack@keystone.service[86934]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 25 08:30:46.594397 dv-cinder-850858-1-iscsi devstack@keystone.service[86934]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 08:30:46 2022] *** Jul 25 08:30:46.594397 dv-cinder-850858-1-iscsi devstack@keystone.service[86934]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 08:30:46.594397 dv-cinder-850858-1-iscsi devstack@keystone.service[86934]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 08:30:46.594397 dv-cinder-850858-1-iscsi devstack@keystone.service[86934]: nodename: dv-cinder-850858-1-iscsi Jul 25 08:30:46.594397 dv-cinder-850858-1-iscsi devstack@keystone.service[86934]: machine: x86_64 Jul 25 08:30:46.594397 dv-cinder-850858-1-iscsi devstack@keystone.service[86934]: clock source: unix Jul 25 08:30:46.594397 dv-cinder-850858-1-iscsi devstack@keystone.service[86934]: pcre jit disabled Jul 25 08:30:46.594397 dv-cinder-850858-1-iscsi devstack@keystone.service[86934]: detected number of CPU cores: 4 Jul 25 08:30:46.594397 dv-cinder-850858-1-iscsi devstack@keystone.service[86934]: current working directory: / Jul 25 08:30:46.594397 dv-cinder-850858-1-iscsi devstack@keystone.service[86934]: detected binary path: /usr/bin/uwsgi-core Jul 25 08:30:46.595073 dv-cinder-850858-1-iscsi devstack@keystone.service[86934]: your processes number limit is 47680 Jul 25 08:30:46.595073 dv-cinder-850858-1-iscsi devstack@keystone.service[86934]: your memory page size is 4096 bytes Jul 25 08:30:46.595073 dv-cinder-850858-1-iscsi devstack@keystone.service[86934]: detected max file descriptor number: 2048 Jul 25 08:30:46.595073 dv-cinder-850858-1-iscsi devstack@keystone.service[86934]: lock engine: pthread robust mutexes Jul 25 08:30:46.595073 dv-cinder-850858-1-iscsi devstack@keystone.service[86934]: thunder lock: enabled Jul 25 08:30:46.595073 dv-cinder-850858-1-iscsi devstack@keystone.service[86934]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 25 08:30:46.595073 dv-cinder-850858-1-iscsi devstack@keystone.service[86934]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 08:30:46.634498 dv-cinder-850858-1-iscsi devstack@keystone.service[86934]: Python main interpreter initialized at 0x55ac2e0fd9c0 Jul 25 08:30:46.634498 dv-cinder-850858-1-iscsi devstack@keystone.service[86934]: python threads support enabled Jul 25 08:30:46.634498 dv-cinder-850858-1-iscsi devstack@keystone.service[86934]: your server socket listen backlog is limited to 100 connections Jul 25 08:30:46.634498 dv-cinder-850858-1-iscsi devstack@keystone.service[86934]: your mercy for graceful operations on workers is 90 seconds Jul 25 08:30:46.634920 dv-cinder-850858-1-iscsi devstack@keystone.service[86934]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 08:30:46.635020 dv-cinder-850858-1-iscsi devstack@keystone.service[86934]: *** Operational MODE: preforking *** Jul 25 08:30:46.635298 dv-cinder-850858-1-iscsi devstack@keystone.service[86934]: *** uWSGI is running in multiple interpreter mode *** Jul 25 08:30:46.635298 dv-cinder-850858-1-iscsi devstack@keystone.service[86934]: spawned uWSGI master process (pid: 86934) Jul 25 08:30:46.635496 dv-cinder-850858-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 25 08:30:46.636469 dv-cinder-850858-1-iscsi devstack@keystone.service[86934]: spawned uWSGI worker 1 (pid: 86941, cores: 1) Jul 25 08:30:46.636469 dv-cinder-850858-1-iscsi devstack@keystone.service[86934]: spawned uWSGI worker 2 (pid: 86942, cores: 1) Jul 25 08:30:46.637883 dv-cinder-850858-1-iscsi devstack@keystone.service[86934]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 08:30:52.156432 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 08:30:52.156432 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: from cryptography.utils import int_from_bytes Jul 25 08:30:52.157190 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 08:30:52.157190 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: from cryptography.utils import int_from_bytes Jul 25 08:30:52.161469 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 08:30:52.161469 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: from cryptography.utils import int_from_bytes Jul 25 08:30:52.161943 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 08:30:52.161943 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: from cryptography.utils import int_from_bytes Jul 25 08:30:52.207017 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 08:30:52.207206 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 08:30:52.207399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] command line args: [] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 08:30:52.207701 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 08:30:52.207883 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ================================================================================ {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 08:30:52.208138 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] admin_token = **** {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.208382 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] config_dir = [] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.208569 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.208750 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] config_source = [] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.208930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] debug = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.209128 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.210502 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.210502 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.210662 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 08:30:52.210731 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.210796 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 08:30:52.210856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.210913 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] command line args: [] {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 08:30:52.210969 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] list_limit = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.211035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 08:30:52.211100 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] log_config_append = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.211158 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ================================================================================ {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 08:30:52.211225 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.211290 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] admin_token = **** {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.211354 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] log_dir = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.211354 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] log_file = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.211472 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] config_dir = [] {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.211472 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.211581 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.211691 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] config_source = [] {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.211755 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.211823 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] debug = True {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.211888 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.211951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.212034 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.212095 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.212163 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.212224 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.212323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.212442 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.212558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.212657 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.212805 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.212916 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] list_limit = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.213031 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.213127 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] log_config_append = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.213200 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.213279 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.213357 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] log_dir = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.213480 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.213583 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] log_file = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.213715 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.213810 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.213964 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.214077 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.214204 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.214282 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.214455 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.214543 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.214628 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.214802 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.214939 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.215045 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.215176 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] publish_errors = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.215292 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.215377 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.215526 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.215604 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.215746 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.215835 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.215972 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.216057 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.216206 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.216284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.216438 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] standard_threads = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.216566 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.216669 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.216747 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.216910 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.216998 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.217083 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.217249 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] use_journal = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.217418 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.217498 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] use_json = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.217579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] use_stderr = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.217656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] publish_errors = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.217752 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] use_syslog = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.217837 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.217982 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.218071 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.218196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.218273 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.218440 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.218517 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.218672 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.218757 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.218904 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] standard_threads = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.218987 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.219134 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.219210 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.219373 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.219534 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.219639 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.219714 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.219794 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] use_journal = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.219872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.219944 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] use_json = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.220069 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] use_stderr = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.220147 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.220244 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] use_syslog = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.220344 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.220472 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 08:30:52.220594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.220734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.220820 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.220974 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.221052 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.221232 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.221316 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.221468 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.221547 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.221714 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.222304 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.222512 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.222594 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.222769 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.222848 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.223024 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.223102 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.223270 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.223347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.223507 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.223586 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.223775 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.223864 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.224009 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.224093 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.224257 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.224336 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.224493 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.224576 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.224735 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.224823 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.224967 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.225056 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.225198 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.225275 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.225433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.225586 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.225667 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.225739 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.225915 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.225998 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.226145 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.226241 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.226377 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.226461 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.226623 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.226701 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.226869 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.226954 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.227108 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.227224 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.227321 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.227413 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.227554 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.227662 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.227813 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.227892 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.228046 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.228128 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.228279 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.228393 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.228510 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.228615 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.228741 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.228852 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.228970 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.229082 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.229203 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.229307 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.229465 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.229608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.229699 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.229783 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.229912 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.230015 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.230140 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.230221 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.230373 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.230465 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.230605 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.230689 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.230835 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.230914 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.231067 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.231157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.231297 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.231383 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.231529 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.231641 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.231787 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.231866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.232023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.232105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.232253 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.232333 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.232481 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.232562 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.232709 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.232793 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.232943 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.233022 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.233177 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.233266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.233410 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.233490 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.233620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.233696 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.233860 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.233938 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.234097 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.234180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.234332 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.234416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.234566 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.234645 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.234801 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.234885 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.235037 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.235116 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.235288 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.235365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.235521 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.235606 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.235780 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.235859 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.236011 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.236098 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.236244 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.236329 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.236490 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.236569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.236720 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.236800 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.236953 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.237034 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.237180 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.237258 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.237439 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.238037 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.238293 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.238382 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.238544 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.238758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.238837 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.239010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.239100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.239243 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.239322 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.239479 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.239561 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.239749 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.239831 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.239995 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.240076 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.240232 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.240311 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.240474 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.240558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.240711 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.240791 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.240948 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.241027 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.241181 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.241261 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.241412 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.241492 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.241646 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.241723 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.241878 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.241963 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.242117 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.242197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.242351 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.242429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.242595 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.242674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.242832 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.242917 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.243069 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.243148 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.243307 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.243385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.243549 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.243687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.243806 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.243899 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.244037 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.244117 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.244269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.244355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] auth.external = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.244504 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.244582 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.244734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.244812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.244975 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.245061 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.245209 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.245289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] auth.password = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.245461 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] auth.token = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.245545 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.245700 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.245779 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.245933 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.246036 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.246180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.246262 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.246413 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.246491 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.246648 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] auth.external = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.246728 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.246879 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.246966 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.247112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.247191 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.247346 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] credential.caching = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.247427 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.247593 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.247729 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] auth.password = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.247859 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] auth.token = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.247939 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.248102 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.248183 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.248338 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.248418 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.248581 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.248660 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.248812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.248892 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.249054 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.249133 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.249301 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.249381 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.249533 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.249614 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.249770 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] credential.caching = True {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.249857 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.250015 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.250094 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.250262 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.250343 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.250509 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.250588 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.250746 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.250826 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.250989 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.251070 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.251222 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] federation.caching = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.251300 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.251459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.251544 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.251743 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.251832 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.251978 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.252061 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.252207 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.252293 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.252455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.252535 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.252691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.252770 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.252944 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.253033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.253231 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.253314 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.253530 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.253610 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.253771 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.253859 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] federation.caching = True {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.254019 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.254098 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.254253 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] identity.caching = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.254332 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.254499 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.254585 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.254730 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.254809 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.254966 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.255044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.255201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.255287 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.255446 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.255525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.255703 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.255826 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.255945 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.256038 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.256184 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.256263 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.256433 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.256512 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.256664 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.256751 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] identity.caching = True {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.256897 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.256977 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.257128 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.257207 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.257364 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.257451 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.257609 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.257691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.257845 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.257924 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.258075 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.258162 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.258314 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.258393 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.258562 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.258641 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.258812 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.258899 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.259046 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.259126 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.259276 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.259354 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.259514 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.259604 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.259779 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.259860 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.260016 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.260095 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.260256 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.260348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.260496 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.260576 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.260740 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.260819 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.260969 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.261050 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.261215 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.261294 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.261458 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.261536 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.261688 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.261769 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.261926 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.262006 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.262156 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.262243 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.262385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.262465 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.262623 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.262739 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.262850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.262929 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.263099 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.263183 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.263315 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.263396 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.263554 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.263680 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.263819 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.263902 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.264052 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.264130 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.264297 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.264376 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.264540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.264620 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.264767 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.264846 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.264998 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.265078 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.265224 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.265304 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.265461 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.265540 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.265696 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.265779 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.265928 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.266008 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.266161 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.266240 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.266391 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.266470 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.266629 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.266711 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.266873 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.266950 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.267105 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.267184 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.267332 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.267411 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.267578 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.267676 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.267847 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.267927 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.268078 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.268160 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.268308 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.268388 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.268539 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.268618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.268794 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.268874 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.user = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.269030 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.269241 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.269320 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.269392 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.269498 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.269580 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.269739 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.269849 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.269988 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.270098 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.270233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.270346 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.270465 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.270593 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.270694 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.270824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.270912 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.271072 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.271153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.271311 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.271380 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.271592 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.271759 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.271906 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.272034 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.272111 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.272184 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.272256 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.272406 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.272488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.272654 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.272734 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.272900 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.272980 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.273132 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.273213 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.273379 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.273459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.273616 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.273695 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.273851 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.273931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.274084 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.274162 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.274320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.274399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.274550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.274625 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.274775 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.274855 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.275014 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.275094 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.275253 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] resource.caching = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.275334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.275483 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.275562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.275749 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.275844 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.275989 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.276069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.276223 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.276302 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.276460 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.276546 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.276701 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.276780 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.276939 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.277019 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.277170 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.277257 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.277408 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.277524 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.277650 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] role.caching = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.277727 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] resource.caching = True {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.277876 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] role.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.277964 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.278109 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.278188 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.278355 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.278433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.278600 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.278687 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.278846 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.278925 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.279082 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.279164 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.279327 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.279414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.279564 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.279662 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.279834 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.279914 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.280069 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] role.caching = True {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.280160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.280299 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.280377 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] role.driver = sql {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.280531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.280609 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.280778 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.280865 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.281022 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.281100 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.281264 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.281342 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.281509 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.281655 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.281756 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.281894 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.282002 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.282146 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.282246 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.282393 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.282494 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.282639 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.282718 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.282884 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.282969 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.283120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.283200 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.283373 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.283451 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.283652 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.283747 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.283889 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.284055 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.284133 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.284804 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.284895 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.285135 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.285217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.285339 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.285454 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.285594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.285710 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.285843 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.286205 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.286335 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.286450 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.286572 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.286703 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.286790 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.286953 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.287033 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] token.caching = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.287193 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.287272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.287425 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.287514 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.287696 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.287779 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.287931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.288010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.288183 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.288275 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.288456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.288588 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.288666 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.288739 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.288898 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.288987 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.289132 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.289211 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.289366 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.289445 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.289601 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] token.caching = True {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.289688 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.289838 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.289919 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.290082 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.290160 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.290314 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.290401 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.290546 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.290625 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.290789 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.290868 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.291029 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.291116 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.291273 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.291353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] database.connection = **** {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.291514 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.291602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.291782 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.291860 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.292010 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.292098 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.292250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.292330 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.292483 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.292563 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.292718 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.292798 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.292954 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.293033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.293182 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.293259 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.293424 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.293507 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.293661 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.293743 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.293905 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.293984 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] database.connection = **** {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.294142 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.294230 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.294379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.294457 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.294615 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.294694 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.294861 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.294941 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.295092 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.295173 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.295329 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.295408 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.295560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.295659 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.295747 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 08:30:52.295822 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.296054 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.296533 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.296533 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.296762 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.297008 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.297244 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.297489 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.297720 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.297959 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.298192 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 08:30:52.298363 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 08:30:52.324692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.324922 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.325149 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.326801 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.327033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.327256 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.334026 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.336261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.364249 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.364405 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.364481 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.364556 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.417139 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.417328 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.467857 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.468089 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.468881 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.469124 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.532797 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.532952 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.533036 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.533167 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.533251 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.533392 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.533476 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.533616 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.533701 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.533837 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.533920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.534053 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.557753 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.557992 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.558154 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.558236 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.558311 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.558428 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.558512 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.558648 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.558731 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.558868 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.558962 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.559083 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.559165 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.559296 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.570231 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.570562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.583401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.583649 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.583881 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.584060 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.584145 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.584296 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.584381 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.584510 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.584591 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.584725 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.584817 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.584942 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.585159 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.585375 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 08:30:52.602730 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.602938 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 08:30:52.603037 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.603217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 08:30:52.603300 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.603465 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 08:30:52.603547 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.603759 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.603844 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 08:30:52.604021 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.604105 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.604277 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.604358 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.604528 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.604609 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.604782 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.615615 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.615701 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.615907 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.615990 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.616172 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.616254 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.616448 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.616529 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.624698 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.624788 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.628001 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.628138 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.628305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.628465 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.628587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.628867 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.628950 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.629146 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.629238 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.629404 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.629486 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.629670 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.629751 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.629938 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.630027 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.630203 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.630284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.630472 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.630552 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.630734 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.630816 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.630999 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.659979 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.661487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.661858 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.662138 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.663108 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.663388 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.667449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.667827 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.668114 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.668717 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.669104 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.669386 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.676068 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.676323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.677674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.677955 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.680812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.681097 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.681374 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.681648 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.681920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.682188 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.682453 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.682549 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.682716 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.682799 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.683004 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.683281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.683549 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.683840 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.684105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.684376 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.702355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.702635 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.704125 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.704407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.707742 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.711423 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.711598 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.711855 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.715407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.715879 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.716956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.720630 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.720908 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.725044 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.725416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.725706 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.725964 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.726106 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.726266 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.726561 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.729623 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.729920 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.730200 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.730485 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.730755 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.731045 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.746472 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.746753 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.747018 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.747280 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.751191 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.751475 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.751763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.752025 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.755516 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.757252 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.757529 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.760534 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.760724 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.761014 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.761302 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.761583 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.761858 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.762246 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.762525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.765716 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.766002 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.766290 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.766569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.766845 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.775431 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.775739 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.776024 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.776311 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.776683 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.776966 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.777244 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.780862 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.781140 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.781418 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.781703 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.782070 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.782350 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.782624 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.796013 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.799273 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.802931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.803170 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.804947 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.806197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.806589 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.806864 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.807163 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.809525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.811260 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.812925 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.813202 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.813479 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.814470 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.816246 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.819480 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.819795 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.820197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.820486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.821359 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.823120 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.826390 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.826688 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.827074 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.827365 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.829629 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.829918 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.830199 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.836956 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.837240 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.837516 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.838153 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.838432 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.838709 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.838980 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.839252 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.839651 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.839932 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.840213 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.840484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.840757 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.841036 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.841309 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.841589 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.841856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.845375 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 08:30:52.845654 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.845936 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.846208 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.846483 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.847770 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.848058 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.848338 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.848609 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.848879 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.849158 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.849429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.849713 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.849973 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 08:30:52.880891 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ac2e0fd9c0 pid: 86942 (default app) Jul 25 08:30:52.884302 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49d720-f077-48ca-95d8-477a9ebd5e04 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:30:52.884598 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49d720-f077-48ca-95d8-477a9ebd5e04 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:30:52.884878 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49d720-f077-48ca-95d8-477a9ebd5e04 None None] PATH_INFO: `/v3` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:30:52.889025 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Mon Jul 25 08:30:52 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:30:52.890420 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ac2e0fd9c0 pid: 86941 (default app) Jul 25 08:31:01.483218 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b0063-0be0-47f8-be5f-f6649b52824d None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:01.483816 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b0063-0be0-47f8-be5f-f6649b52824d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:01.483816 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b0063-0be0-47f8-be5f-f6649b52824d None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:01.485139 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 2/2] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:01.493087 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ca9b6-8478-4876-93b1-5a623ca7f8dd None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:01.493491 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ca9b6-8478-4876-93b1-5a623ca7f8dd None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:01.493656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ca9b6-8478-4876-93b1-5a623ca7f8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:01.565455 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: INFO dbcounter [None req-108ca9b6-8478-4876-93b1-5a623ca7f8dd None None] Registered counter for database keystone Jul 25 08:31:01.587522 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG oslo_db.sqlalchemy.engines [None req-108ca9b6-8478-4876-93b1-5a623ca7f8dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86941) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 08:31:01.593642 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writer thread running {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 08:31:01.773900 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG passlib.handlers.bcrypt [None req-108ca9b6-8478-4876-93b1-5a623ca7f8dd None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86941) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 08:31:01.774245 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG passlib.handlers.bcrypt [None req-108ca9b6-8478-4876-93b1-5a623ca7f8dd None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86941) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 08:31:01.829484 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-108ca9b6-8478-4876-93b1-5a623ca7f8dd None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:01.831360 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-108ca9b6-8478-4876-93b1-5a623ca7f8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:01.954375 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1/3] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 25 08:31:02.079311 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b0063-0be0-47f8-be5f-f6649b52824d None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:02.149499 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: INFO dbcounter [None req-1d4b0063-0be0-47f8-be5f-f6649b52824d None None] Registered counter for database keystone Jul 25 08:31:02.168978 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG oslo_db.sqlalchemy.engines [None req-1d4b0063-0be0-47f8-be5f-f6649b52824d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86942) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 08:31:02.175770 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writer thread running {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 08:31:02.294420 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b0063-0be0-47f8-be5f-f6649b52824d None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:02.298726 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad8324-1187-40db-ad5f-7956eca4f483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:02.299386 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad8324-1187-40db-ad5f-7956eca4f483 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:02.300220 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad8324-1187-40db-ad5f-7956eca4f483 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:02.300499 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad8324-1187-40db-ad5f-7956eca4f483 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:02.309091 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad8324-1187-40db-ad5f-7956eca4f483 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:02.358775 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9aad8324-1187-40db-ad5f-7956eca4f483 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 08:31:02.359062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad8324-1187-40db-ad5f-7956eca4f483 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:02.369291 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 3/4] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Jul 25 08:31:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 08:31:02.375257 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ca9b6-8478-4876-93b1-5a623ca7f8dd None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:02.390451 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ca9b6-8478-4876-93b1-5a623ca7f8dd None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:02.395076 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4e53d-9657-4c90-9e6c-dbb44fae3bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:02.396348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4e53d-9657-4c90-9e6c-dbb44fae3bcf admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:02.396637 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4e53d-9657-4c90-9e6c-dbb44fae3bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:02.396913 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4e53d-9657-4c90-9e6c-dbb44fae3bcf admin admin] PATH_INFO: `/v3/projects/dc9626b4086645e5810dd68fb6d20d03` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:02.398406 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e4e53d-9657-4c90-9e6c-dbb44fae3bcf admin admin] RBAC: Authorizing `identity:get_project(project_id=dc9626b4086645e5810dd68fb6d20d03)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:02.452373 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b4e4e53d-9657-4c90-9e6c-dbb44fae3bcf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 08:31:02.452714 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e4e53d-9657-4c90-9e6c-dbb44fae3bcf admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:02.457573 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 2/5] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Jul 25 08:31:02 2022] GET /identity/v3/projects/dc9626b4086645e5810dd68fb6d20d03 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:04.406162 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4276f-2fa7-4826-bde6-0d007a7173c0 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:04.406717 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4276f-2fa7-4826-bde6-0d007a7173c0 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:04.406717 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4276f-2fa7-4826-bde6-0d007a7173c0 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:04.411425 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 4/6] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:31:04.416895 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fd8c2-ae42-4eec-b105-c3423bfa61b5 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:04.417298 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fd8c2-ae42-4eec-b105-c3423bfa61b5 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:04.417446 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fd8c2-ae42-4eec-b105-c3423bfa61b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:04.437779 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-557fd8c2-ae42-4eec-b105-c3423bfa61b5 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:04.439277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-557fd8c2-ae42-4eec-b105-c3423bfa61b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:04.448055 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 3/7] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 25 08:31:04.469600 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4276f-2fa7-4826-bde6-0d007a7173c0 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:04.481735 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4276f-2fa7-4826-bde6-0d007a7173c0 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:04.485933 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c5afd-9348-49ea-b2f0-94a4eac37170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:04.486561 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c5afd-9348-49ea-b2f0-94a4eac37170 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:04.486850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c5afd-9348-49ea-b2f0-94a4eac37170 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:04.487884 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c5afd-9348-49ea-b2f0-94a4eac37170 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:04.495514 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c5afd-9348-49ea-b2f0-94a4eac37170 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:04.497310 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c5afd-9348-49ea-b2f0-94a4eac37170 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:04.506887 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 5/8] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Jul 25 08:31:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 08:31:04.512108 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fd8c2-ae42-4eec-b105-c3423bfa61b5 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:04.521348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fd8c2-ae42-4eec-b105-c3423bfa61b5 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:04.525742 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad0621-ab0b-422b-80dc-fba562d61a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:04.526602 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad0621-ab0b-422b-80dc-fba562d61a0a admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:04.526887 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad0621-ab0b-422b-80dc-fba562d61a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:04.527163 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad0621-ab0b-422b-80dc-fba562d61a0a admin admin] PATH_INFO: `/v3/users/d3e81ab686314e4bafebf32342e3e7a2` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:04.528567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad0621-ab0b-422b-80dc-fba562d61a0a admin admin] RBAC: Authorizing `identity:get_user(user_id=d3e81ab686314e4bafebf32342e3e7a2)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:04.530379 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad0621-ab0b-422b-80dc-fba562d61a0a admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:04.531976 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 4/9] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Jul 25 08:31:04 2022] GET /identity/v3/users/d3e81ab686314e4bafebf32342e3e7a2 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:06.571754 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa02df-0f47-4df0-a4e1-3e5c06e65cdb None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:06.572293 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa02df-0f47-4df0-a4e1-3e5c06e65cdb None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:06.572293 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa02df-0f47-4df0-a4e1-3e5c06e65cdb None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:06.573669 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 6/10] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:06.578755 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61d0b7-f6f3-419e-a84e-2ff2ad84ec59 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:06.579182 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61d0b7-f6f3-419e-a84e-2ff2ad84ec59 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:06.579321 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61d0b7-f6f3-419e-a84e-2ff2ad84ec59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:06.593124 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3cf9d-75d7-4be9-a50c-8df86a6011e5 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:06.593417 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3cf9d-75d7-4be9-a50c-8df86a6011e5 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:06.593703 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3cf9d-75d7-4be9-a50c-8df86a6011e5 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:06.595024 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 7/11] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:31:06.597633 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-7b61d0b7-f6f3-419e-a84e-2ff2ad84ec59 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:06.598813 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-7b61d0b7-f6f3-419e-a84e-2ff2ad84ec59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:06.599882 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65c2c7-68b1-44fa-8eec-a8156f920ff1 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:06.600174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65c2c7-68b1-44fa-8eec-a8156f920ff1 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:06.600452 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65c2c7-68b1-44fa-8eec-a8156f920ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:06.644249 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG passlib.handlers.bcrypt [None req-2b65c2c7-68b1-44fa-8eec-a8156f920ff1 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86942) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 08:31:06.644671 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG passlib.handlers.bcrypt [None req-2b65c2c7-68b1-44fa-8eec-a8156f920ff1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86942) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 08:31:06.679421 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 5/12] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:31:06.690968 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-2b65c2c7-68b1-44fa-8eec-a8156f920ff1 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:06.692599 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-2b65c2c7-68b1-44fa-8eec-a8156f920ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:06.701742 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61d0b7-f6f3-419e-a84e-2ff2ad84ec59 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:06.725649 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:06.792464 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 8/13] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:31:06.803852 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61d0b7-f6f3-419e-a84e-2ff2ad84ec59 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:06.814998 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65c2c7-68b1-44fa-8eec-a8156f920ff1 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:06.837533 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a98ab-153a-43db-8c55-c8b90186bae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:06.838272 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a98ab-153a-43db-8c55-c8b90186bae7 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:06.838561 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a98ab-153a-43db-8c55-c8b90186bae7 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:06.838838 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a98ab-153a-43db-8c55-c8b90186bae7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:06.850133 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a98ab-153a-43db-8c55-c8b90186bae7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:06.861390 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-387a98ab-153a-43db-8c55-c8b90186bae7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:31:06.861390 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:06.861390 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:06.861390 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:06.861390 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:06.861390 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:06.861390 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:06.861390 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:06.861390 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:06.861390 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:06.861390 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:06.861390 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:06.861390 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:06.861390 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:06.861390 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:06.861390 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:06.862999 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:06.862999 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:06.862999 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:06.862999 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:06.862999 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:06.862999 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:06.862999 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:06.862999 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:06.862999 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:06.862999 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:06.862999 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:06.862999 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:06.862999 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:06.862999 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:06.862999 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:06.862999 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:06.864025 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:06.864025 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:06.864025 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:06.864025 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:06.864025 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:06.864025 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:06.864025 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:06.864025 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:06.864025 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:06.864025 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:06.864025 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:31:06.864025 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:31:06.864025 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 6/14] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:31:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:31:06.869141 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a98ab-153a-43db-8c55-c8b90186bae7 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:06.918341 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65c2c7-68b1-44fa-8eec-a8156f920ff1 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:06.920796 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:06.951507 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:06.956991 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617325fd-daf8-416c-9f3d-24e91548cb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:06.957895 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617325fd-daf8-416c-9f3d-24e91548cb2f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:06.958188 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617325fd-daf8-416c-9f3d-24e91548cb2f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:06.958471 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617325fd-daf8-416c-9f3d-24e91548cb2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:06.969269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a98ab-153a-43db-8c55-c8b90186bae7 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:07.004504 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9305c1-ae83-438b-85d3-d7a7392edb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:07.005165 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9305c1-ae83-438b-85d3-d7a7392edb45 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:07.005449 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9305c1-ae83-438b-85d3-d7a7392edb45 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:07.005723 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9305c1-ae83-438b-85d3-d7a7392edb45 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:07.006470 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9305c1-ae83-438b-85d3-d7a7392edb45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:07.006778 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9305c1-ae83-438b-85d3-d7a7392edb45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:07.008205 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9305c1-ae83-438b-85d3-d7a7392edb45 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:07.019742 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 7/15] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:07.025307 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9305c1-ae83-438b-85d3-d7a7392edb45 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:07.028816 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617325fd-daf8-416c-9f3d-24e91548cb2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:07.030346 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617325fd-daf8-416c-9f3d-24e91548cb2f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:07.123747 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9305c1-ae83-438b-85d3-d7a7392edb45 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:07.128418 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 9/16] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:31:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 08:31:07.133911 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617325fd-daf8-416c-9f3d-24e91548cb2f None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:07.136618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:07.156687 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379d041-5345-4af3-9af4-7e8739881f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:07.157556 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379d041-5345-4af3-9af4-7e8739881f10 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:07.157844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379d041-5345-4af3-9af4-7e8739881f10 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:07.158123 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379d041-5345-4af3-9af4-7e8739881f10 None admin] PATH_INFO: `/v3/users/d3e81ab686314e4bafebf32342e3e7a2` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:07.160112 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d379d041-5345-4af3-9af4-7e8739881f10 None admin] RBAC: Authorizing `identity:get_user(user_id=d3e81ab686314e4bafebf32342e3e7a2)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:07.161842 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d379d041-5345-4af3-9af4-7e8739881f10 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:07.163476 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 8/17] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:07 2022] GET /identity/v3/users/d3e81ab686314e4bafebf32342e3e7a2 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:07.168755 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379d041-5345-4af3-9af4-7e8739881f10 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:07.184217 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:07.231789 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617325fd-daf8-416c-9f3d-24e91548cb2f None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:07.264863 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8abae-a309-4661-8b70-cbee27b072c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:07.265709 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8abae-a309-4661-8b70-cbee27b072c0 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:07.265995 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8abae-a309-4661-8b70-cbee27b072c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:07.266269 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8abae-a309-4661-8b70-cbee27b072c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:07.267922 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379d041-5345-4af3-9af4-7e8739881f10 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:07.285244 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d8abae-a309-4661-8b70-cbee27b072c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:07.286987 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d8abae-a309-4661-8b70-cbee27b072c0 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:07.302742 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32233d1-c8ad-4468-8e9b-e618b34a34ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:07.303533 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32233d1-c8ad-4468-8e9b-e618b34a34ee None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:07.303847 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32233d1-c8ad-4468-8e9b-e618b34a34ee None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:07.304124 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32233d1-c8ad-4468-8e9b-e618b34a34ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:07.305314 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32233d1-c8ad-4468-8e9b-e618b34a34ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:07.306774 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32233d1-c8ad-4468-8e9b-e618b34a34ee None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:07.308422 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 9/18] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:07.308538 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-c1d8abae-a309-4661-8b70-cbee27b072c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:31:07.308538 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:07.308538 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:07.308538 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:07.308538 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:07.308538 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:07.308538 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:07.308538 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:07.308538 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:07.308538 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:07.308538 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:07.308538 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:07.308538 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:31:07.308538 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:31:07.308538 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:31:07.309286 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:31:07.309286 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:07.309286 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:07.309286 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:07.309286 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:07.309286 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:07.309286 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:07.309286 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:07.309286 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:07.309286 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:07.309286 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:07.309286 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:07.309286 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:07.309286 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:07.309286 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:07.309286 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:07.309286 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:07.310090 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:31:07.310090 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:31:07.310090 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:31:07.310090 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:31:07.310090 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 10/19] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:31:07.314403 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32233d1-c8ad-4468-8e9b-e618b34a34ee None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:07.315178 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8abae-a309-4661-8b70-cbee27b072c0 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:07.370463 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:07.395136 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:07.414387 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32233d1-c8ad-4468-8e9b-e618b34a34ee None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:07.414912 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8abae-a309-4661-8b70-cbee27b072c0 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:07.448667 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9410d-eaf9-4350-a467-0a61f7744eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:07.448900 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aef060-8133-40e0-b96e-927fd445e47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:07.449325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9410d-eaf9-4350-a467-0a61f7744eae None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:07.449558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aef060-8133-40e0-b96e-927fd445e47a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:07.449647 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9410d-eaf9-4350-a467-0a61f7744eae None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:07.449847 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aef060-8133-40e0-b96e-927fd445e47a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:07.449935 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9410d-eaf9-4350-a467-0a61f7744eae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:07.450130 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aef060-8133-40e0-b96e-927fd445e47a None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:07.450702 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9410d-eaf9-4350-a467-0a61f7744eae None admin] RBAC: Adding query filter params (role.id=25b0f48c10474bf6b98aad8f093868ee, scope.domain.id=default, user.id=d3e81ab686314e4bafebf32342e3e7a2) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:07.450867 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aef060-8133-40e0-b96e-927fd445e47a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:07.451015 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9410d-eaf9-4350-a467-0a61f7744eae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:07.451180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aef060-8133-40e0-b96e-927fd445e47a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:07.452556 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9410d-eaf9-4350-a467-0a61f7744eae None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:07.452683 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aef060-8133-40e0-b96e-927fd445e47a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:07.460047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 10/20] 10.222.0.18 () {56 vars in 1322 bytes} [Mon Jul 25 08:31:07 2022] GET /identity/v3/role_assignments?user.id=d3e81ab686314e4bafebf32342e3e7a2&scope.domain.id=default&role.id=25b0f48c10474bf6b98aad8f093868ee => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:07.473087 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 11/21] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:09.782684 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe730fc-3bbb-4e0f-8d9c-db7cb32fca97 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:09.783189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe730fc-3bbb-4e0f-8d9c-db7cb32fca97 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:09.783261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe730fc-3bbb-4e0f-8d9c-db7cb32fca97 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:09.785031 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 11/22] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:09.790703 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27642962-032e-469d-885c-4cb89f944d35 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:09.791155 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27642962-032e-469d-885c-4cb89f944d35 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:09.791331 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27642962-032e-469d-885c-4cb89f944d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:09.812167 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-27642962-032e-469d-885c-4cb89f944d35 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:09.813363 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-27642962-032e-469d-885c-4cb89f944d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:09.902760 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 12/23] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:09.942639 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe730fc-3bbb-4e0f-8d9c-db7cb32fca97 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:09.961062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099050fe-12da-4a45-8a7f-f9aadfa1e66e None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:09.961271 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099050fe-12da-4a45-8a7f-f9aadfa1e66e None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:09.961757 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099050fe-12da-4a45-8a7f-f9aadfa1e66e None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:09.963321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:31:09.968459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de8484-b692-4566-b7ab-5e770177e29f None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:09.968997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de8484-b692-4566-b7ab-5e770177e29f None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:09.969480 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de8484-b692-4566-b7ab-5e770177e29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:10.000428 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-52de8484-b692-4566-b7ab-5e770177e29f None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:10.003550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-52de8484-b692-4566-b7ab-5e770177e29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:10.115316 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:10.158620 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 14/25] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:31:10.161353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c4309-bb05-4ab2-9b27-888ff4feba56 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:10.161891 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c4309-bb05-4ab2-9b27-888ff4feba56 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:10.162361 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c4309-bb05-4ab2-9b27-888ff4feba56 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:10.163853 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 15/26] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:10.168896 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cd55a-4ad2-48af-8660-766565e6a86c None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:10.169396 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cd55a-4ad2-48af-8660-766565e6a86c None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:10.169496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe730fc-3bbb-4e0f-8d9c-db7cb32fca97 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:10.169970 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cd55a-4ad2-48af-8660-766565e6a86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:10.195736 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-804cd55a-4ad2-48af-8660-766565e6a86c None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:10.198593 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-804cd55a-4ad2-48af-8660-766565e6a86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:10.239308 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1871901-bb40-4613-84f3-c7617d69f1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:10.240457 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1871901-bb40-4613-84f3-c7617d69f1d4 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:10.240935 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1871901-bb40-4613-84f3-c7617d69f1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:10.241403 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1871901-bb40-4613-84f3-c7617d69f1d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:10.258350 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1871901-bb40-4613-84f3-c7617d69f1d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:10.268931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-d1871901-bb40-4613-84f3-c7617d69f1d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:31:10.268931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:10.268931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:10.268931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:10.268931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:10.268931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:10.268931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:10.268931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:10.268931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:10.268931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:10.268931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:10.268931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:10.268931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:10.268931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:10.268931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:10.268931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:10.269758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:10.269758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:10.269758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:10.269758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:10.269758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:10.269758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:10.269758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:10.269758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:10.269758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:10.269758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:10.269758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:10.269758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:10.269758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:10.269758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:10.269758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:10.269758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:10.270525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:10.270525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:10.270525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:10.270525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:10.270525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:10.270525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:10.270525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:10.270525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:10.270525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:10.270525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:10.270525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:31:10.270525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:31:10.274141 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 12/27] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:31:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:10.275157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1871901-bb40-4613-84f3-c7617d69f1d4 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:10.311971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:10.341757 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 16/28] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:31:10.341933 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cd55a-4ad2-48af-8660-766565e6a86c None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:10.584249 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1871901-bb40-4613-84f3-c7617d69f1d4 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:10.585809 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cd55a-4ad2-48af-8660-766565e6a86c None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:10.599939 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:10.645970 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301673b-85b9-4e2b-9676-8d09e48c7cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:10.646650 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301673b-85b9-4e2b-9676-8d09e48c7cc1 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:10.646939 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301673b-85b9-4e2b-9676-8d09e48c7cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:10.647220 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301673b-85b9-4e2b-9676-8d09e48c7cc1 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:10.648016 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301673b-85b9-4e2b-9676-8d09e48c7cc1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:10.648326 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301673b-85b9-4e2b-9676-8d09e48c7cc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:10.649717 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301673b-85b9-4e2b-9676-8d09e48c7cc1 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:10.659563 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1acb0af-f52f-495c-b3a9-fa26808f3b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:10.660389 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acb0af-f52f-495c-b3a9-fa26808f3b8f None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:10.660926 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acb0af-f52f-495c-b3a9-fa26808f3b8f None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:10.661202 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acb0af-f52f-495c-b3a9-fa26808f3b8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:10.675436 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 17/29] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:10.675749 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1acb0af-f52f-495c-b3a9-fa26808f3b8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:10.676456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301673b-85b9-4e2b-9676-8d09e48c7cc1 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:10.677254 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1acb0af-f52f-495c-b3a9-fa26808f3b8f None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:10.702971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-d1acb0af-f52f-495c-b3a9-fa26808f3b8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:31:10.702971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:10.702971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:10.702971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:10.702971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:10.702971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:10.702971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:10.702971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:10.702971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:10.702971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:10.702971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:10.702971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:10.702971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:31:10.702971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:31:10.702971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:31:10.703866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:31:10.703866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:10.703866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:10.703866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:10.703866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:10.703866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:10.703866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:10.703866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:10.703866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:10.703866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:10.703866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:10.703866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:10.703866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:10.703866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:10.703866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:10.703866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:10.703866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:10.704668 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:31:10.704668 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:31:10.704668 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:31:10.704668 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:31:10.704668 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 13/30] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:10.711287 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ced62-ab23-49c5-8ed5-59cd396b0943 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:10.711389 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ced62-ab23-49c5-8ed5-59cd396b0943 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:10.711686 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ced62-ab23-49c5-8ed5-59cd396b0943 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:10.713316 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 14/31] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:10.713889 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ced62-ab23-49c5-8ed5-59cd396b0943 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:10.784642 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:10.801365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301673b-85b9-4e2b-9676-8d09e48c7cc1 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:10.841332 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77375b81-2ebf-46ae-b8d9-8fdcb1f1d95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:10.841968 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77375b81-2ebf-46ae-b8d9-8fdcb1f1d95b None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:10.842416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77375b81-2ebf-46ae-b8d9-8fdcb1f1d95b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:10.842820 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ced62-ab23-49c5-8ed5-59cd396b0943 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:10.843119 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77375b81-2ebf-46ae-b8d9-8fdcb1f1d95b None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:10.844060 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77375b81-2ebf-46ae-b8d9-8fdcb1f1d95b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:10.845671 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77375b81-2ebf-46ae-b8d9-8fdcb1f1d95b None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:10.883164 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b28c4-1bab-4059-9c25-0b5a7e4e5093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:10.884081 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b28c4-1bab-4059-9c25-0b5a7e4e5093 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:10.884369 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b28c4-1bab-4059-9c25-0b5a7e4e5093 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:10.884665 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b28c4-1bab-4059-9c25-0b5a7e4e5093 None admin] PATH_INFO: `/v3/users/d3e81ab686314e4bafebf32342e3e7a2` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:10.885846 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b28c4-1bab-4059-9c25-0b5a7e4e5093 None admin] RBAC: Authorizing `identity:get_user(user_id=d3e81ab686314e4bafebf32342e3e7a2)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:10.887311 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b28c4-1bab-4059-9c25-0b5a7e4e5093 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:10.888974 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 15/32] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:10 2022] GET /identity/v3/users/d3e81ab686314e4bafebf32342e3e7a2 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:10.889744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b28c4-1bab-4059-9c25-0b5a7e4e5093 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:10.996511 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b28c4-1bab-4059-9c25-0b5a7e4e5093 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:11.023779 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:11.045001 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4740ca-f326-4d90-becf-4e13397d8600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:11.045772 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4740ca-f326-4d90-becf-4e13397d8600 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:11.046057 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4740ca-f326-4d90-becf-4e13397d8600 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:11.046345 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4740ca-f326-4d90-becf-4e13397d8600 None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:11.047225 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4740ca-f326-4d90-becf-4e13397d8600 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:11.047546 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4740ca-f326-4d90-becf-4e13397d8600 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:11.049018 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4740ca-f326-4d90-becf-4e13397d8600 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:11.070724 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 16/33] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:11.072148 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae4639-275a-48cd-bcab-625b3e8881cd None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:11.072440 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae4639-275a-48cd-bcab-625b3e8881cd None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:11.072719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae4639-275a-48cd-bcab-625b3e8881cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:11.098111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-17ae4639-275a-48cd-bcab-625b3e8881cd None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:11.099389 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-17ae4639-275a-48cd-bcab-625b3e8881cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:11.185889 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 17/34] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:11.187270 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae4639-275a-48cd-bcab-625b3e8881cd None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:11.220458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 18/35] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Jul 25 08:31:10 2022] POST /identity/v3/roles => generated 219 bytes in 544 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:31:11.223558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9a545-9bcb-446c-82dc-ac470c6ed200 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:11.223702 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9a545-9bcb-446c-82dc-ac470c6ed200 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:11.223915 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9a545-9bcb-446c-82dc-ac470c6ed200 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:11.229273 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 19/36] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:11.229273 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9a545-9bcb-446c-82dc-ac470c6ed200 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:11.264943 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:11.354503 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae4639-275a-48cd-bcab-625b3e8881cd None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:11.379236 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:11.411831 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9a545-9bcb-446c-82dc-ac470c6ed200 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:11.413358 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecd558-fcb0-4f17-882b-bea60c8e76e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:11.414164 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecd558-fcb0-4f17-882b-bea60c8e76e9 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:11.415293 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecd558-fcb0-4f17-882b-bea60c8e76e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:11.415293 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecd558-fcb0-4f17-882b-bea60c8e76e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:11.415999 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecd558-fcb0-4f17-882b-bea60c8e76e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:11.419111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecd558-fcb0-4f17-882b-bea60c8e76e9 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:11.421035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 18/37] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:11.421997 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecd558-fcb0-4f17-882b-bea60c8e76e9 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:11.475688 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159f33f-f3f9-41d7-990b-758f23cb2602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:11.475688 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159f33f-f3f9-41d7-990b-758f23cb2602 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:11.475688 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159f33f-f3f9-41d7-990b-758f23cb2602 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:11.475688 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159f33f-f3f9-41d7-990b-758f23cb2602 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:11.476095 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e159f33f-f3f9-41d7-990b-758f23cb2602 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:11.476357 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e159f33f-f3f9-41d7-990b-758f23cb2602 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:11.549593 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecd558-fcb0-4f17-882b-bea60c8e76e9 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:11.582876 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036a147-ed07-4fb1-8fa7-323e6a5244b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:11.583536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036a147-ed07-4fb1-8fa7-323e6a5244b5 None admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:11.583845 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036a147-ed07-4fb1-8fa7-323e6a5244b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:11.584120 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036a147-ed07-4fb1-8fa7-323e6a5244b5 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:11.584862 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036a147-ed07-4fb1-8fa7-323e6a5244b5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:11.586227 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036a147-ed07-4fb1-8fa7-323e6a5244b5 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:11.607520 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 20/38] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jul 25 08:31:11 2022] POST /identity/v3/projects => generated 301 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:31:11.608766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d3fda-abef-47ed-a1d7-877c4ee05a38 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:11.609063 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d3fda-abef-47ed-a1d7-877c4ee05a38 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:11.609339 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d3fda-abef-47ed-a1d7-877c4ee05a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:11.631765 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-da9d3fda-abef-47ed-a1d7-877c4ee05a38 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:11.633377 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-da9d3fda-abef-47ed-a1d7-877c4ee05a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:11.719102 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 21/39] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:11.719848 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d3fda-abef-47ed-a1d7-877c4ee05a38 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:11.733805 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:11.777798 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 19/40] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Jul 25 08:31:11 2022] POST /identity/v3/roles => generated 225 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:31:11.779729 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077a302-d997-4e25-bc80-3bbb9af66f57 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:11.780234 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077a302-d997-4e25-bc80-3bbb9af66f57 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:11.780718 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077a302-d997-4e25-bc80-3bbb9af66f57 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:11.782281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 20/41] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:11.783194 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077a302-d997-4e25-bc80-3bbb9af66f57 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:11.843313 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d3fda-abef-47ed-a1d7-877c4ee05a38 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:11.850786 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:11.887793 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668858f-264e-4e23-80c9-36608f3644ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:11.888732 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668858f-264e-4e23-80c9-36608f3644ff None admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:11.889099 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668858f-264e-4e23-80c9-36608f3644ff None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:11.889399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668858f-264e-4e23-80c9-36608f3644ff None admin] PATH_INFO: `/v3/domains/default/users/d3e81ab686314e4bafebf32342e3e7a2/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:11.892068 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668858f-264e-4e23-80c9-36608f3644ff None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d3e81ab686314e4bafebf32342e3e7a2, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:11.894152 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668858f-264e-4e23-80c9-36608f3644ff None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:11.924480 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077a302-d997-4e25-bc80-3bbb9af66f57 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:11.960286 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407a12c-0f50-4969-bc50-ac81e9b54408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:11.960967 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407a12c-0f50-4969-bc50-ac81e9b54408 None admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:11.961265 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407a12c-0f50-4969-bc50-ac81e9b54408 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:11.961551 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407a12c-0f50-4969-bc50-ac81e9b54408 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:11.962315 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407a12c-0f50-4969-bc50-ac81e9b54408 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:11.963880 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407a12c-0f50-4969-bc50-ac81e9b54408 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:12.001356 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 22/42] 10.222.0.18 () {58 vars in 1361 bytes} [Mon Jul 25 08:31:11 2022] PUT /identity/v3/domains/default/users/d3e81ab686314e4bafebf32342e3e7a2/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:31:12.003250 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c648357-510a-464b-b9fd-a6eb85461fab None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:12.003548 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c648357-510a-464b-b9fd-a6eb85461fab None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:12.003892 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c648357-510a-464b-b9fd-a6eb85461fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:12.023482 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-1c648357-510a-464b-b9fd-a6eb85461fab None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:12.024799 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-1c648357-510a-464b-b9fd-a6eb85461fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:12.059861 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 21/43] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Jul 25 08:31:11 2022] POST /identity/v3/roles => generated 223 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:31:12.101138 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:12.107015 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 23/44] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:12.130483 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407a12c-0f50-4969-bc50-ac81e9b54408 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:12.249356 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407a12c-0f50-4969-bc50-ac81e9b54408 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:12.251267 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:12.289849 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a465238-716b-4875-b5da-b144aff95cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:12.290692 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a465238-716b-4875-b5da-b144aff95cd8 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:12.290986 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a465238-716b-4875-b5da-b144aff95cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:12.291275 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a465238-716b-4875-b5da-b144aff95cd8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:12.292748 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a465238-716b-4875-b5da-b144aff95cd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:12.294230 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a465238-716b-4875-b5da-b144aff95cd8 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:12.295922 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 22/45] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:12.301793 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c648357-510a-464b-b9fd-a6eb85461fab None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:12.403023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c648357-510a-464b-b9fd-a6eb85461fab None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:12.437253 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76b749-ff24-4eb5-8005-a252306abe11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:12.437924 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76b749-ff24-4eb5-8005-a252306abe11 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:12.438215 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76b749-ff24-4eb5-8005-a252306abe11 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:12.438498 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76b749-ff24-4eb5-8005-a252306abe11 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:12.439214 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76b749-ff24-4eb5-8005-a252306abe11 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:12.441282 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76b749-ff24-4eb5-8005-a252306abe11 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:12.521537 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jul 25 08:31:12 2022] POST /identity/v3/projects => generated 312 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:31:14.046359 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67173e18-ba14-4f63-806d-c1b04c555c8b None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:14.046880 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67173e18-ba14-4f63-806d-c1b04c555c8b None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:14.046880 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67173e18-ba14-4f63-806d-c1b04c555c8b None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:14.048257 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 23/47] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:14.055053 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81277334-5fe6-4996-afb0-6792f3a7589b None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:14.055511 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81277334-5fe6-4996-afb0-6792f3a7589b None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:14.055629 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81277334-5fe6-4996-afb0-6792f3a7589b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:14.073632 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-81277334-5fe6-4996-afb0-6792f3a7589b None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:14.074818 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-81277334-5fe6-4996-afb0-6792f3a7589b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:14.121929 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:14.141926 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 25/48] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:14.164642 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67173e18-ba14-4f63-806d-c1b04c555c8b None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:14.263860 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67173e18-ba14-4f63-806d-c1b04c555c8b None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:14.296516 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b40d36-53e6-43f4-aff0-a86cce181bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:14.297235 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b40d36-53e6-43f4-aff0-a86cce181bfa None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:14.297518 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b40d36-53e6-43f4-aff0-a86cce181bfa None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:14.297798 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b40d36-53e6-43f4-aff0-a86cce181bfa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:14.308181 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b40d36-53e6-43f4-aff0-a86cce181bfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:14.316540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-f2b40d36-53e6-43f4-aff0-a86cce181bfa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:31:14.316540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:14.316540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:14.316540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:14.316540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:14.316540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:14.316540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:14.316540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:14.316540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:14.316540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:14.316540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:14.316540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:14.316540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:14.316540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:14.316540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:14.316540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:14.317411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:14.317411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:14.317411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:14.317411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:14.317411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:14.317411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:14.317411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:14.317411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:14.317411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:14.317411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:14.317411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:14.317411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:14.317411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:14.317411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:14.317411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:14.317411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:14.318157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:14.318157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:14.318157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:14.318157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:14.318157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:14.318157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:14.318157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:14.318157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:14.318157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:14.318157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:14.318157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:31:14.318157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:31:14.318157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 24/49] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:31:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:14.323534 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81277334-5fe6-4996-afb0-6792f3a7589b None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:14.422709 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81277334-5fe6-4996-afb0-6792f3a7589b None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:14.456981 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326dcaec-bbac-4554-89ed-bf7c65322527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:14.457652 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326dcaec-bbac-4554-89ed-bf7c65322527 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:14.457939 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326dcaec-bbac-4554-89ed-bf7c65322527 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:14.458220 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326dcaec-bbac-4554-89ed-bf7c65322527 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:14.458979 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326dcaec-bbac-4554-89ed-bf7c65322527 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:14.459290 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326dcaec-bbac-4554-89ed-bf7c65322527 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:14.460730 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326dcaec-bbac-4554-89ed-bf7c65322527 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:14.468852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 26/50] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:14.474914 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b40d36-53e6-43f4-aff0-a86cce181bfa None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:14.505299 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:14.575235 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b40d36-53e6-43f4-aff0-a86cce181bfa None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:14.609553 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077ab6a-af5c-403e-ac82-b00ea28b7ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:14.610434 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077ab6a-af5c-403e-ac82-b00ea28b7ece None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:14.610726 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077ab6a-af5c-403e-ac82-b00ea28b7ece None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:14.611011 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077ab6a-af5c-403e-ac82-b00ea28b7ece None admin] PATH_INFO: `/v3/users/d3e81ab686314e4bafebf32342e3e7a2` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:14.612995 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c077ab6a-af5c-403e-ac82-b00ea28b7ece None admin] RBAC: Authorizing `identity:get_user(user_id=d3e81ab686314e4bafebf32342e3e7a2)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:14.614464 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c077ab6a-af5c-403e-ac82-b00ea28b7ece None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:14.616136 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 25/51] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:14 2022] GET /identity/v3/users/d3e81ab686314e4bafebf32342e3e7a2 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:14.621620 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326dcaec-bbac-4554-89ed-bf7c65322527 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:14.648098 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333249d-44ab-4bcf-a09a-3a808e8a0295 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:14.648394 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333249d-44ab-4bcf-a09a-3a808e8a0295 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:14.648687 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333249d-44ab-4bcf-a09a-3a808e8a0295 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:14.650051 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 26/52] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:31:14.654942 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45901d4e-3163-4662-a8ee-5c691958aca1 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:14.658027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45901d4e-3163-4662-a8ee-5c691958aca1 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:14.658027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45901d4e-3163-4662-a8ee-5c691958aca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:14.668131 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:14.675387 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-45901d4e-3163-4662-a8ee-5c691958aca1 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:14.676981 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-45901d4e-3163-4662-a8ee-5c691958aca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:14.727554 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326dcaec-bbac-4554-89ed-bf7c65322527 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:14.743506 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 27/53] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:31:14.765679 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf6e34-99c8-44be-8207-7d7662676f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:14.766508 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf6e34-99c8-44be-8207-7d7662676f27 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:14.766846 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf6e34-99c8-44be-8207-7d7662676f27 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:14.766978 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45901d4e-3163-4662-a8ee-5c691958aca1 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:14.767130 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf6e34-99c8-44be-8207-7d7662676f27 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:14.769346 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf6e34-99c8-44be-8207-7d7662676f27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:14.770786 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf6e34-99c8-44be-8207-7d7662676f27 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:14.772437 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 27/54] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:14.778103 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf6e34-99c8-44be-8207-7d7662676f27 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:14.794880 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:14.866114 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45901d4e-3163-4662-a8ee-5c691958aca1 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:14.878637 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf6e34-99c8-44be-8207-7d7662676f27 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:14.891115 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:14.900201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662599b-61c0-42da-9675-e281c084aa6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:14.904439 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662599b-61c0-42da-9675-e281c084aa6f None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:14.904439 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662599b-61c0-42da-9675-e281c084aa6f None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:14.904439 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662599b-61c0-42da-9675-e281c084aa6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:14.904439 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662599b-61c0-42da-9675-e281c084aa6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:14.904439 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662599b-61c0-42da-9675-e281c084aa6f None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:14.905840 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 28/55] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:14.911703 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662599b-61c0-42da-9675-e281c084aa6f None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:14.912539 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1787863-f602-42ef-8bb7-af958669742f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:14.913201 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1787863-f602-42ef-8bb7-af958669742f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:14.913487 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1787863-f602-42ef-8bb7-af958669742f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:14.913769 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1787863-f602-42ef-8bb7-af958669742f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:14.914609 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1787863-f602-42ef-8bb7-af958669742f None admin] RBAC: Adding query filter params (role.id=25b0f48c10474bf6b98aad8f093868ee, scope.domain.id=default, user.id=d3e81ab686314e4bafebf32342e3e7a2) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:14.914921 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1787863-f602-42ef-8bb7-af958669742f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:14.916411 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1787863-f602-42ef-8bb7-af958669742f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:14.925421 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 28/56] 10.222.0.18 () {56 vars in 1322 bytes} [Mon Jul 25 08:31:14 2022] GET /identity/v3/role_assignments?user.id=d3e81ab686314e4bafebf32342e3e7a2&scope.domain.id=default&role.id=25b0f48c10474bf6b98aad8f093868ee => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:15.011602 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:15.018531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662599b-61c0-42da-9675-e281c084aa6f None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:15.056028 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88853414-dc4b-471e-91f2-2ca3a345d93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:15.056718 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88853414-dc4b-471e-91f2-2ca3a345d93c None admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:15.057004 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88853414-dc4b-471e-91f2-2ca3a345d93c None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:15.057284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88853414-dc4b-471e-91f2-2ca3a345d93c None admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:15.058011 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88853414-dc4b-471e-91f2-2ca3a345d93c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:15.059490 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88853414-dc4b-471e-91f2-2ca3a345d93c None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:15.163003 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 29/57] 10.222.0.18 () {60 vars in 1140 bytes} [Mon Jul 25 08:31:14 2022] POST /identity/v3/projects => generated 298 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:31:17.153149 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda77670-f3b7-4043-9bee-4421d4369c4b None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:17.153638 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda77670-f3b7-4043-9bee-4421d4369c4b None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:17.153638 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda77670-f3b7-4043-9bee-4421d4369c4b None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:17.154986 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 29/58] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:17.160984 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23611c65-57ea-4b34-9156-f913f1cac9c8 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:17.161408 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23611c65-57ea-4b34-9156-f913f1cac9c8 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:17.161548 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23611c65-57ea-4b34-9156-f913f1cac9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:17.179112 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-23611c65-57ea-4b34-9156-f913f1cac9c8 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:17.180385 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-23611c65-57ea-4b34-9156-f913f1cac9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:17.243665 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 30/59] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:17.266756 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda77670-f3b7-4043-9bee-4421d4369c4b None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:17.365037 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda77670-f3b7-4043-9bee-4421d4369c4b None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:17.397236 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae731a8-27a1-4583-b6d9-b87802d8b853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:17.398023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae731a8-27a1-4583-b6d9-b87802d8b853 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:17.398313 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae731a8-27a1-4583-b6d9-b87802d8b853 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:17.398595 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae731a8-27a1-4583-b6d9-b87802d8b853 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:17.399809 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae731a8-27a1-4583-b6d9-b87802d8b853 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:17.401312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae731a8-27a1-4583-b6d9-b87802d8b853 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:17.402928 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 30/60] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:17.408456 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23611c65-57ea-4b34-9156-f913f1cac9c8 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:17.482652 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:17.503174 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23611c65-57ea-4b34-9156-f913f1cac9c8 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:17.536986 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfc0b8-8136-4de5-9816-9eb715c17310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:17.537664 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfc0b8-8136-4de5-9816-9eb715c17310 None admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:17.538164 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfc0b8-8136-4de5-9816-9eb715c17310 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:17.538807 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfc0b8-8136-4de5-9816-9eb715c17310 None admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:17.539582 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfc0b8-8136-4de5-9816-9eb715c17310 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:17.541071 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfc0b8-8136-4de5-9816-9eb715c17310 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:17.634140 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 31/61] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jul 25 08:31:17 2022] POST /identity/v3/users => generated 275 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:31:20.817873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060d388-a244-4302-97c1-da32935833de None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:20.818419 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060d388-a244-4302-97c1-da32935833de None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:20.818419 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060d388-a244-4302-97c1-da32935833de None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:20.819863 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 31/62] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:20.825247 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff1885-f23f-4795-ab74-95b3f4746ea3 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:20.825638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff1885-f23f-4795-ab74-95b3f4746ea3 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:20.825821 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff1885-f23f-4795-ab74-95b3f4746ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:20.847750 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-b7ff1885-f23f-4795-ab74-95b3f4746ea3 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:20.848983 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-b7ff1885-f23f-4795-ab74-95b3f4746ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:20.924523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f388c-2faa-4c06-abda-f6f316fcb20d None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:20.925150 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f388c-2faa-4c06-abda-f6f316fcb20d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:20.925633 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f388c-2faa-4c06-abda-f6f316fcb20d None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:20.927203 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 32/63] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:20.932451 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c071d-ea85-4d8b-9ef7-9b985c38198e None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:20.932979 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c071d-ea85-4d8b-9ef7-9b985c38198e None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:20.933462 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c071d-ea85-4d8b-9ef7-9b985c38198e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:20.942147 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 32/64] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:20.965912 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff1885-f23f-4795-ab74-95b3f4746ea3 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:20.971697 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-fd5c071d-ea85-4d8b-9ef7-9b985c38198e None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:20.973682 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-fd5c071d-ea85-4d8b-9ef7-9b985c38198e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:21.031985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:21.069711 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 33/65] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:31:21.071324 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b53f7-929b-4b50-a8b7-974d7aa6635b None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:21.071819 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b53f7-929b-4b50-a8b7-974d7aa6635b None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:21.072327 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b53f7-929b-4b50-a8b7-974d7aa6635b None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:21.077784 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 34/66] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:21.079514 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6702b1b-d481-4f0d-857e-2dc74555c0bd None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:21.079996 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6702b1b-d481-4f0d-857e-2dc74555c0bd None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:21.080666 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6702b1b-d481-4f0d-857e-2dc74555c0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:21.092631 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:21.100843 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-b6702b1b-d481-4f0d-857e-2dc74555c0bd None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:21.102218 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b6702b1b-d481-4f0d-857e-2dc74555c0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:21.144720 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff1885-f23f-4795-ab74-95b3f4746ea3 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:21.185759 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 35/67] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:31:21.190768 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806949e-23cd-45b8-835c-e860357e05f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:21.190768 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806949e-23cd-45b8-835c-e860357e05f4 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:21.190768 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806949e-23cd-45b8-835c-e860357e05f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:21.190768 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806949e-23cd-45b8-835c-e860357e05f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:21.192449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6702b1b-d481-4f0d-857e-2dc74555c0bd None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:21.208949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806949e-23cd-45b8-835c-e860357e05f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:21.219552 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-1806949e-23cd-45b8-835c-e860357e05f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:31:21.219552 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:21.219552 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:21.219552 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:21.219552 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:21.219552 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:21.219552 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:21.219552 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:21.219552 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:21.219552 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:21.219552 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:21.219552 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:21.219552 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:21.219552 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:21.219552 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:21.219552 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:21.220429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:21.220429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:21.220429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:21.220429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:21.220429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:21.220429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:21.220429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:21.220429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:21.220429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:21.220429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:21.220429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:21.220429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:21.220429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:21.220429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:21.220429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:21.220429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:21.221715 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:21.221715 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:21.221715 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:21.221715 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:21.221715 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:21.221715 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:21.221715 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:21.221715 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:21.221715 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:21.221715 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:21.221715 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:31:21.221715 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:31:21.229097 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 33/68] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:31:21.229097 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806949e-23cd-45b8-835c-e860357e05f4 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:21.335759 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6702b1b-d481-4f0d-857e-2dc74555c0bd None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:21.338236 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:21.340465 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806949e-23cd-45b8-835c-e860357e05f4 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:21.363108 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:21.369855 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5bda8-a5fc-4233-9fb1-132c5e27dd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:21.370662 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5bda8-a5fc-4233-9fb1-132c5e27dd9a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:21.370961 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5bda8-a5fc-4233-9fb1-132c5e27dd9a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:21.371302 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5bda8-a5fc-4233-9fb1-132c5e27dd9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:21.373506 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d1226-90ad-46c5-8a2f-0bd36d50e848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:21.374312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d1226-90ad-46c5-8a2f-0bd36d50e848 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:21.374600 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d1226-90ad-46c5-8a2f-0bd36d50e848 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:21.374877 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d1226-90ad-46c5-8a2f-0bd36d50e848 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:21.383690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5bda8-a5fc-4233-9fb1-132c5e27dd9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:21.386938 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d1226-90ad-46c5-8a2f-0bd36d50e848 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:21.393549 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-46e5bda8-a5fc-4233-9fb1-132c5e27dd9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:31:21.393549 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:21.393549 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:21.393549 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:21.393549 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:21.393549 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:21.393549 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:21.393549 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:21.393549 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:21.393549 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:21.393549 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:21.393549 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:21.393549 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:21.393549 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:21.393549 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:21.393549 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:21.394690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:21.394690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:21.394690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:21.394690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:21.394690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:21.394690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:21.394690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:21.394690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:21.394690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:21.394690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:21.394690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:21.394690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:21.394690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:21.394690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:21.394690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:21.394690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:21.395562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:21.395562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:21.395562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:21.395562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:21.395562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:21.395562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:21.395562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:21.395562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:21.395562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:21.395562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:21.395562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:31:21.395562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:31:21.395562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 36/69] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:31:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:21.396225 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5bda8-a5fc-4233-9fb1-132c5e27dd9a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:21.396297 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-802d1226-90ad-46c5-8a2f-0bd36d50e848 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:31:21.396297 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:21.396297 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:21.396297 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:21.396297 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:21.396297 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:21.396297 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:21.396297 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:21.396297 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:21.396297 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:21.396297 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:21.396297 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:21.396297 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:21.396297 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:21.396297 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:21.396297 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:21.397033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:21.397033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:21.397033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:21.397033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:21.397033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:21.397033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:21.397033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:21.397033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:21.397033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:21.397033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:21.397033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:21.397033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:21.397033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:21.397033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:21.397033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:21.397033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:21.397782 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:21.397782 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:21.397782 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:21.397782 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:21.397782 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:21.397782 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:21.397782 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:21.397782 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:21.397782 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:21.397782 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:21.397782 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:31:21.397782 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:31:21.397782 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 34/70] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 08:31:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:21.398378 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0f7ab-eb5b-4275-9c93-3ee0f436c0c0 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:21.399255 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0f7ab-eb5b-4275-9c93-3ee0f436c0c0 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:21.399255 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0f7ab-eb5b-4275-9c93-3ee0f436c0c0 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:21.400486 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 35/71] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:21.401603 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45260509-e8fb-49e8-8e08-f4433bd0f328 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:21.401902 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45260509-e8fb-49e8-8e08-f4433bd0f328 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:21.402476 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45260509-e8fb-49e8-8e08-f4433bd0f328 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:21.404169 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 36/72] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:21.405458 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45260509-e8fb-49e8-8e08-f4433bd0f328 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:21.506722 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5bda8-a5fc-4233-9fb1-132c5e27dd9a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:21.508121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45260509-e8fb-49e8-8e08-f4433bd0f328 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:21.542502 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c6ec0-8f17-4a52-a6a6-d601c88f90e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:21.543177 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c6ec0-8f17-4a52-a6a6-d601c88f90e9 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:21.543467 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c6ec0-8f17-4a52-a6a6-d601c88f90e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:21.543780 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c6ec0-8f17-4a52-a6a6-d601c88f90e9 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:21.544540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c6ec0-8f17-4a52-a6a6-d601c88f90e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:21.544857 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c6ec0-8f17-4a52-a6a6-d601c88f90e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:21.546270 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c6ec0-8f17-4a52-a6a6-d601c88f90e9 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:21.547179 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b9604-25e8-4b63-bb97-e21eafbe5d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:21.547874 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b9604-25e8-4b63-bb97-e21eafbe5d06 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:21.548160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b9604-25e8-4b63-bb97-e21eafbe5d06 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:21.548447 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b9604-25e8-4b63-bb97-e21eafbe5d06 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:21.549719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b9604-25e8-4b63-bb97-e21eafbe5d06 None admin] RBAC: Adding query filter params (name=member) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:21.550105 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b9604-25e8-4b63-bb97-e21eafbe5d06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:21.551476 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b9604-25e8-4b63-bb97-e21eafbe5d06 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:21.555088 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 37/73] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:21.555904 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c6ec0-8f17-4a52-a6a6-d601c88f90e9 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:21.559493 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 37/74] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 08:31:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:21.560725 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa65fe-351f-4027-9894-1e54ff993daa None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:21.561017 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa65fe-351f-4027-9894-1e54ff993daa None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:21.561298 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa65fe-351f-4027-9894-1e54ff993daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:21.579271 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-61fa65fe-351f-4027-9894-1e54ff993daa None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:21.580614 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-61fa65fe-351f-4027-9894-1e54ff993daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:21.600068 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:21.606891 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:21.646779 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 38/75] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:21.648429 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9f36c-8544-4142-a26d-0eb1100612f7 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:21.648723 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9f36c-8544-4142-a26d-0eb1100612f7 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:21.649006 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9f36c-8544-4142-a26d-0eb1100612f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:21.661335 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c6ec0-8f17-4a52-a6a6-d601c88f90e9 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:21.672733 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-d6e9f36c-8544-4142-a26d-0eb1100612f7 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:21.673950 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d6e9f36c-8544-4142-a26d-0eb1100612f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:21.696163 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d8810-7874-4c8b-a393-61517bd7ae1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:21.696841 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d8810-7874-4c8b-a393-61517bd7ae1e None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:21.697136 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d8810-7874-4c8b-a393-61517bd7ae1e None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:21.697422 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d8810-7874-4c8b-a393-61517bd7ae1e None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:21.698183 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d8810-7874-4c8b-a393-61517bd7ae1e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:21.698495 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d8810-7874-4c8b-a393-61517bd7ae1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:21.699913 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d8810-7874-4c8b-a393-61517bd7ae1e None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:21.708141 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 38/76] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:31:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:21.708910 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d8810-7874-4c8b-a393-61517bd7ae1e None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:21.744502 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 39/77] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:21.745349 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9f36c-8544-4142-a26d-0eb1100612f7 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:21.812014 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d8810-7874-4c8b-a393-61517bd7ae1e None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:21.821138 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:21.834280 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:21.845454 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253a540-80fe-49b7-98d6-c4491195aa02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:21.846440 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253a540-80fe-49b7-98d6-c4491195aa02 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:21.846613 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253a540-80fe-49b7-98d6-c4491195aa02 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:21.846891 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253a540-80fe-49b7-98d6-c4491195aa02 None admin] PATH_INFO: `/v3/users/d3e81ab686314e4bafebf32342e3e7a2` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:21.848116 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2253a540-80fe-49b7-98d6-c4491195aa02 None admin] RBAC: Authorizing `identity:get_user(user_id=d3e81ab686314e4bafebf32342e3e7a2)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:21.848927 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9f36c-8544-4142-a26d-0eb1100612f7 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:21.849566 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2253a540-80fe-49b7-98d6-c4491195aa02 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:21.851267 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 39/78] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:21 2022] GET /identity/v3/users/d3e81ab686314e4bafebf32342e3e7a2 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:21.851992 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253a540-80fe-49b7-98d6-c4491195aa02 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:21.884842 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15338b63-de68-4193-b4d7-6e7505fded7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:21.885728 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15338b63-de68-4193-b4d7-6e7505fded7a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:21.886024 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15338b63-de68-4193-b4d7-6e7505fded7a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:21.886307 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15338b63-de68-4193-b4d7-6e7505fded7a None admin] PATH_INFO: `/v3/users/465479e39e5141f68f4d110bd7aff569` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:21.901491 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15338b63-de68-4193-b4d7-6e7505fded7a None admin] RBAC: Authorizing `identity:get_user(user_id=465479e39e5141f68f4d110bd7aff569)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:21.902962 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15338b63-de68-4193-b4d7-6e7505fded7a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:21.904686 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 40/79] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:21 2022] GET /identity/v3/users/465479e39e5141f68f4d110bd7aff569 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:21.905454 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15338b63-de68-4193-b4d7-6e7505fded7a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:21.957265 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253a540-80fe-49b7-98d6-c4491195aa02 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:21.990984 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0272e1a-ba7e-485d-9f63-dcf99aa7cb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:21.991804 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0272e1a-ba7e-485d-9f63-dcf99aa7cb20 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:21.992090 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0272e1a-ba7e-485d-9f63-dcf99aa7cb20 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:21.992367 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0272e1a-ba7e-485d-9f63-dcf99aa7cb20 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:21.993572 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0272e1a-ba7e-485d-9f63-dcf99aa7cb20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:21.995030 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0272e1a-ba7e-485d-9f63-dcf99aa7cb20 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:21.996700 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 40/80] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:21.997546 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0272e1a-ba7e-485d-9f63-dcf99aa7cb20 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:22.006892 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15338b63-de68-4193-b4d7-6e7505fded7a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:22.040739 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce5dcf-1996-4fd9-b741-fb647dbb452a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:22.041616 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce5dcf-1996-4fd9-b741-fb647dbb452a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:22.041907 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce5dcf-1996-4fd9-b741-fb647dbb452a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:22.042189 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce5dcf-1996-4fd9-b741-fb647dbb452a None admin] PATH_INFO: `/v3/users/465479e39e5141f68f4d110bd7aff569` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:22.043388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce5dcf-1996-4fd9-b741-fb647dbb452a None admin] RBAC: Authorizing `identity:get_user(user_id=465479e39e5141f68f4d110bd7aff569)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:22.044882 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce5dcf-1996-4fd9-b741-fb647dbb452a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:22.046106 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:22.046684 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 41/81] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:21 2022] GET /identity/v3/users/465479e39e5141f68f4d110bd7aff569 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:22.047277 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce5dcf-1996-4fd9-b741-fb647dbb452a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:22.066364 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:22.100812 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0272e1a-ba7e-485d-9f63-dcf99aa7cb20 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:22.134476 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928846f-eb6a-4cc1-a012-cf3118e46e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:22.135274 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928846f-eb6a-4cc1-a012-cf3118e46e3c None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:22.135569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928846f-eb6a-4cc1-a012-cf3118e46e3c None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:22.135878 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928846f-eb6a-4cc1-a012-cf3118e46e3c None admin] PATH_INFO: `/v3/roles/member` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:22.146058 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928846f-eb6a-4cc1-a012-cf3118e46e3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:22.150376 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce5dcf-1996-4fd9-b741-fb647dbb452a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:22.153880 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-f928846f-eb6a-4cc1-a012-cf3118e46e3c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:31:22.153880 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:22.153880 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:22.153880 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:22.153880 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:22.153880 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:22.153880 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:22.153880 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:22.153880 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:22.153880 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:22.153880 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:22.153880 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:22.153880 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:22.153880 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:22.153880 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:22.153880 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:22.154744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:22.154744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:22.154744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:22.154744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:22.154744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:22.154744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:22.154744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:22.154744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:22.154744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:22.154744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:22.154744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:22.154744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:22.154744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:22.154744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:22.154744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:22.154744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:22.155501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:22.155501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:22.155501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:22.155501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:22.155501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:22.155501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:22.155501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:22.155501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:22.155501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:22.155501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:22.155501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:31:22.155501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:31:22.155501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 41/82] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:22.156175 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928846f-eb6a-4cc1-a012-cf3118e46e3c None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:22.187902 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e37f7-3a0a-4d41-8ec5-dd30e28c2a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:22.188559 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e37f7-3a0a-4d41-8ec5-dd30e28c2a70 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:22.188854 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e37f7-3a0a-4d41-8ec5-dd30e28c2a70 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:22.189142 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e37f7-3a0a-4d41-8ec5-dd30e28c2a70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:22.254386 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928846f-eb6a-4cc1-a012-cf3118e46e3c None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:22.255410 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e37f7-3a0a-4d41-8ec5-dd30e28c2a70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:22.256920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e37f7-3a0a-4d41-8ec5-dd30e28c2a70 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:22.261128 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:22.270230 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:22.287030 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430a081-927d-490b-a23a-8589547460ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:22.287704 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430a081-927d-490b-a23a-8589547460ef None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:22.287997 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430a081-927d-490b-a23a-8589547460ef None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:22.288280 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430a081-927d-490b-a23a-8589547460ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:22.354964 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 42/83] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:31:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:31:22.355379 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430a081-927d-490b-a23a-8589547460ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:22.355542 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e37f7-3a0a-4d41-8ec5-dd30e28c2a70 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:22.356983 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430a081-927d-490b-a23a-8589547460ef None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:22.456096 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 42/84] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:31:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:31:22.456942 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430a081-927d-490b-a23a-8589547460ef None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:22.457042 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e37f7-3a0a-4d41-8ec5-dd30e28c2a70 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:22.460225 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:22.472321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:22.492597 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c55fb-67ea-4193-b53e-fbecefafd296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:22.493268 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c55fb-67ea-4193-b53e-fbecefafd296 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:22.493556 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c55fb-67ea-4193-b53e-fbecefafd296 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:22.493838 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c55fb-67ea-4193-b53e-fbecefafd296 None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:22.494557 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c55fb-67ea-4193-b53e-fbecefafd296 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:22.496052 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c55fb-67ea-4193-b53e-fbecefafd296 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:22.554130 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430a081-927d-490b-a23a-8589547460ef None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:22.587301 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b59513-5d3b-4b44-be33-b7ca5522ebe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:22.587969 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b59513-5d3b-4b44-be33-b7ca5522ebe9 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:22.588259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b59513-5d3b-4b44-be33-b7ca5522ebe9 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:22.588541 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b59513-5d3b-4b44-be33-b7ca5522ebe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:22.605521 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 43/85] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jul 25 08:31:22 2022] POST /identity/v3/users => generated 289 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:31:22.606281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c55fb-67ea-4193-b53e-fbecefafd296 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:22.664893 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b59513-5d3b-4b44-be33-b7ca5522ebe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:22.666391 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b59513-5d3b-4b44-be33-b7ca5522ebe9 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:22.669589 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:22.739467 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c55fb-67ea-4193-b53e-fbecefafd296 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:22.787488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3d1b9-d26e-4480-b363-12bd2d3a3c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:22.787488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3d1b9-d26e-4480-b363-12bd2d3a3c9d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:22.787488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3d1b9-d26e-4480-b363-12bd2d3a3c9d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:22.787488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3d1b9-d26e-4480-b363-12bd2d3a3c9d None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:22.787933 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3d1b9-d26e-4480-b363-12bd2d3a3c9d None admin] RBAC: Adding query filter params (name=member) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:22.788842 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3d1b9-d26e-4480-b363-12bd2d3a3c9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:22.788943 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 43/86] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:31:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:31:22.789304 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b59513-5d3b-4b44-be33-b7ca5522ebe9 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:22.789635 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3d1b9-d26e-4480-b363-12bd2d3a3c9d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:22.803117 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 44/87] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 08:31:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:22.804072 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3d1b9-d26e-4480-b363-12bd2d3a3c9d None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:22.837648 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:22.917915 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b59513-5d3b-4b44-be33-b7ca5522ebe9 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:22.921027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:22.927495 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3d1b9-d26e-4480-b363-12bd2d3a3c9d None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:22.954981 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266cb04-6ec9-4d1f-b244-2cbd683d2427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:22.956112 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266cb04-6ec9-4d1f-b244-2cbd683d2427 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:22.956397 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266cb04-6ec9-4d1f-b244-2cbd683d2427 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:22.956674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266cb04-6ec9-4d1f-b244-2cbd683d2427 None admin] PATH_INFO: `/v3/projects/65208cd21fc9480e843b073170fa9fff` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:22.957879 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266cb04-6ec9-4d1f-b244-2cbd683d2427 None admin] RBAC: Authorizing `identity:get_project(project_id=65208cd21fc9480e843b073170fa9fff)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:22.959388 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266cb04-6ec9-4d1f-b244-2cbd683d2427 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:22.961335 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 44/88] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:22 2022] GET /identity/v3/projects/65208cd21fc9480e843b073170fa9fff => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:22.962123 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266cb04-6ec9-4d1f-b244-2cbd683d2427 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:22.973510 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38ff54-4aea-4201-ab4d-2fb518a6f635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:22.975174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38ff54-4aea-4201-ab4d-2fb518a6f635 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:22.976041 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38ff54-4aea-4201-ab4d-2fb518a6f635 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:22.976808 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38ff54-4aea-4201-ab4d-2fb518a6f635 None admin] PATH_INFO: `/v3/projects/65208cd21fc9480e843b073170fa9fff` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:22.978479 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38ff54-4aea-4201-ab4d-2fb518a6f635 None admin] RBAC: Authorizing `identity:get_project(project_id=65208cd21fc9480e843b073170fa9fff)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:22.980932 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38ff54-4aea-4201-ab4d-2fb518a6f635 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:22.983536 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 45/89] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:22 2022] GET /identity/v3/projects/65208cd21fc9480e843b073170fa9fff => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:22.984499 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38ff54-4aea-4201-ab4d-2fb518a6f635 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:23.074596 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266cb04-6ec9-4d1f-b244-2cbd683d2427 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:23.113103 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470c32c-631a-4172-864b-fe39017474f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:23.114132 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470c32c-631a-4172-864b-fe39017474f6 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:23.114484 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470c32c-631a-4172-864b-fe39017474f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:23.115106 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470c32c-631a-4172-864b-fe39017474f6 None admin] PATH_INFO: `/v3/projects/65208cd21fc9480e843b073170fa9fff` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:23.116225 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470c32c-631a-4172-864b-fe39017474f6 None admin] RBAC: Authorizing `identity:get_project(project_id=65208cd21fc9480e843b073170fa9fff)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:23.117792 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470c32c-631a-4172-864b-fe39017474f6 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:23.119728 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 45/90] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:22 2022] GET /identity/v3/projects/65208cd21fc9480e843b073170fa9fff => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:23.121726 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:23.124614 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470c32c-631a-4172-864b-fe39017474f6 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:23.131081 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38ff54-4aea-4201-ab4d-2fb518a6f635 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:23.171430 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:23.184615 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e1cd9-0ea1-45d6-970e-1045c442bc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:23.186328 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e1cd9-0ea1-45d6-970e-1045c442bc96 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:23.187079 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e1cd9-0ea1-45d6-970e-1045c442bc96 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:23.187546 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e1cd9-0ea1-45d6-970e-1045c442bc96 None admin] PATH_INFO: `/v3/users/465479e39e5141f68f4d110bd7aff569` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:23.189525 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e1cd9-0ea1-45d6-970e-1045c442bc96 None admin] RBAC: Authorizing `identity:get_user(user_id=465479e39e5141f68f4d110bd7aff569)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:23.191683 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e1cd9-0ea1-45d6-970e-1045c442bc96 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:23.194212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 46/91] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:22 2022] GET /identity/v3/users/465479e39e5141f68f4d110bd7aff569 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:23.195181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e1cd9-0ea1-45d6-970e-1045c442bc96 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:23.240330 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470c32c-631a-4172-864b-fe39017474f6 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:23.278219 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96049cdc-4cab-484e-96de-2cf0e89289f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:23.279210 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96049cdc-4cab-484e-96de-2cf0e89289f0 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:23.279790 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96049cdc-4cab-484e-96de-2cf0e89289f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:23.280372 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96049cdc-4cab-484e-96de-2cf0e89289f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:23.281392 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96049cdc-4cab-484e-96de-2cf0e89289f0 None admin] RBAC: Adding query filter params (role.id=25b0f48c10474bf6b98aad8f093868ee, scope.project.id=65208cd21fc9480e843b073170fa9fff, user.id=d3e81ab686314e4bafebf32342e3e7a2) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:23.281884 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96049cdc-4cab-484e-96de-2cf0e89289f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:23.284015 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96049cdc-4cab-484e-96de-2cf0e89289f0 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:23.291056 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 46/92] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:31:23 2022] GET /identity/v3/role_assignments?user.id=d3e81ab686314e4bafebf32342e3e7a2&scope.project.id=65208cd21fc9480e843b073170fa9fff&role.id=25b0f48c10474bf6b98aad8f093868ee => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:23.292267 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96049cdc-4cab-484e-96de-2cf0e89289f0 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:23.337526 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e1cd9-0ea1-45d6-970e-1045c442bc96 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:23.405025 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be07a2-1073-48fd-b976-1b769d30d6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:23.405811 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be07a2-1073-48fd-b976-1b769d30d6af None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:23.406168 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be07a2-1073-48fd-b976-1b769d30d6af None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:23.406838 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be07a2-1073-48fd-b976-1b769d30d6af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:23.407462 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be07a2-1073-48fd-b976-1b769d30d6af None admin] RBAC: Adding query filter params (role.id=2cb5ed3eb0484858a5f7cbdce69092ed, scope.project.id=65208cd21fc9480e843b073170fa9fff, user.id=465479e39e5141f68f4d110bd7aff569) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:23.407885 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be07a2-1073-48fd-b976-1b769d30d6af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:23.410856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be07a2-1073-48fd-b976-1b769d30d6af None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:23.418942 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96049cdc-4cab-484e-96de-2cf0e89289f0 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:23.422574 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:23.429713 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 47/93] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:31:23 2022] GET /identity/v3/role_assignments?user.id=465479e39e5141f68f4d110bd7aff569&scope.project.id=65208cd21fc9480e843b073170fa9fff&role.id=2cb5ed3eb0484858a5f7cbdce69092ed => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:23.431140 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be07a2-1073-48fd-b976-1b769d30d6af None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:23.468368 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84517be4-b07c-483c-8e93-39a030cc1875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:23.469487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84517be4-b07c-483c-8e93-39a030cc1875 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:23.470329 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84517be4-b07c-483c-8e93-39a030cc1875 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:23.471531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84517be4-b07c-483c-8e93-39a030cc1875 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:23.473500 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84517be4-b07c-483c-8e93-39a030cc1875 None admin] RBAC: Adding query filter params (role.id=be32d79ae2964b4b93a1efff3a9aa70b, scope.project.id=65208cd21fc9480e843b073170fa9fff, user.id=465479e39e5141f68f4d110bd7aff569) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:23.474018 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84517be4-b07c-483c-8e93-39a030cc1875 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:23.476060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84517be4-b07c-483c-8e93-39a030cc1875 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:23.483679 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 47/94] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:31:23 2022] GET /identity/v3/role_assignments?user.id=465479e39e5141f68f4d110bd7aff569&scope.project.id=65208cd21fc9480e843b073170fa9fff&role.id=be32d79ae2964b4b93a1efff3a9aa70b => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:23.531659 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:23.608169 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be07a2-1073-48fd-b976-1b769d30d6af None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:23.656717 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33f625-8495-490c-b763-c6d38ed71885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:23.657811 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33f625-8495-490c-b763-c6d38ed71885 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:23.658381 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33f625-8495-490c-b763-c6d38ed71885 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:23.658856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33f625-8495-490c-b763-c6d38ed71885 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:23.784867 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33f625-8495-490c-b763-c6d38ed71885 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:23.786920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33f625-8495-490c-b763-c6d38ed71885 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:23.819193 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:23.894561 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 48/95] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:31:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:31:23.899878 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84517be4-b07c-483c-8e93-39a030cc1875 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:24.008710 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84517be4-b07c-483c-8e93-39a030cc1875 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:24.047020 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f0cb9-8843-4cd2-a0da-9ed0fcfc1929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:24.048261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f0cb9-8843-4cd2-a0da-9ed0fcfc1929 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:24.048729 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f0cb9-8843-4cd2-a0da-9ed0fcfc1929 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:24.049855 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f0cb9-8843-4cd2-a0da-9ed0fcfc1929 None admin] PATH_INFO: `/v3/projects/86834a3aa6ea40379cc5f181470a60da` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:24.051370 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f0cb9-8843-4cd2-a0da-9ed0fcfc1929 None admin] RBAC: Authorizing `identity:get_project(project_id=86834a3aa6ea40379cc5f181470a60da)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:24.053076 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f0cb9-8843-4cd2-a0da-9ed0fcfc1929 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:24.055055 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 48/96] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:23 2022] GET /identity/v3/projects/86834a3aa6ea40379cc5f181470a60da => generated 312 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:24.061448 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33f625-8495-490c-b763-c6d38ed71885 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:24.177692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33f625-8495-490c-b763-c6d38ed71885 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:24.214517 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69fb958-0ede-479f-bc30-f25647676018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:24.215519 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fb958-0ede-479f-bc30-f25647676018 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:24.223644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:24.224218 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fb958-0ede-479f-bc30-f25647676018 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:24.224727 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fb958-0ede-479f-bc30-f25647676018 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:24.225802 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69fb958-0ede-479f-bc30-f25647676018 None admin] RBAC: Adding query filter params (role.id=2cb5ed3eb0484858a5f7cbdce69092ed, scope.project.id=86834a3aa6ea40379cc5f181470a60da, user.id=465479e39e5141f68f4d110bd7aff569) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:24.226311 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69fb958-0ede-479f-bc30-f25647676018 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:24.228056 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69fb958-0ede-479f-bc30-f25647676018 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:24.234453 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 49/97] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:31:24 2022] GET /identity/v3/role_assignments?user.id=465479e39e5141f68f4d110bd7aff569&scope.project.id=86834a3aa6ea40379cc5f181470a60da&role.id=2cb5ed3eb0484858a5f7cbdce69092ed => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:25.342794 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc28b1e-2202-4796-8586-50da1261d855 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:25.343854 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc28b1e-2202-4796-8586-50da1261d855 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:25.344357 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc28b1e-2202-4796-8586-50da1261d855 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:25.346029 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 49/98] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:25.351519 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318a7ce-9bf6-4dca-be23-ee6eefcb2056 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:25.352354 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318a7ce-9bf6-4dca-be23-ee6eefcb2056 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:25.352849 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318a7ce-9bf6-4dca-be23-ee6eefcb2056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:25.372401 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-a318a7ce-9bf6-4dca-be23-ee6eefcb2056 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:25.373926 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a318a7ce-9bf6-4dca-be23-ee6eefcb2056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:25.446439 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 50/99] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:31:25.470240 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc28b1e-2202-4796-8586-50da1261d855 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:25.510805 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:25.583862 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc28b1e-2202-4796-8586-50da1261d855 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:25.622118 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e159c32-b142-43d5-9ffb-9b5a77438df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:25.623297 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e159c32-b142-43d5-9ffb-9b5a77438df5 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:25.623881 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e159c32-b142-43d5-9ffb-9b5a77438df5 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:25.624344 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e159c32-b142-43d5-9ffb-9b5a77438df5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:25.636431 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e159c32-b142-43d5-9ffb-9b5a77438df5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:25.645121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-1e159c32-b142-43d5-9ffb-9b5a77438df5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:31:25.645121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:25.645121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:25.645121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:25.645121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:25.645121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:25.645121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:25.645121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:25.645121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:25.645121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:25.645121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:25.645121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:25.645121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:25.645121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:25.645121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:25.645121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:25.645968 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:25.645968 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:25.645968 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:25.645968 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:25.645968 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:25.645968 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:25.645968 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:25.645968 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:25.645968 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:25.645968 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:25.645968 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:25.645968 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:25.645968 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:25.645968 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:25.645968 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:25.645968 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:25.646745 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:25.646745 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:25.646745 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:25.646745 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:25.646745 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:25.646745 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:25.646745 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:25.646745 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:25.646745 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:25.646745 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:25.646745 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:31:25.646745 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:31:25.648693 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 50/100] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:25.665785 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318a7ce-9bf6-4dca-be23-ee6eefcb2056 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:25.775589 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318a7ce-9bf6-4dca-be23-ee6eefcb2056 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:25.816131 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:25.836872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a74e5-deea-4786-a55d-f822c37b7f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:25.837565 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a74e5-deea-4786-a55d-f822c37b7f02 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:25.837857 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a74e5-deea-4786-a55d-f822c37b7f02 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:25.838141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a74e5-deea-4786-a55d-f822c37b7f02 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:25.838913 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a74e5-deea-4786-a55d-f822c37b7f02 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:25.839226 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a74e5-deea-4786-a55d-f822c37b7f02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:25.840654 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a74e5-deea-4786-a55d-f822c37b7f02 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:25.851442 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 51/101] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 08:31:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:25.857504 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e159c32-b142-43d5-9ffb-9b5a77438df5 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:25.873743 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88bb6bc-8a15-4bc6-94e3-09afc06abbe6 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:25.874237 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88bb6bc-8a15-4bc6-94e3-09afc06abbe6 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:25.874670 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88bb6bc-8a15-4bc6-94e3-09afc06abbe6 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:25.876206 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 52/102] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:25.882281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc93a55-2d28-490b-a94a-95af5d480bd7 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:25.882879 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc93a55-2d28-490b-a94a-95af5d480bd7 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:25.883385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc93a55-2d28-490b-a94a-95af5d480bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:25.920838 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-6cc93a55-2d28-490b-a94a-95af5d480bd7 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:25.922432 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6cc93a55-2d28-490b-a94a-95af5d480bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:26.019386 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e159c32-b142-43d5-9ffb-9b5a77438df5 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:26.023939 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:26.076406 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f85086-71b1-439f-abca-5a929febc54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:26.077329 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f85086-71b1-439f-abca-5a929febc54c None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:26.077626 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f85086-71b1-439f-abca-5a929febc54c None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:26.077912 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f85086-71b1-439f-abca-5a929febc54c None admin] PATH_INFO: `/v3/users/0aedfa9b55274d9b81df542b048a105e` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:26.104388 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f85086-71b1-439f-abca-5a929febc54c None admin] RBAC: Authorizing `identity:get_user(user_id=0aedfa9b55274d9b81df542b048a105e)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:26.105909 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f85086-71b1-439f-abca-5a929febc54c None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:26.107843 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 51/103] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:25 2022] GET /identity/v3/users/0aedfa9b55274d9b81df542b048a105e => generated 289 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:26.114586 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f85086-71b1-439f-abca-5a929febc54c None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:26.130393 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 53/104] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:31:26.169872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc93a55-2d28-490b-a94a-95af5d480bd7 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:26.300534 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f85086-71b1-439f-abca-5a929febc54c None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:26.357111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b05aa-beb8-458b-be1c-a1c861073e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:26.357763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b05aa-beb8-458b-be1c-a1c861073e6a None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:26.358288 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b05aa-beb8-458b-be1c-a1c861073e6a None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:26.358735 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b05aa-beb8-458b-be1c-a1c861073e6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:26.368965 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc93a55-2d28-490b-a94a-95af5d480bd7 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:26.386131 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:26.386550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:26.405920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3a5f9-7650-4195-a539-97634ce8f4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:26.407042 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3a5f9-7650-4195-a539-97634ce8f4e2 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:26.407559 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3a5f9-7650-4195-a539-97634ce8f4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:26.408286 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3a5f9-7650-4195-a539-97634ce8f4e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:26.410537 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3a5f9-7650-4195-a539-97634ce8f4e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:26.412249 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3a5f9-7650-4195-a539-97634ce8f4e2 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:26.414427 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 54/105] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:26.415955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab7783-0614-4dfd-b2b6-ac6e012a9d65 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:26.416454 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab7783-0614-4dfd-b2b6-ac6e012a9d65 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:26.416990 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab7783-0614-4dfd-b2b6-ac6e012a9d65 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:26.418481 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 55/106] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:26.420208 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7b338-9144-43ad-ab12-4e79eb54f430 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:26.420703 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7b338-9144-43ad-ab12-4e79eb54f430 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:26.421198 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7b338-9144-43ad-ab12-4e79eb54f430 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:26.422897 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 56/107] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:26.424495 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7b338-9144-43ad-ab12-4e79eb54f430 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:26.442143 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b05aa-beb8-458b-be1c-a1c861073e6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:26.443661 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b05aa-beb8-458b-be1c-a1c861073e6a None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:26.535421 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7b338-9144-43ad-ab12-4e79eb54f430 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:26.552850 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 52/108] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:31:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 08:31:26.557724 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd9051-7f25-4428-b5a1-0ae22f81171f None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:26.557724 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd9051-7f25-4428-b5a1-0ae22f81171f None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:26.557724 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd9051-7f25-4428-b5a1-0ae22f81171f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:26.575066 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-17cd9051-7f25-4428-b5a1-0ae22f81171f None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:26.577708 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-17cd9051-7f25-4428-b5a1-0ae22f81171f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:26.578402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f45b49-1b6c-4633-99bc-95f4df735be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:26.579329 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f45b49-1b6c-4633-99bc-95f4df735be2 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:26.579864 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f45b49-1b6c-4633-99bc-95f4df735be2 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:26.581042 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f45b49-1b6c-4633-99bc-95f4df735be2 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:26.581972 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f45b49-1b6c-4633-99bc-95f4df735be2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:26.583782 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f45b49-1b6c-4633-99bc-95f4df735be2 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:26.630781 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:26.649260 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 53/109] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:26.650845 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7122d10-cfa6-40d7-bdf5-44e2582ce798 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:26.651269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7122d10-cfa6-40d7-bdf5-44e2582ce798 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:26.651713 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7122d10-cfa6-40d7-bdf5-44e2582ce798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:26.665990 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 57/110] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jul 25 08:31:26 2022] POST /identity/v3/projects => generated 302 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:31:26.667025 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f45b49-1b6c-4633-99bc-95f4df735be2 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:26.690664 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-f7122d10-cfa6-40d7-bdf5-44e2582ce798 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:26.692853 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-f7122d10-cfa6-40d7-bdf5-44e2582ce798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:26.750438 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:26.858924 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 54/111] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:26.860177 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7122d10-cfa6-40d7-bdf5-44e2582ce798 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:26.894082 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f45b49-1b6c-4633-99bc-95f4df735be2 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:26.943547 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c5d82-2fea-48a2-b9ad-66cc0bfa28d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:26.944374 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c5d82-2fea-48a2-b9ad-66cc0bfa28d9 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:26.944667 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c5d82-2fea-48a2-b9ad-66cc0bfa28d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:26.944950 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c5d82-2fea-48a2-b9ad-66cc0bfa28d9 None admin] PATH_INFO: `/v3/projects/65208cd21fc9480e843b073170fa9fff` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:26.946184 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c5d82-2fea-48a2-b9ad-66cc0bfa28d9 None admin] RBAC: Authorizing `identity:get_project(project_id=65208cd21fc9480e843b073170fa9fff)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:26.949314 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c5d82-2fea-48a2-b9ad-66cc0bfa28d9 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:26.951926 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 58/112] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:26 2022] GET /identity/v3/projects/65208cd21fc9480e843b073170fa9fff => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:26.955676 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c5d82-2fea-48a2-b9ad-66cc0bfa28d9 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:27.012392 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7122d10-cfa6-40d7-bdf5-44e2582ce798 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:27.038810 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:27.070941 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920459e5-7106-4bcd-a284-fa463d79e662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:27.071798 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920459e5-7106-4bcd-a284-fa463d79e662 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:27.072090 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920459e5-7106-4bcd-a284-fa463d79e662 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:27.072375 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920459e5-7106-4bcd-a284-fa463d79e662 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:27.084398 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920459e5-7106-4bcd-a284-fa463d79e662 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:27.092306 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-920459e5-7106-4bcd-a284-fa463d79e662 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:31:27.092306 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:27.092306 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:27.092306 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:27.092306 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:27.092306 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:27.092306 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:27.092306 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:27.092306 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:27.092306 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:27.092306 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:27.092306 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:27.092306 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:27.092306 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:27.092306 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:27.092306 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:27.093331 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:27.093331 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:27.093331 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:27.093331 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:27.093331 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:27.093331 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:27.093331 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:27.093331 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:27.093331 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:27.093331 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:27.093331 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:27.093331 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:27.093331 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:27.093331 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:27.093331 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:27.093331 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:27.094131 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:27.094131 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:27.094131 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:27.094131 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:27.094131 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:27.094131 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:27.094131 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:27.094131 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:27.094131 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:27.094131 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:27.094131 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:31:27.094131 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:31:27.094131 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 55/113] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:31:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:27.094758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920459e5-7106-4bcd-a284-fa463d79e662 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:27.099401 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c5d82-2fea-48a2-b9ad-66cc0bfa28d9 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:27.102671 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:27.137162 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd195d-2f13-4368-9f96-827c9dd4772d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:27.137981 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd195d-2f13-4368-9f96-827c9dd4772d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:27.138272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd195d-2f13-4368-9f96-827c9dd4772d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:27.138553 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd195d-2f13-4368-9f96-827c9dd4772d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:27.150168 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd195d-2f13-4368-9f96-827c9dd4772d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:27.161915 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-53fd195d-2f13-4368-9f96-827c9dd4772d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:31:27.161915 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:27.161915 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:27.161915 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:27.161915 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:27.161915 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:27.161915 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:27.161915 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:27.161915 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:27.161915 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:27.161915 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:27.161915 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:27.161915 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:27.161915 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:27.161915 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:27.161915 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:27.162788 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:27.162788 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:27.162788 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:27.162788 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:27.162788 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:27.162788 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:27.162788 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:27.162788 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:27.162788 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:27.162788 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:27.162788 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:27.162788 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:27.162788 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:27.162788 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:27.162788 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:27.162788 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:27.163554 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:27.163554 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:27.163554 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:27.163554 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:27.163554 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:27.163554 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:27.163554 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:27.163554 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:27.163554 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:27.163554 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:27.163554 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:31:27.163554 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:31:27.164153 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 59/114] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 08:31:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:27.167680 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f5ede-8227-4e65-8797-64c9d6790186 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:27.167680 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f5ede-8227-4e65-8797-64c9d6790186 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:27.167680 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f5ede-8227-4e65-8797-64c9d6790186 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:27.171022 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 60/115] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:27.172718 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bec314-d334-4683-8fa0-a272e1dbcf31 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:27.173017 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bec314-d334-4683-8fa0-a272e1dbcf31 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:27.173302 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bec314-d334-4683-8fa0-a272e1dbcf31 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:27.175156 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 61/116] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:27.175892 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bec314-d334-4683-8fa0-a272e1dbcf31 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:27.213374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920459e5-7106-4bcd-a284-fa463d79e662 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:27.250936 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b115bc7-c586-4726-8c78-b2c008a75a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:27.251606 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b115bc7-c586-4726-8c78-b2c008a75a0c None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:27.252473 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b115bc7-c586-4726-8c78-b2c008a75a0c None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:27.252875 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b115bc7-c586-4726-8c78-b2c008a75a0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:27.253727 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b115bc7-c586-4726-8c78-b2c008a75a0c None admin] RBAC: Adding query filter params (role.id=0263e334bab74e7cb5d062a03089b3f7, scope.project.id=65208cd21fc9480e843b073170fa9fff, user.id=0aedfa9b55274d9b81df542b048a105e) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:27.254045 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b115bc7-c586-4726-8c78-b2c008a75a0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:27.255515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b115bc7-c586-4726-8c78-b2c008a75a0c None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:27.261216 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 56/117] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:31:27 2022] GET /identity/v3/role_assignments?user.id=0aedfa9b55274d9b81df542b048a105e&scope.project.id=65208cd21fc9480e843b073170fa9fff&role.id=0263e334bab74e7cb5d062a03089b3f7 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:27.261929 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b115bc7-c586-4726-8c78-b2c008a75a0c None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:27.308139 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bec314-d334-4683-8fa0-a272e1dbcf31 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:27.309991 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:27.362374 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadfd84-c036-456d-a2aa-6d019c6baffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:27.363652 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadfd84-c036-456d-a2aa-6d019c6baffc None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:27.364126 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadfd84-c036-456d-a2aa-6d019c6baffc None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:27.364855 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadfd84-c036-456d-a2aa-6d019c6baffc None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:27.366273 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdadfd84-c036-456d-a2aa-6d019c6baffc None admin] RBAC: Adding query filter params (name=admin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:27.366782 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdadfd84-c036-456d-a2aa-6d019c6baffc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:27.368405 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdadfd84-c036-456d-a2aa-6d019c6baffc None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:27.383289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 62/118] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:27.385467 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5eac2-2616-4be2-a98e-801f18e70af6 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:27.385976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5eac2-2616-4be2-a98e-801f18e70af6 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:27.386500 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5eac2-2616-4be2-a98e-801f18e70af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:27.389907 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b115bc7-c586-4726-8c78-b2c008a75a0c None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:27.412955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-eff5eac2-2616-4be2-a98e-801f18e70af6 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:27.415165 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-eff5eac2-2616-4be2-a98e-801f18e70af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:27.431852 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c8f56-a6cd-4147-9808-9f9fb6c8010a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:27.432543 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c8f56-a6cd-4147-9808-9f9fb6c8010a None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:27.432835 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c8f56-a6cd-4147-9808-9f9fb6c8010a None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:27.433118 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c8f56-a6cd-4147-9808-9f9fb6c8010a None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:27.433882 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c8f56-a6cd-4147-9808-9f9fb6c8010a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:27.434201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c8f56-a6cd-4147-9808-9f9fb6c8010a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:27.435598 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c8f56-a6cd-4147-9808-9f9fb6c8010a None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:27.445285 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 57/119] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:31:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:27.449817 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef667aa6-701e-4b17-82e6-2a7f077fddc2 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:27.449817 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef667aa6-701e-4b17-82e6-2a7f077fddc2 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:27.449817 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef667aa6-701e-4b17-82e6-2a7f077fddc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:27.451977 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:27.466986 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-ef667aa6-701e-4b17-82e6-2a7f077fddc2 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:27.468254 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-ef667aa6-701e-4b17-82e6-2a7f077fddc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:27.523929 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 63/120] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:27.525618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5eac2-2616-4be2-a98e-801f18e70af6 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:27.547647 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 58/121] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:27.547647 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef667aa6-701e-4b17-82e6-2a7f077fddc2 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:27.592253 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:27.652772 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5eac2-2616-4be2-a98e-801f18e70af6 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:27.688494 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef667aa6-701e-4b17-82e6-2a7f077fddc2 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:27.691580 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0c7f9-09a5-4eab-bc64-2eb71250809f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:27.692494 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0c7f9-09a5-4eab-bc64-2eb71250809f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:27.692780 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0c7f9-09a5-4eab-bc64-2eb71250809f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:27.693057 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0c7f9-09a5-4eab-bc64-2eb71250809f None admin] PATH_INFO: `/v3/users/d3e81ab686314e4bafebf32342e3e7a2` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:27.694262 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0c7f9-09a5-4eab-bc64-2eb71250809f None admin] RBAC: Authorizing `identity:get_user(user_id=d3e81ab686314e4bafebf32342e3e7a2)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:27.695871 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0c7f9-09a5-4eab-bc64-2eb71250809f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:27.697670 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 64/122] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:27 2022] GET /identity/v3/users/d3e81ab686314e4bafebf32342e3e7a2 => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:27.698278 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0c7f9-09a5-4eab-bc64-2eb71250809f None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:27.731900 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:27.744908 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44065c-c060-4682-a03e-bf234b1ab4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:27.751051 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44065c-c060-4682-a03e-bf234b1ab4c6 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:27.751051 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44065c-c060-4682-a03e-bf234b1ab4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:27.751051 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44065c-c060-4682-a03e-bf234b1ab4c6 None admin] PATH_INFO: `/v3/users/465479e39e5141f68f4d110bd7aff569` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:27.751051 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44065c-c060-4682-a03e-bf234b1ab4c6 None admin] RBAC: Authorizing `identity:get_user(user_id=465479e39e5141f68f4d110bd7aff569)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:27.751051 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44065c-c060-4682-a03e-bf234b1ab4c6 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:27.751051 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 59/123] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:27 2022] GET /identity/v3/users/465479e39e5141f68f4d110bd7aff569 => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:27.751642 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44065c-c060-4682-a03e-bf234b1ab4c6 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:27.823798 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0c7f9-09a5-4eab-bc64-2eb71250809f None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:27.866374 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbedef-60a6-4c4a-a61f-8bf234873b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:27.867444 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbedef-60a6-4c4a-a61f-8bf234873b8d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:27.867774 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbedef-60a6-4c4a-a61f-8bf234873b8d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:27.868057 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbedef-60a6-4c4a-a61f-8bf234873b8d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:27.868855 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:27.873379 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44065c-c060-4682-a03e-bf234b1ab4c6 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:27.882743 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbedef-60a6-4c4a-a61f-8bf234873b8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:27.894960 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-8dbbedef-60a6-4c4a-a61f-8bf234873b8d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:31:27.894960 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:27.894960 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:27.894960 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:27.894960 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:27.894960 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:27.894960 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:27.894960 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:27.894960 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:27.894960 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:27.894960 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:27.894960 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:27.894960 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:27.894960 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:27.894960 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:27.894960 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:27.895856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:27.895856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:27.895856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:27.895856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:27.895856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:27.895856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:27.895856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:27.895856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:27.895856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:27.895856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:27.895856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:27.895856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:27.895856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:27.895856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:27.895856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:27.895856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:27.896627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:27.896627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:27.896627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:27.896627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:27.896627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:27.896627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:27.896627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:27.896627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:27.896627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:27.896627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:27.896627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:31:27.896627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:31:27.899770 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 65/124] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:27.900647 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbedef-60a6-4c4a-a61f-8bf234873b8d None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:27.920751 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52176594-11c8-4072-98a4-dcfe0c17a8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:27.921558 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52176594-11c8-4072-98a4-dcfe0c17a8f0 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:27.921847 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52176594-11c8-4072-98a4-dcfe0c17a8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:27.922123 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52176594-11c8-4072-98a4-dcfe0c17a8f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:27.933114 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52176594-11c8-4072-98a4-dcfe0c17a8f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:27.941641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-52176594-11c8-4072-98a4-dcfe0c17a8f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:31:27.941641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:27.941641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:27.941641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:27.941641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:27.941641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:27.941641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:27.941641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:27.941641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:27.941641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:27.941641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:27.941641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:27.941641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:27.941641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:27.941641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:27.941641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:27.942487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:27.942487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:27.942487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:27.942487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:27.942487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:27.942487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:27.942487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:27.942487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:27.942487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:27.942487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:27.942487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:27.942487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:27.942487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:27.942487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:27.942487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:27.942487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:27.943719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:27.943719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:27.943719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:27.943719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:27.943719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:27.943719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:27.943719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:27.943719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:27.943719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:27.943719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:27.943719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:31:27.943719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:31:27.943719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 60/125] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:27.944361 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52176594-11c8-4072-98a4-dcfe0c17a8f0 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:28.017288 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:28.040538 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbedef-60a6-4c4a-a61f-8bf234873b8d None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:28.078751 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52176594-11c8-4072-98a4-dcfe0c17a8f0 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:28.084523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca258f0-80a3-4281-836c-621a2c635208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:28.085480 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca258f0-80a3-4281-836c-621a2c635208 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:28.085841 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca258f0-80a3-4281-836c-621a2c635208 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:28.086200 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca258f0-80a3-4281-836c-621a2c635208 None admin] PATH_INFO: `/v3/projects/65208cd21fc9480e843b073170fa9fff` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:28.087492 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca258f0-80a3-4281-836c-621a2c635208 None admin] RBAC: Authorizing `identity:get_project(project_id=65208cd21fc9480e843b073170fa9fff)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:28.089334 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca258f0-80a3-4281-836c-621a2c635208 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:28.091534 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 66/126] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:27 2022] GET /identity/v3/projects/65208cd21fc9480e843b073170fa9fff => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:28.092519 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca258f0-80a3-4281-836c-621a2c635208 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:28.125622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b8f8d-81c3-4497-a5ca-f0d62262745e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:28.127468 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b8f8d-81c3-4497-a5ca-f0d62262745e None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:28.127965 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b8f8d-81c3-4497-a5ca-f0d62262745e None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:28.128441 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b8f8d-81c3-4497-a5ca-f0d62262745e None admin] PATH_INFO: `/v3/projects/65208cd21fc9480e843b073170fa9fff` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:28.130735 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b8f8d-81c3-4497-a5ca-f0d62262745e None admin] RBAC: Authorizing `identity:get_project(project_id=65208cd21fc9480e843b073170fa9fff)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:28.132507 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b8f8d-81c3-4497-a5ca-f0d62262745e None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:28.136495 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 61/127] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:27 2022] GET /identity/v3/projects/65208cd21fc9480e843b073170fa9fff => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:28.137468 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b8f8d-81c3-4497-a5ca-f0d62262745e None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:28.173164 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:28.217335 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca258f0-80a3-4281-836c-621a2c635208 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:28.260815 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96ddd4-b4eb-42c0-b24b-627c90d26932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:28.261644 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b8f8d-81c3-4497-a5ca-f0d62262745e None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:28.262014 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96ddd4-b4eb-42c0-b24b-627c90d26932 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:28.262498 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96ddd4-b4eb-42c0-b24b-627c90d26932 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:28.263250 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96ddd4-b4eb-42c0-b24b-627c90d26932 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:28.265094 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef96ddd4-b4eb-42c0-b24b-627c90d26932 None admin] RBAC: Adding query filter params (name=member) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:28.265612 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef96ddd4-b4eb-42c0-b24b-627c90d26932 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:28.267177 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef96ddd4-b4eb-42c0-b24b-627c90d26932 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:28.284059 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 67/128] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 08:31:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:28.284767 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96ddd4-b4eb-42c0-b24b-627c90d26932 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:28.300366 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c0e54-d10e-443c-8d81-1c491e96b05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:28.301353 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c0e54-d10e-443c-8d81-1c491e96b05f None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:28.301353 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c0e54-d10e-443c-8d81-1c491e96b05f None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:28.301627 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c0e54-d10e-443c-8d81-1c491e96b05f None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:28.302383 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c0e54-d10e-443c-8d81-1c491e96b05f None admin] RBAC: Adding query filter params (name=member) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:28.302699 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c0e54-d10e-443c-8d81-1c491e96b05f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:28.304205 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c0e54-d10e-443c-8d81-1c491e96b05f None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:28.308237 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:28.313032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 62/129] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 08:31:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:28.313874 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c0e54-d10e-443c-8d81-1c491e96b05f None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:28.421753 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96ddd4-b4eb-42c0-b24b-627c90d26932 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:28.422807 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:28.440686 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c0e54-d10e-443c-8d81-1c491e96b05f None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:28.463644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d061a-3e5b-4d03-a45e-40c9ce9acc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:28.464439 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d061a-3e5b-4d03-a45e-40c9ce9acc3a None admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:28.464877 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d061a-3e5b-4d03-a45e-40c9ce9acc3a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:28.465257 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d061a-3e5b-4d03-a45e-40c9ce9acc3a None admin] PATH_INFO: `/v3/projects/65208cd21fc9480e843b073170fa9fff/users/d3e81ab686314e4bafebf32342e3e7a2/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:28.467470 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d061a-3e5b-4d03-a45e-40c9ce9acc3a None admin] RBAC: Authorizing `identity:create_grant(project_id=65208cd21fc9480e843b073170fa9fff, user_id=d3e81ab686314e4bafebf32342e3e7a2, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:28.469038 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d061a-3e5b-4d03-a45e-40c9ce9acc3a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:28.482933 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9db026-008d-40dd-b78b-9f740ef2267b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:28.485680 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9db026-008d-40dd-b78b-9f740ef2267b None admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:28.485971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9db026-008d-40dd-b78b-9f740ef2267b None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:28.486275 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9db026-008d-40dd-b78b-9f740ef2267b None admin] PATH_INFO: `/v3/projects/65208cd21fc9480e843b073170fa9fff/users/465479e39e5141f68f4d110bd7aff569/roles/be32d79ae2964b4b93a1efff3a9aa70b` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:28.488686 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9db026-008d-40dd-b78b-9f740ef2267b None admin] RBAC: Authorizing `identity:create_grant(project_id=65208cd21fc9480e843b073170fa9fff, user_id=465479e39e5141f68f4d110bd7aff569, role_id=be32d79ae2964b4b93a1efff3a9aa70b)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:28.490189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9db026-008d-40dd-b78b-9f740ef2267b None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:28.539773 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 68/130] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 08:31:28 2022] PUT /identity/v3/projects/65208cd21fc9480e843b073170fa9fff/users/d3e81ab686314e4bafebf32342e3e7a2/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:31:28.539773 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d061a-3e5b-4d03-a45e-40c9ce9acc3a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:28.568725 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 63/131] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 08:31:28 2022] PUT /identity/v3/projects/65208cd21fc9480e843b073170fa9fff/users/465479e39e5141f68f4d110bd7aff569/roles/be32d79ae2964b4b93a1efff3a9aa70b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:31:28.569472 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9db026-008d-40dd-b78b-9f740ef2267b None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:28.728029 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:28.757801 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d061a-3e5b-4d03-a45e-40c9ce9acc3a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:28.801778 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff9516-f872-4d4c-becf-bece329f728e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:28.802599 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff9516-f872-4d4c-becf-bece329f728e None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:28.802882 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff9516-f872-4d4c-becf-bece329f728e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:28.803221 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff9516-f872-4d4c-becf-bece329f728e None admin] PATH_INFO: `/v3/users/465479e39e5141f68f4d110bd7aff569` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:28.805297 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff9516-f872-4d4c-becf-bece329f728e None admin] RBAC: Authorizing `identity:get_user(user_id=465479e39e5141f68f4d110bd7aff569)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:28.806881 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff9516-f872-4d4c-becf-bece329f728e None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:28.809640 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 69/132] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:28 2022] GET /identity/v3/users/465479e39e5141f68f4d110bd7aff569 => generated 275 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:28.816243 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff9516-f872-4d4c-becf-bece329f728e None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:28.834693 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9db026-008d-40dd-b78b-9f740ef2267b None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:28.906944 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9a52a-572a-4db3-a425-ae51f89d069e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:28.907866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9a52a-572a-4db3-a425-ae51f89d069e None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:28.908760 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9a52a-572a-4db3-a425-ae51f89d069e None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:28.909088 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9a52a-572a-4db3-a425-ae51f89d069e None admin] PATH_INFO: `/v3/users/465479e39e5141f68f4d110bd7aff569` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:28.910711 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9a52a-572a-4db3-a425-ae51f89d069e None admin] RBAC: Authorizing `identity:get_user(user_id=465479e39e5141f68f4d110bd7aff569)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:28.913021 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9a52a-572a-4db3-a425-ae51f89d069e None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:28.917965 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 64/133] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:28 2022] GET /identity/v3/users/465479e39e5141f68f4d110bd7aff569 => generated 275 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:28.923713 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9a52a-572a-4db3-a425-ae51f89d069e None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:28.957556 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff9516-f872-4d4c-becf-bece329f728e None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:28.963984 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:29.020460 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe71f7-c514-4c2f-a3b0-34d24c824c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:29.021343 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe71f7-c514-4c2f-a3b0-34d24c824c36 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:29.021632 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe71f7-c514-4c2f-a3b0-34d24c824c36 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:29.021912 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe71f7-c514-4c2f-a3b0-34d24c824c36 None admin] PATH_INFO: `/v3/projects/86834a3aa6ea40379cc5f181470a60da` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:29.023262 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe71f7-c514-4c2f-a3b0-34d24c824c36 None admin] RBAC: Authorizing `identity:get_project(project_id=86834a3aa6ea40379cc5f181470a60da)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:29.024776 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe71f7-c514-4c2f-a3b0-34d24c824c36 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:29.026762 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 70/134] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:28 2022] GET /identity/v3/projects/86834a3aa6ea40379cc5f181470a60da => generated 312 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:29.036639 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe71f7-c514-4c2f-a3b0-34d24c824c36 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:29.064059 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:29.152577 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9a52a-572a-4db3-a425-ae51f89d069e None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:29.181315 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe71f7-c514-4c2f-a3b0-34d24c824c36 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:29.218606 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0aa3da-dfce-432e-a4d1-8daf31496017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:29.219884 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0aa3da-dfce-432e-a4d1-8daf31496017 None admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:29.220399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0aa3da-dfce-432e-a4d1-8daf31496017 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:29.220949 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0aa3da-dfce-432e-a4d1-8daf31496017 None admin] PATH_INFO: `/v3/projects/86834a3aa6ea40379cc5f181470a60da/users/465479e39e5141f68f4d110bd7aff569/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:29.223240 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0aa3da-dfce-432e-a4d1-8daf31496017 None admin] RBAC: Authorizing `identity:create_grant(project_id=86834a3aa6ea40379cc5f181470a60da, user_id=465479e39e5141f68f4d110bd7aff569, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:29.225025 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0aa3da-dfce-432e-a4d1-8daf31496017 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:29.239646 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f6738-e6ff-4f23-b29f-bf663e6de34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:29.239646 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f6738-e6ff-4f23-b29f-bf663e6de34e None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:29.239646 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f6738-e6ff-4f23-b29f-bf663e6de34e None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:29.239646 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f6738-e6ff-4f23-b29f-bf663e6de34e None admin] PATH_INFO: `/v3/projects/65208cd21fc9480e843b073170fa9fff` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:29.240023 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f6738-e6ff-4f23-b29f-bf663e6de34e None admin] RBAC: Authorizing `identity:get_project(project_id=65208cd21fc9480e843b073170fa9fff)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:29.241016 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f6738-e6ff-4f23-b29f-bf663e6de34e None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:29.242808 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 65/135] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:28 2022] GET /identity/v3/projects/65208cd21fc9480e843b073170fa9fff => generated 298 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:29.244063 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ed59b-4a1c-4173-90f6-6dcc7fdf9265 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:29.244312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ed59b-4a1c-4173-90f6-6dcc7fdf9265 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:29.244597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ed59b-4a1c-4173-90f6-6dcc7fdf9265 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:29.245973 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 66/136] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:29.250227 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ed59b-4a1c-4173-90f6-6dcc7fdf9265 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:29.307004 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 71/137] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 08:31:29 2022] PUT /identity/v3/projects/86834a3aa6ea40379cc5f181470a60da/users/465479e39e5141f68f4d110bd7aff569/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:31:29.308665 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bdfbf2-3c33-4649-b910-13dccc037380 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:29.309077 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bdfbf2-3c33-4649-b910-13dccc037380 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:29.309457 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bdfbf2-3c33-4649-b910-13dccc037380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:29.364793 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-32bdfbf2-3c33-4649-b910-13dccc037380 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:29.366081 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-32bdfbf2-3c33-4649-b910-13dccc037380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:29.372026 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:29.400736 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ed59b-4a1c-4173-90f6-6dcc7fdf9265 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:29.464509 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee153a11-3736-4744-959d-8943ecdd5b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:29.465995 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee153a11-3736-4744-959d-8943ecdd5b80 None admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:29.466286 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee153a11-3736-4744-959d-8943ecdd5b80 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:29.466568 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee153a11-3736-4744-959d-8943ecdd5b80 None admin] PATH_INFO: `/v3/projects/65208cd21fc9480e843b073170fa9fff/users/465479e39e5141f68f4d110bd7aff569/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:29.468631 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee153a11-3736-4744-959d-8943ecdd5b80 None admin] RBAC: Authorizing `identity:create_grant(project_id=65208cd21fc9480e843b073170fa9fff, user_id=465479e39e5141f68f4d110bd7aff569, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:29.470104 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee153a11-3736-4744-959d-8943ecdd5b80 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:29.548366 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:29.553496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 67/138] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 08:31:29 2022] PUT /identity/v3/projects/65208cd21fc9480e843b073170fa9fff/users/465479e39e5141f68f4d110bd7aff569/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:31:29.559358 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 72/139] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:29.588684 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee153a11-3736-4744-959d-8943ecdd5b80 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:29.701318 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fca249-7aa2-42ee-ad6d-0fd559e2971e None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:29.701608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fca249-7aa2-42ee-ad6d-0fd559e2971e None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:29.701815 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fca249-7aa2-42ee-ad6d-0fd559e2971e None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:29.705666 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee153a11-3736-4744-959d-8943ecdd5b80 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:29.709969 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 73/140] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:29.721823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a9bbd-6d45-4bbd-9f0d-53de4a62a808 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:29.721994 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a9bbd-6d45-4bbd-9f0d-53de4a62a808 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:29.727636 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a9bbd-6d45-4bbd-9f0d-53de4a62a808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:29.753087 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-9b2a9bbd-6d45-4bbd-9f0d-53de4a62a808 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:29.755402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9b2a9bbd-6d45-4bbd-9f0d-53de4a62a808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:29.779125 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f015a5-cf25-47bd-b078-feeb0e42b90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:29.780005 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f015a5-cf25-47bd-b078-feeb0e42b90c None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:29.780291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f015a5-cf25-47bd-b078-feeb0e42b90c None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:29.780611 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f015a5-cf25-47bd-b078-feeb0e42b90c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:29.781968 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f015a5-cf25-47bd-b078-feeb0e42b90c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:29.784012 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f015a5-cf25-47bd-b078-feeb0e42b90c None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:29.788120 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 68/141] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:29.794947 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f015a5-cf25-47bd-b078-feeb0e42b90c None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:29.828920 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:29.908603 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 74/142] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:31:29.947106 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a9bbd-6d45-4bbd-9f0d-53de4a62a808 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:29.968409 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f015a5-cf25-47bd-b078-feeb0e42b90c None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:30.038860 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24bee6-0033-45b4-a38b-32aea568f8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:30.039749 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24bee6-0033-45b4-a38b-32aea568f8ee None admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:30.040043 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24bee6-0033-45b4-a38b-32aea568f8ee None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:30.040323 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24bee6-0033-45b4-a38b-32aea568f8ee None admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:30.041059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24bee6-0033-45b4-a38b-32aea568f8ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:30.042582 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24bee6-0033-45b4-a38b-32aea568f8ee None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:30.165646 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 69/143] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jul 25 08:31:29 2022] POST /identity/v3/users => generated 283 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:31:30.171996 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a9bbd-6d45-4bbd-9f0d-53de4a62a808 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:30.212251 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:30.225138 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5ea23-9271-4008-bd86-216ab28153a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:30.225884 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5ea23-9271-4008-bd86-216ab28153a9 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:30.226178 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5ea23-9271-4008-bd86-216ab28153a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:30.226461 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5ea23-9271-4008-bd86-216ab28153a9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:30.241595 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5ea23-9271-4008-bd86-216ab28153a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:30.249734 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-01c5ea23-9271-4008-bd86-216ab28153a9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:31:30.249734 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:30.249734 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:30.249734 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:30.249734 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:30.249734 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:30.249734 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:30.249734 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:30.249734 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:30.249734 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:30.249734 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:30.249734 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:30.249734 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:30.249734 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:30.249734 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:30.249734 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:30.250627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:30.250627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:30.250627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:30.250627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:30.250627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:30.250627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:30.250627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:30.250627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:30.250627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:30.250627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:30.250627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:30.250627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:30.250627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:30.250627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:30.250627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:30.250627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:30.251365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:30.251365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:30.251365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:30.251365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:30.251365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:30.251365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:30.251365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:30.251365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:30.251365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:30.251365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:30.251365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:31:30.251365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:31:30.254752 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 75/144] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:31:30.260312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24bee6-0033-45b4-a38b-32aea568f8ee None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:30.367427 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:30.418555 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24bee6-0033-45b4-a38b-32aea568f8ee None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:30.468825 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc702924-19e3-48c4-a1de-62cc249a31e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:30.469610 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc702924-19e3-48c4-a1de-62cc249a31e1 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:30.469801 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc702924-19e3-48c4-a1de-62cc249a31e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:30.470083 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc702924-19e3-48c4-a1de-62cc249a31e1 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:30.471390 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc702924-19e3-48c4-a1de-62cc249a31e1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:30.471738 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc702924-19e3-48c4-a1de-62cc249a31e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:30.473154 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc702924-19e3-48c4-a1de-62cc249a31e1 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:30.486109 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 70/145] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 08:31:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:30.492540 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5ea23-9271-4008-bd86-216ab28153a9 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:30.633583 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5ea23-9271-4008-bd86-216ab28153a9 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:30.678990 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ef115-182e-4be2-8ec7-9486e52d512c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:30.680281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ef115-182e-4be2-8ec7-9486e52d512c None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:30.680769 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ef115-182e-4be2-8ec7-9486e52d512c None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:30.681247 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ef115-182e-4be2-8ec7-9486e52d512c None admin] PATH_INFO: `/v3/users/0aedfa9b55274d9b81df542b048a105e` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:30.682667 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ef115-182e-4be2-8ec7-9486e52d512c None admin] RBAC: Authorizing `identity:get_user(user_id=0aedfa9b55274d9b81df542b048a105e)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:30.684339 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ef115-182e-4be2-8ec7-9486e52d512c None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:30.686180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 76/146] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:30 2022] GET /identity/v3/users/0aedfa9b55274d9b81df542b048a105e => generated 289 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:30.691970 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc702924-19e3-48c4-a1de-62cc249a31e1 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:30.842426 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc702924-19e3-48c4-a1de-62cc249a31e1 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:30.884148 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:30.890913 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd2c04-fa26-4138-b23d-bb9d8b67a13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:30.891813 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd2c04-fa26-4138-b23d-bb9d8b67a13f None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:30.892100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd2c04-fa26-4138-b23d-bb9d8b67a13f None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:30.893115 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd2c04-fa26-4138-b23d-bb9d8b67a13f None admin] PATH_INFO: `/v3/projects/65208cd21fc9480e843b073170fa9fff` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:30.894550 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd2c04-fa26-4138-b23d-bb9d8b67a13f None admin] RBAC: Authorizing `identity:get_project(project_id=65208cd21fc9480e843b073170fa9fff)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:30.901536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd2c04-fa26-4138-b23d-bb9d8b67a13f None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:30.901536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 71/147] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:30 2022] GET /identity/v3/projects/65208cd21fc9480e843b073170fa9fff => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:30.903337 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ef115-182e-4be2-8ec7-9486e52d512c None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:30.990259 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:31.037262 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ef115-182e-4be2-8ec7-9486e52d512c None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:31.079283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522be0e-dee2-4098-836d-a7343f9ebb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:31.080450 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522be0e-dee2-4098-836d-a7343f9ebb45 None admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:31.080944 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522be0e-dee2-4098-836d-a7343f9ebb45 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:31.081295 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522be0e-dee2-4098-836d-a7343f9ebb45 None admin] PATH_INFO: `/v3/projects/65208cd21fc9480e843b073170fa9fff/users/0aedfa9b55274d9b81df542b048a105e/roles/0263e334bab74e7cb5d062a03089b3f7` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:31.083364 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522be0e-dee2-4098-836d-a7343f9ebb45 None admin] RBAC: Authorizing `identity:create_grant(project_id=65208cd21fc9480e843b073170fa9fff, user_id=0aedfa9b55274d9b81df542b048a105e, role_id=0263e334bab74e7cb5d062a03089b3f7)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:31.084852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522be0e-dee2-4098-836d-a7343f9ebb45 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:31.175845 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 77/148] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 08:31:30 2022] PUT /identity/v3/projects/65208cd21fc9480e843b073170fa9fff/users/0aedfa9b55274d9b81df542b048a105e/roles/0263e334bab74e7cb5d062a03089b3f7 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:31:31.321495 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9ce73-565f-4010-a386-eba3f6dae926 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:31.321777 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9ce73-565f-4010-a386-eba3f6dae926 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:31.322056 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9ce73-565f-4010-a386-eba3f6dae926 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:31.323490 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 72/149] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:31.329417 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a1535-0000-4883-8b47-d083bda25a40 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:31.329715 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a1535-0000-4883-8b47-d083bda25a40 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:31.330614 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a1535-0000-4883-8b47-d083bda25a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:31.357276 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-6b4a1535-0000-4883-8b47-d083bda25a40 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:31.358478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6b4a1535-0000-4883-8b47-d083bda25a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:31.441680 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 78/150] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:31.487640 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9ce73-565f-4010-a386-eba3f6dae926 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:31.634323 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9ce73-565f-4010-a386-eba3f6dae926 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:31.682415 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455439a-d21d-4d89-80f2-32b219e4cb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:31.683224 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455439a-d21d-4d89-80f2-32b219e4cb0c None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:31.683508 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455439a-d21d-4d89-80f2-32b219e4cb0c None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:31.683814 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455439a-d21d-4d89-80f2-32b219e4cb0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:31.703348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455439a-d21d-4d89-80f2-32b219e4cb0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:31.711395 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-2455439a-d21d-4d89-80f2-32b219e4cb0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:31:31.711395 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:31.711395 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:31.711395 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:31.711395 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:31.711395 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:31.711395 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:31.711395 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:31.711395 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:31.711395 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:31.711395 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:31.711395 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:31.711395 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:31.711395 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:31.711395 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:31.711395 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:31.712312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:31.712312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:31.712312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:31.712312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:31.712312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:31.712312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:31.712312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:31.712312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:31.712312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:31.712312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:31.712312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:31.712312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:31.712312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:31.712312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:31.712312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:31.712312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:31.713529 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:31.713529 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:31.713529 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:31.713529 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:31.713529 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:31.713529 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:31.713529 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:31.713529 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:31.713529 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:31.713529 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:31.713529 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:31:31.713529 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:31:31.713529 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 73/151] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:31:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:31:31.722937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a1535-0000-4883-8b47-d083bda25a40 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:31.789381 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:31.847225 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a1535-0000-4883-8b47-d083bda25a40 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:31.883357 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac1eff-c591-47bc-bfa0-6e3e8eb7ef3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:31.884233 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac1eff-c591-47bc-bfa0-6e3e8eb7ef3b None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:31.884913 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac1eff-c591-47bc-bfa0-6e3e8eb7ef3b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:31.885197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac1eff-c591-47bc-bfa0-6e3e8eb7ef3b None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:31.885970 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac1eff-c591-47bc-bfa0-6e3e8eb7ef3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:31.886637 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac1eff-c591-47bc-bfa0-6e3e8eb7ef3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:31.888065 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac1eff-c591-47bc-bfa0-6e3e8eb7ef3b None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:31.897865 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 79/152] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:31.903216 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455439a-d21d-4d89-80f2-32b219e4cb0c None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:31.997063 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:32.051750 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455439a-d21d-4d89-80f2-32b219e4cb0c None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:32.093255 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4212b3-79d2-480a-9350-3eb77f349201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:32.094145 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4212b3-79d2-480a-9350-3eb77f349201 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:32.094427 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4212b3-79d2-480a-9350-3eb77f349201 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:32.094699 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4212b3-79d2-480a-9350-3eb77f349201 None admin] PATH_INFO: `/v3/users/d3e81ab686314e4bafebf32342e3e7a2` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:32.096211 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4212b3-79d2-480a-9350-3eb77f349201 None admin] RBAC: Authorizing `identity:get_user(user_id=d3e81ab686314e4bafebf32342e3e7a2)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:32.097692 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4212b3-79d2-480a-9350-3eb77f349201 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:32.099345 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 74/153] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:31 2022] GET /identity/v3/users/d3e81ab686314e4bafebf32342e3e7a2 => generated 247 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:32.105198 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac1eff-c591-47bc-bfa0-6e3e8eb7ef3b None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:32.196863 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d5060-cb87-4878-b84e-c4ad9e60b653 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:32.197547 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d5060-cb87-4878-b84e-c4ad9e60b653 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:32.198040 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d5060-cb87-4878-b84e-c4ad9e60b653 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:32.199899 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 75/154] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:32.205232 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92847653-d3d7-4742-9798-39388ade9ed5 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:32.205784 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92847653-d3d7-4742-9798-39388ade9ed5 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:32.206422 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92847653-d3d7-4742-9798-39388ade9ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:32.240606 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-92847653-d3d7-4742-9798-39388ade9ed5 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:32.242164 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-92847653-d3d7-4742-9798-39388ade9ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:32.291463 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac1eff-c591-47bc-bfa0-6e3e8eb7ef3b None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:32.311200 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:32.368616 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 76/155] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:31:32.372944 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef80a31-4ebe-456c-99e7-95482ff390e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:32.373665 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef80a31-4ebe-456c-99e7-95482ff390e0 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:32.373956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef80a31-4ebe-456c-99e7-95482ff390e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:32.374236 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef80a31-4ebe-456c-99e7-95482ff390e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:32.403257 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92847653-d3d7-4742-9798-39388ade9ed5 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:32.496525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:32.511805 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef80a31-4ebe-456c-99e7-95482ff390e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:32.519439 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef80a31-4ebe-456c-99e7-95482ff390e0 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:32.565257 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92847653-d3d7-4742-9798-39388ade9ed5 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:32.618209 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59defda-09f3-4080-b108-c64a12a80231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:32.619332 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59defda-09f3-4080-b108-c64a12a80231 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:32.619797 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59defda-09f3-4080-b108-c64a12a80231 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:32.620225 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59defda-09f3-4080-b108-c64a12a80231 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:32.636779 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59defda-09f3-4080-b108-c64a12a80231 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:32.649113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-e59defda-09f3-4080-b108-c64a12a80231 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:31:32.649113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:32.649113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:32.649113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:32.649113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:32.649113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:32.649113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:32.649113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:32.649113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:32.649113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:32.649113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:32.649113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:32.649113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:32.649113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:32.649113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:32.649113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:32.650027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:32.650027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:32.650027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:32.650027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:32.650027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:32.650027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:32.650027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:32.650027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:32.650027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:32.650027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:32.650027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:32.650027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:32.650027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:32.650027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:32.650027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:32.650027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:32.650827 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:32.650827 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:32.650827 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:32.650827 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:32.650827 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:32.650827 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:32.650827 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:32.650827 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:32.650827 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:32.650827 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:32.650827 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:31:32.650827 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:31:32.653292 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 77/156] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 08:31:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:31:32.654755 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e85f8d-81bb-41c8-a35f-ce1f55b8a0aa None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:32.659637 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e85f8d-81bb-41c8-a35f-ce1f55b8a0aa None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:32.660581 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e85f8d-81bb-41c8-a35f-ce1f55b8a0aa None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:32.662169 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 78/157] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:32.669199 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ffdd8-da13-47b2-907f-60ec49c390ad None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:32.669728 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ffdd8-da13-47b2-907f-60ec49c390ad None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:32.670210 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ffdd8-da13-47b2-907f-60ec49c390ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:32.708665 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-de3ffdd8-da13-47b2-907f-60ec49c390ad None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:32.710229 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-de3ffdd8-da13-47b2-907f-60ec49c390ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:32.764420 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 80/158] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:31:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:31:32.765943 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef80a31-4ebe-456c-99e7-95482ff390e0 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:32.797107 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:32.823649 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 79/159] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:31:32.824464 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ffdd8-da13-47b2-907f-60ec49c390ad None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:32.894695 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:32.937050 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef80a31-4ebe-456c-99e7-95482ff390e0 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:32.972609 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad00ba5-c6c7-4725-8d8e-bc2798a6e21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:32.973664 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad00ba5-c6c7-4725-8d8e-bc2798a6e21b None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:32.974161 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad00ba5-c6c7-4725-8d8e-bc2798a6e21b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:32.974655 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad00ba5-c6c7-4725-8d8e-bc2798a6e21b None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:32.975702 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad00ba5-c6c7-4725-8d8e-bc2798a6e21b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:32.976230 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad00ba5-c6c7-4725-8d8e-bc2798a6e21b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:32.977812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad00ba5-c6c7-4725-8d8e-bc2798a6e21b None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:32.978975 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ffdd8-da13-47b2-907f-60ec49c390ad None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:32.988063 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 81/160] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:31:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:32.989158 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad00ba5-c6c7-4725-8d8e-bc2798a6e21b None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:33.041426 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b057d8d-4fc9-40b0-bb14-aa19f2c8f929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:33.042299 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b057d8d-4fc9-40b0-bb14-aa19f2c8f929 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:33.042577 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b057d8d-4fc9-40b0-bb14-aa19f2c8f929 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:33.042850 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b057d8d-4fc9-40b0-bb14-aa19f2c8f929 None admin] PATH_INFO: `/v3/projects/65208cd21fc9480e843b073170fa9fff` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:33.045811 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b057d8d-4fc9-40b0-bb14-aa19f2c8f929 None admin] RBAC: Authorizing `identity:get_project(project_id=65208cd21fc9480e843b073170fa9fff)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:33.047577 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b057d8d-4fc9-40b0-bb14-aa19f2c8f929 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:33.050446 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 80/161] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:32 2022] GET /identity/v3/projects/65208cd21fc9480e843b073170fa9fff => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:33.051704 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4deeb6f-2f65-4840-9dd9-a1dffae769f1 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:33.051994 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4deeb6f-2f65-4840-9dd9-a1dffae769f1 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:33.052268 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4deeb6f-2f65-4840-9dd9-a1dffae769f1 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:33.053638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 81/162] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:33.054594 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4deeb6f-2f65-4840-9dd9-a1dffae769f1 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:33.066326 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:33.105103 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad00ba5-c6c7-4725-8d8e-bc2798a6e21b None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:33.180233 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed28bf-33f0-4efb-b1c0-0d81ce5461bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:33.181033 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed28bf-33f0-4efb-b1c0-0d81ce5461bc None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:33.181314 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed28bf-33f0-4efb-b1c0-0d81ce5461bc None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:33.181587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed28bf-33f0-4efb-b1c0-0d81ce5461bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:33.207112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed28bf-33f0-4efb-b1c0-0d81ce5461bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:33.215045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-02ed28bf-33f0-4efb-b1c0-0d81ce5461bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:31:33.215045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:33.215045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:33.215045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:33.215045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:33.215045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:33.215045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:33.215045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:33.215045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:33.215045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:33.215045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:33.215045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:33.215045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:33.215045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:33.215045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:33.215045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:33.215937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:33.215937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:33.215937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:33.215937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:33.215937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:33.215937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:33.215937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:33.215937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:33.215937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:33.215937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:33.215937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:33.215937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:33.215937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:33.215937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:33.215937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:33.215937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:33.216719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:33.216719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:33.216719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:33.216719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:33.216719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:33.216719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:33.216719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:33.216719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:33.216719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:33.216719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:33.216719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:31:33.216719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:31:33.229238 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 82/163] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:33.231151 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08dc4a-0b21-4d81-a3bb-5d2fd769a373 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:33.231437 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08dc4a-0b21-4d81-a3bb-5d2fd769a373 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:33.231740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08dc4a-0b21-4d81-a3bb-5d2fd769a373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:33.278009 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4deeb6f-2f65-4840-9dd9-a1dffae769f1 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:33.289715 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-7b08dc4a-0b21-4d81-a3bb-5d2fd769a373 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:33.290930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-7b08dc4a-0b21-4d81-a3bb-5d2fd769a373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:33.310033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:33.375916 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf292e-fc99-48a4-b7b4-e88f76caad6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:33.377257 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf292e-fc99-48a4-b7b4-e88f76caad6e None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:33.377638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf292e-fc99-48a4-b7b4-e88f76caad6e None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:33.378128 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf292e-fc99-48a4-b7b4-e88f76caad6e None admin] PATH_INFO: `/v3/users/465479e39e5141f68f4d110bd7aff569` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:33.380715 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf292e-fc99-48a4-b7b4-e88f76caad6e None admin] RBAC: Authorizing `identity:get_user(user_id=465479e39e5141f68f4d110bd7aff569)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:33.382169 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf292e-fc99-48a4-b7b4-e88f76caad6e None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:33.386526 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 82/164] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:33 2022] GET /identity/v3/users/465479e39e5141f68f4d110bd7aff569 => generated 275 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:33.393643 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf292e-fc99-48a4-b7b4-e88f76caad6e None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:33.480984 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 83/165] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:33.481850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08dc4a-0b21-4d81-a3bb-5d2fd769a373 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:33.648040 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:33.672281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08dc4a-0b21-4d81-a3bb-5d2fd769a373 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:33.716721 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf292e-fc99-48a4-b7b4-e88f76caad6e None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:33.731138 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6547f6b-90f3-496b-8cdf-b3a8eb20fa8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:33.731924 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6547f6b-90f3-496b-8cdf-b3a8eb20fa8a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:33.732214 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6547f6b-90f3-496b-8cdf-b3a8eb20fa8a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:33.732541 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6547f6b-90f3-496b-8cdf-b3a8eb20fa8a None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:33.733341 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6547f6b-90f3-496b-8cdf-b3a8eb20fa8a None admin] RBAC: Adding query filter params (name=member) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:33.733775 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6547f6b-90f3-496b-8cdf-b3a8eb20fa8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:33.735241 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6547f6b-90f3-496b-8cdf-b3a8eb20fa8a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:33.751008 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 84/166] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 08:31:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:33.751969 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6547f6b-90f3-496b-8cdf-b3a8eb20fa8a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:33.809135 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35299a-28bd-43d6-8a31-d9448727525c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:33.810188 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35299a-28bd-43d6-8a31-d9448727525c None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:33.810683 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35299a-28bd-43d6-8a31-d9448727525c None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:33.811162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35299a-28bd-43d6-8a31-d9448727525c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:33.812276 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35299a-28bd-43d6-8a31-d9448727525c None admin] RBAC: Adding query filter params (role.id=25b0f48c10474bf6b98aad8f093868ee, scope.project.id=65208cd21fc9480e843b073170fa9fff, user.id=d3e81ab686314e4bafebf32342e3e7a2) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:33.812804 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35299a-28bd-43d6-8a31-d9448727525c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:33.815486 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35299a-28bd-43d6-8a31-d9448727525c None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:33.831234 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 83/167] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:31:33 2022] GET /identity/v3/role_assignments?user.id=d3e81ab686314e4bafebf32342e3e7a2&scope.project.id=65208cd21fc9480e843b073170fa9fff&role.id=25b0f48c10474bf6b98aad8f093868ee => generated 608 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:33.832398 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35299a-28bd-43d6-8a31-d9448727525c None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:33.915894 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6547f6b-90f3-496b-8cdf-b3a8eb20fa8a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:33.948015 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:33.961009 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:33.964582 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ac01c-447a-48d8-9e37-6447ef370d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:33.965463 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ac01c-447a-48d8-9e37-6447ef370d5d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:33.965921 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ac01c-447a-48d8-9e37-6447ef370d5d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:33.966359 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ac01c-447a-48d8-9e37-6447ef370d5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:34.069630 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ac01c-447a-48d8-9e37-6447ef370d5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:34.071471 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ac01c-447a-48d8-9e37-6447ef370d5d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:34.072183 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35299a-28bd-43d6-8a31-d9448727525c None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:34.182122 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386721d-abf2-4ab2-b8fc-db3fc7551133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:34.183018 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386721d-abf2-4ab2-b8fc-db3fc7551133 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:34.183330 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 85/168] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:31:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:31:34.183438 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386721d-abf2-4ab2-b8fc-db3fc7551133 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:34.183757 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386721d-abf2-4ab2-b8fc-db3fc7551133 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:34.184813 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ac01c-447a-48d8-9e37-6447ef370d5d None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:34.214594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:34.219793 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386721d-abf2-4ab2-b8fc-db3fc7551133 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:34.232414 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-a386721d-abf2-4ab2-b8fc-db3fc7551133 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:31:34.232414 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:34.232414 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:34.232414 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:34.232414 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:34.232414 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:34.232414 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:34.232414 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:34.232414 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:34.232414 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:34.232414 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:34.232414 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:34.232414 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:34.232414 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:34.232414 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:34.232414 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:34.234527 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:34.234527 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:34.234527 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:34.234527 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:34.234527 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:34.234527 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:34.234527 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:34.234527 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:34.234527 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:34.234527 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:34.234527 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:34.234527 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:34.234527 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:34.234527 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:34.234527 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:34.234527 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:34.235325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:34.235325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:34.235325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:34.235325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:34.235325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:34.235325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:34.235325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:34.235325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:34.235325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:34.235325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:34.235325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:31:34.235325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:31:34.235325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 84/169] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:34.240523 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386721d-abf2-4ab2-b8fc-db3fc7551133 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:34.302059 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ac01c-447a-48d8-9e37-6447ef370d5d None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:34.339605 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0d102-ce52-41c2-b386-02c83019bd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:34.340846 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0d102-ce52-41c2-b386-02c83019bd25 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:34.341332 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0d102-ce52-41c2-b386-02c83019bd25 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:34.341788 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0d102-ce52-41c2-b386-02c83019bd25 None admin] PATH_INFO: `/v3/users/465479e39e5141f68f4d110bd7aff569` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:34.343231 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0d102-ce52-41c2-b386-02c83019bd25 None admin] RBAC: Authorizing `identity:get_user(user_id=465479e39e5141f68f4d110bd7aff569)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:34.344904 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0d102-ce52-41c2-b386-02c83019bd25 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:34.347717 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 86/170] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:34 2022] GET /identity/v3/users/465479e39e5141f68f4d110bd7aff569 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:34.348695 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0d102-ce52-41c2-b386-02c83019bd25 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:34.453193 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:34.457817 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386721d-abf2-4ab2-b8fc-db3fc7551133 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:34.462950 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0d102-ce52-41c2-b386-02c83019bd25 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:34.472009 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:34.500163 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb3f41-c66c-480d-ac18-2a0bb341e030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:34.500850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb3f41-c66c-480d-ac18-2a0bb341e030 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:34.501142 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb3f41-c66c-480d-ac18-2a0bb341e030 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:34.501423 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb3f41-c66c-480d-ac18-2a0bb341e030 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:34.502836 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb3f41-c66c-480d-ac18-2a0bb341e030 None admin] RBAC: Adding query filter params (name=member) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:34.503149 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb3f41-c66c-480d-ac18-2a0bb341e030 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:34.504679 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb3f41-c66c-480d-ac18-2a0bb341e030 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:34.516163 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 87/171] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 08:31:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:34.517317 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb3f41-c66c-480d-ac18-2a0bb341e030 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:34.521276 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbeaf6a-c324-4e7d-aa33-21696323836c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:34.522167 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbeaf6a-c324-4e7d-aa33-21696323836c None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:34.522458 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbeaf6a-c324-4e7d-aa33-21696323836c None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:34.522729 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbeaf6a-c324-4e7d-aa33-21696323836c None admin] PATH_INFO: `/v3/projects/65208cd21fc9480e843b073170fa9fff` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:34.524386 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbeaf6a-c324-4e7d-aa33-21696323836c None admin] RBAC: Authorizing `identity:get_project(project_id=65208cd21fc9480e843b073170fa9fff)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:34.525858 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbeaf6a-c324-4e7d-aa33-21696323836c None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:34.529204 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 85/172] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:34 2022] GET /identity/v3/projects/65208cd21fc9480e843b073170fa9fff => generated 298 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:34.530102 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbeaf6a-c324-4e7d-aa33-21696323836c None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:34.639528 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb3f41-c66c-480d-ac18-2a0bb341e030 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:34.681233 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc1d09-f3f2-48dd-b860-eaef26cada29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:34.681925 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc1d09-f3f2-48dd-b860-eaef26cada29 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:34.682215 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc1d09-f3f2-48dd-b860-eaef26cada29 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:34.682554 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc1d09-f3f2-48dd-b860-eaef26cada29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:34.714487 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:34.764092 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc1d09-f3f2-48dd-b860-eaef26cada29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:34.766184 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc1d09-f3f2-48dd-b860-eaef26cada29 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:34.777763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbeaf6a-c324-4e7d-aa33-21696323836c None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:34.877613 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 88/173] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:31:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:31:34.878840 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc1d09-f3f2-48dd-b860-eaef26cada29 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:34.909657 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac719541-9416-4234-9036-46b74bce61a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:34.911655 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac719541-9416-4234-9036-46b74bce61a3 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:34.912299 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac719541-9416-4234-9036-46b74bce61a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:34.912852 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac719541-9416-4234-9036-46b74bce61a3 None admin] PATH_INFO: `/v3/users/465479e39e5141f68f4d110bd7aff569` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:34.914898 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac719541-9416-4234-9036-46b74bce61a3 None admin] RBAC: Authorizing `identity:get_user(user_id=465479e39e5141f68f4d110bd7aff569)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:34.917224 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac719541-9416-4234-9036-46b74bce61a3 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:34.919758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 86/174] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:34 2022] GET /identity/v3/users/465479e39e5141f68f4d110bd7aff569 => generated 275 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:34.921419 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a457239-e2a3-42e5-89a9-cad952b35c2b None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:34.921875 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a457239-e2a3-42e5-89a9-cad952b35c2b None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:34.922308 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a457239-e2a3-42e5-89a9-cad952b35c2b None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:34.924307 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 87/175] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:34.925589 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a457239-e2a3-42e5-89a9-cad952b35c2b None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:34.956965 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:34.979220 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:35.013272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc1d09-f3f2-48dd-b860-eaef26cada29 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:35.052751 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19527d53-65d2-46c7-b61e-3aa67c853f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:35.053726 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19527d53-65d2-46c7-b61e-3aa67c853f60 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:35.054183 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19527d53-65d2-46c7-b61e-3aa67c853f60 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:35.054679 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19527d53-65d2-46c7-b61e-3aa67c853f60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:35.055757 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19527d53-65d2-46c7-b61e-3aa67c853f60 None admin] RBAC: Adding query filter params (role.id=be32d79ae2964b4b93a1efff3a9aa70b, scope.project.id=65208cd21fc9480e843b073170fa9fff, user.id=465479e39e5141f68f4d110bd7aff569) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:35.055883 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a457239-e2a3-42e5-89a9-cad952b35c2b None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:35.056392 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19527d53-65d2-46c7-b61e-3aa67c853f60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:35.058021 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19527d53-65d2-46c7-b61e-3aa67c853f60 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:35.065007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 89/176] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:31:34 2022] GET /identity/v3/role_assignments?user.id=465479e39e5141f68f4d110bd7aff569&scope.project.id=65208cd21fc9480e843b073170fa9fff&role.id=be32d79ae2964b4b93a1efff3a9aa70b => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:35.065007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa623f99-8639-4fc1-8c2a-17fac92c8609 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:35.065007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa623f99-8639-4fc1-8c2a-17fac92c8609 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:35.065007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa623f99-8639-4fc1-8c2a-17fac92c8609 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:35.065007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 90/177] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:35.073757 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa623f99-8639-4fc1-8c2a-17fac92c8609 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:35.094828 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc155c-1d1f-4910-83c8-ab786107d912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:35.095843 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc155c-1d1f-4910-83c8-ab786107d912 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:35.096129 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc155c-1d1f-4910-83c8-ab786107d912 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:35.096604 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc155c-1d1f-4910-83c8-ab786107d912 None admin] PATH_INFO: `/v3/projects/65208cd21fc9480e843b073170fa9fff` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:35.097910 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc155c-1d1f-4910-83c8-ab786107d912 None admin] RBAC: Authorizing `identity:get_project(project_id=65208cd21fc9480e843b073170fa9fff)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:35.099423 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc155c-1d1f-4910-83c8-ab786107d912 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:35.101304 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 88/178] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:34 2022] GET /identity/v3/projects/65208cd21fc9480e843b073170fa9fff => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:35.102570 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed4642-2231-4ac6-8aee-0cd8989dac9b None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:35.102858 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed4642-2231-4ac6-8aee-0cd8989dac9b None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:35.103136 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed4642-2231-4ac6-8aee-0cd8989dac9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:35.128511 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-45ed4642-2231-4ac6-8aee-0cd8989dac9b None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:35.129735 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-45ed4642-2231-4ac6-8aee-0cd8989dac9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:35.195712 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa623f99-8639-4fc1-8c2a-17fac92c8609 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:35.208165 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 89/179] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:35.208165 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd38a8-6ce9-4095-97d9-de05d01aacd6 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:35.208165 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd38a8-6ce9-4095-97d9-de05d01aacd6 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:35.208165 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd38a8-6ce9-4095-97d9-de05d01aacd6 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:35.212724 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 90/180] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:35.212724 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42d415-d685-4c22-8bc2-6b4bb54ad69e None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:35.212724 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42d415-d685-4c22-8bc2-6b4bb54ad69e None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:35.212724 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42d415-d685-4c22-8bc2-6b4bb54ad69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:35.222329 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:35.235634 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-3d42d415-d685-4c22-8bc2-6b4bb54ad69e None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:35.235634 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-3d42d415-d685-4c22-8bc2-6b4bb54ad69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:35.240967 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7463bc-2c6b-4037-a264-39ffad5e788a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:35.241624 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7463bc-2c6b-4037-a264-39ffad5e788a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:35.241912 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7463bc-2c6b-4037-a264-39ffad5e788a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:35.242186 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7463bc-2c6b-4037-a264-39ffad5e788a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:35.273531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:35.312798 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 91/181] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:35.313650 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42d415-d685-4c22-8bc2-6b4bb54ad69e None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:35.322084 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7463bc-2c6b-4037-a264-39ffad5e788a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:35.323556 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7463bc-2c6b-4037-a264-39ffad5e788a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:35.410937 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42d415-d685-4c22-8bc2-6b4bb54ad69e None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:35.422206 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 91/182] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:31:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:31:35.423515 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84794c7-f8ea-41a2-9371-5b7e6481c9ed None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:35.423836 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84794c7-f8ea-41a2-9371-5b7e6481c9ed None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:35.424131 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84794c7-f8ea-41a2-9371-5b7e6481c9ed None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:35.425549 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 92/183] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:35.426419 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a4466-5e43-4693-8305-ea966767cda2 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:35.426703 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a4466-5e43-4693-8305-ea966767cda2 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:35.427141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a4466-5e43-4693-8305-ea966767cda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:35.444459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-b86a4466-5e43-4693-8305-ea966767cda2 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:35.445644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b86a4466-5e43-4693-8305-ea966767cda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:35.450298 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b2150-274e-4aa5-b827-955f35e761a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:35.450958 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b2150-274e-4aa5-b827-955f35e761a6 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:35.451245 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b2150-274e-4aa5-b827-955f35e761a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:35.451541 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b2150-274e-4aa5-b827-955f35e761a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:35.452391 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b2150-274e-4aa5-b827-955f35e761a6 None admin] RBAC: Adding query filter params (role.id=2cb5ed3eb0484858a5f7cbdce69092ed, scope.project.id=65208cd21fc9480e843b073170fa9fff, user.id=465479e39e5141f68f4d110bd7aff569) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:35.452710 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b2150-274e-4aa5-b827-955f35e761a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:35.454165 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b2150-274e-4aa5-b827-955f35e761a6 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:35.459001 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:35.460580 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 92/184] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:31:35 2022] GET /identity/v3/role_assignments?user.id=465479e39e5141f68f4d110bd7aff569&scope.project.id=65208cd21fc9480e843b073170fa9fff&role.id=2cb5ed3eb0484858a5f7cbdce69092ed => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:35.464489 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b2150-274e-4aa5-b827-955f35e761a6 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:35.502657 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:35.524755 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 93/185] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:35.526159 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a4466-5e43-4693-8305-ea966767cda2 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:35.592691 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b2150-274e-4aa5-b827-955f35e761a6 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:35.631893 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98804f89-3492-49ac-9d09-da0f4080c3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:35.633077 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98804f89-3492-49ac-9d09-da0f4080c3de None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:35.633566 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98804f89-3492-49ac-9d09-da0f4080c3de None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:35.634057 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98804f89-3492-49ac-9d09-da0f4080c3de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:35.646859 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98804f89-3492-49ac-9d09-da0f4080c3de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:35.648952 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a4466-5e43-4693-8305-ea966767cda2 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:35.655049 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-98804f89-3492-49ac-9d09-da0f4080c3de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:31:35.655049 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:35.655049 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:35.655049 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:35.655049 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:35.655049 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:35.655049 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:35.655049 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:35.655049 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:35.655049 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:35.655049 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:35.655049 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:35.655049 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:35.655049 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:35.655049 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:35.655049 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:35.656162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:35.656162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:35.656162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:35.656162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:35.656162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:35.656162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:35.656162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:35.656162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:35.656162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:35.656162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:35.656162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:35.656162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:35.656162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:35.656162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:35.656162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:35.656162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:35.656963 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:35.656963 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:35.656963 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:35.656963 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:35.656963 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:35.656963 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:35.656963 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:35.656963 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:35.656963 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:35.656963 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:35.656963 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:31:35.656963 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:31:35.656963 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 93/186] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:31:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:35.662337 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98804f89-3492-49ac-9d09-da0f4080c3de None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:35.690590 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d5c66-1e1c-4bbe-bad3-e57b6d1041c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:35.691911 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d5c66-1e1c-4bbe-bad3-e57b6d1041c5 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:35.692434 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d5c66-1e1c-4bbe-bad3-e57b6d1041c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:35.692808 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d5c66-1e1c-4bbe-bad3-e57b6d1041c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:35.705773 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d5c66-1e1c-4bbe-bad3-e57b6d1041c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:35.714066 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-a14d5c66-1e1c-4bbe-bad3-e57b6d1041c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:31:35.714066 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:35.714066 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:35.714066 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:35.714066 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:35.714066 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:35.714066 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:35.714066 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:35.714066 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:35.714066 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:35.714066 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:35.714066 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:35.714066 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:35.714066 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:35.714066 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:35.714066 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:35.714937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:35.714937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:35.714937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:35.714937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:35.714937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:35.714937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:35.714937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:35.714937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:35.714937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:35.714937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:35.714937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:35.714937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:35.714937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:35.714937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:35.714937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:35.714937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:35.716018 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:35.716018 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:35.716018 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:35.716018 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:35.716018 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:35.716018 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:35.716018 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:35.716018 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:35.716018 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:35.716018 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:35.716018 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:31:35.716018 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:31:35.716018 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 94/187] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 08:31:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:35.721242 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b90b9-7b47-42c7-bf48-c54069abe2ce None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:35.721531 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b90b9-7b47-42c7-bf48-c54069abe2ce None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:35.721812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b90b9-7b47-42c7-bf48-c54069abe2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:35.739378 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-e49b90b9-7b47-42c7-bf48-c54069abe2ce None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:35.740604 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-e49b90b9-7b47-42c7-bf48-c54069abe2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:35.742623 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:35.766933 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:35.774546 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98804f89-3492-49ac-9d09-da0f4080c3de None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:35.807996 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211374cc-887f-476c-bcfb-11841e75b56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:35.809201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211374cc-887f-476c-bcfb-11841e75b56a None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:35.809494 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211374cc-887f-476c-bcfb-11841e75b56a None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:35.809776 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211374cc-887f-476c-bcfb-11841e75b56a None admin] PATH_INFO: `/v3/projects/86834a3aa6ea40379cc5f181470a60da` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:35.810209 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 95/188] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:35.811042 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b90b9-7b47-42c7-bf48-c54069abe2ce None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:35.811144 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211374cc-887f-476c-bcfb-11841e75b56a None admin] RBAC: Authorizing `identity:get_project(project_id=86834a3aa6ea40379cc5f181470a60da)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:35.812712 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211374cc-887f-476c-bcfb-11841e75b56a None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:35.819594 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 94/189] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:35 2022] GET /identity/v3/projects/86834a3aa6ea40379cc5f181470a60da => generated 312 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:35.819594 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211374cc-887f-476c-bcfb-11841e75b56a None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:35.911443 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b90b9-7b47-42c7-bf48-c54069abe2ce None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:35.920220 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211374cc-887f-476c-bcfb-11841e75b56a None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:35.944335 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910664a-2da8-4a77-add6-909948558f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:35.945120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910664a-2da8-4a77-add6-909948558f4c None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:35.945403 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910664a-2da8-4a77-add6-909948558f4c None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:35.945678 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910664a-2da8-4a77-add6-909948558f4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:35.946848 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910664a-2da8-4a77-add6-909948558f4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:35.948330 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910664a-2da8-4a77-add6-909948558f4c None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:35.949934 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 96/190] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:35.950770 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910664a-2da8-4a77-add6-909948558f4c None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:35.957640 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcaf9a-d0a4-4499-aa05-31a48331f014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:35.958316 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcaf9a-d0a4-4499-aa05-31a48331f014 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:35.958602 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcaf9a-d0a4-4499-aa05-31a48331f014 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:35.958881 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcaf9a-d0a4-4499-aa05-31a48331f014 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:35.959666 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcaf9a-d0a4-4499-aa05-31a48331f014 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:35.959926 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:35.960359 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcaf9a-d0a4-4499-aa05-31a48331f014 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:35.961350 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcaf9a-d0a4-4499-aa05-31a48331f014 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:35.969759 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 95/191] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:35.971363 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcaf9a-d0a4-4499-aa05-31a48331f014 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:35.996131 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:36.052303 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910664a-2da8-4a77-add6-909948558f4c None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:36.068469 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcaf9a-d0a4-4499-aa05-31a48331f014 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:36.085920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed50a2-238b-4db8-a3b1-5b4c7f939c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:36.086582 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed50a2-238b-4db8-a3b1-5b4c7f939c60 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:36.086863 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed50a2-238b-4db8-a3b1-5b4c7f939c60 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:36.087139 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed50a2-238b-4db8-a3b1-5b4c7f939c60 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:36.087921 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed50a2-238b-4db8-a3b1-5b4c7f939c60 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:36.088225 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed50a2-238b-4db8-a3b1-5b4c7f939c60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:36.089618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed50a2-238b-4db8-a3b1-5b4c7f939c60 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:36.097931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 97/192] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:31:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:36.098843 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed50a2-238b-4db8-a3b1-5b4c7f939c60 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:36.101162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e6e2d-7050-4c19-a949-a667043ab848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:36.101825 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e6e2d-7050-4c19-a949-a667043ab848 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:36.102111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e6e2d-7050-4c19-a949-a667043ab848 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:36.103264 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e6e2d-7050-4c19-a949-a667043ab848 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:36.103264 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e6e2d-7050-4c19-a949-a667043ab848 None admin] RBAC: Adding query filter params (role.id=2cb5ed3eb0484858a5f7cbdce69092ed, scope.project.id=86834a3aa6ea40379cc5f181470a60da, user.id=465479e39e5141f68f4d110bd7aff569) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:36.103525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e6e2d-7050-4c19-a949-a667043ab848 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:36.104995 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e6e2d-7050-4c19-a949-a667043ab848 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:36.110919 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 96/193] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:31:35 2022] GET /identity/v3/role_assignments?user.id=465479e39e5141f68f4d110bd7aff569&scope.project.id=86834a3aa6ea40379cc5f181470a60da&role.id=2cb5ed3eb0484858a5f7cbdce69092ed => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:36.112457 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e6e2d-7050-4c19-a949-a667043ab848 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:36.179054 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:36.219780 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed50a2-238b-4db8-a3b1-5b4c7f939c60 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:36.224805 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:36.237933 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e6e2d-7050-4c19-a949-a667043ab848 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:36.258887 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1379626-0be8-4ce4-9070-7110fac598e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:36.259735 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1379626-0be8-4ce4-9070-7110fac598e5 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:36.260538 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1379626-0be8-4ce4-9070-7110fac598e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:36.260827 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1379626-0be8-4ce4-9070-7110fac598e5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:36.275565 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1379626-0be8-4ce4-9070-7110fac598e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:36.275884 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e359374-bb30-44a8-8d97-57cc43397b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:36.277315 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e359374-bb30-44a8-8d97-57cc43397b5d None admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:36.277315 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e359374-bb30-44a8-8d97-57cc43397b5d None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:36.277315 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e359374-bb30-44a8-8d97-57cc43397b5d None admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:36.277741 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e359374-bb30-44a8-8d97-57cc43397b5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:36.279825 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e359374-bb30-44a8-8d97-57cc43397b5d None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:36.285500 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-b1379626-0be8-4ce4-9070-7110fac598e5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:31:36.285500 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:36.285500 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:36.285500 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:36.285500 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:36.285500 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:36.285500 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:36.285500 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:36.285500 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:36.285500 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:36.285500 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:36.285500 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:36.285500 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:36.285500 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:36.285500 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:36.285500 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:36.286385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:36.286385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:36.286385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:36.286385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:36.286385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:36.286385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:36.286385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:36.286385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:36.286385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:36.286385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:36.286385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:36.286385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:36.286385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:36.286385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:36.286385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:36.286385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:36.287187 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:36.287187 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:36.287187 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:36.287187 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:36.287187 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:36.287187 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:36.287187 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:36.287187 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:36.287187 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:36.287187 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:36.287187 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:31:36.287187 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:31:36.287187 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 98/194] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:36.288831 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1379626-0be8-4ce4-9070-7110fac598e5 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:36.372149 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 97/195] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jul 25 08:31:36 2022] POST /identity/v3/users => generated 297 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:31:36.372902 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e359374-bb30-44a8-8d97-57cc43397b5d None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:36.406149 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1379626-0be8-4ce4-9070-7110fac598e5 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:36.438121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:36.447032 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46fc555-e590-462f-82fc-42ecf3369e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:36.447968 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fc555-e590-462f-82fc-42ecf3369e87 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:36.448257 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fc555-e590-462f-82fc-42ecf3369e87 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:36.448541 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fc555-e590-462f-82fc-42ecf3369e87 None admin] PATH_INFO: `/v3/users/86f94ad775e24030979ad9af891ca3b8` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:36.466978 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46fc555-e590-462f-82fc-42ecf3369e87 None admin] RBAC: Authorizing `identity:get_user(user_id=86f94ad775e24030979ad9af891ca3b8)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:36.469491 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46fc555-e590-462f-82fc-42ecf3369e87 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:36.475771 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 99/196] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:36 2022] GET /identity/v3/users/86f94ad775e24030979ad9af891ca3b8 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:36.477116 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46fc555-e590-462f-82fc-42ecf3369e87 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:36.489557 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e359374-bb30-44a8-8d97-57cc43397b5d None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:36.526814 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec42625-ca71-433e-8bd0-ccde343c8f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:36.527339 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec42625-ca71-433e-8bd0-ccde343c8f7e None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:36.528461 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec42625-ca71-433e-8bd0-ccde343c8f7e None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:36.528461 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec42625-ca71-433e-8bd0-ccde343c8f7e None admin] PATH_INFO: `/v3/users/86f94ad775e24030979ad9af891ca3b8` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:36.529165 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec42625-ca71-433e-8bd0-ccde343c8f7e None admin] RBAC: Authorizing `identity:get_user(user_id=86f94ad775e24030979ad9af891ca3b8)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:36.530804 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec42625-ca71-433e-8bd0-ccde343c8f7e None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:36.532253 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 98/197] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:36 2022] GET /identity/v3/users/86f94ad775e24030979ad9af891ca3b8 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:36.533094 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec42625-ca71-433e-8bd0-ccde343c8f7e None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:36.553150 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:36.604455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46fc555-e590-462f-82fc-42ecf3369e87 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:36.650393 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895c463-e3e5-4934-b676-c160026dd1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:36.651293 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895c463-e3e5-4934-b676-c160026dd1d0 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:36.651770 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895c463-e3e5-4934-b676-c160026dd1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:36.652245 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895c463-e3e5-4934-b676-c160026dd1d0 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:36.653018 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895c463-e3e5-4934-b676-c160026dd1d0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:36.653358 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895c463-e3e5-4934-b676-c160026dd1d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:36.654841 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895c463-e3e5-4934-b676-c160026dd1d0 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:36.663206 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec42625-ca71-433e-8bd0-ccde343c8f7e None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:36.663912 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 100/198] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 08:31:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:36.664735 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895c463-e3e5-4934-b676-c160026dd1d0 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:36.717830 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fcf9fd-dbba-4c89-8d31-0c34ebcf7a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:36.718014 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcf9fd-dbba-4c89-8d31-0c34ebcf7a42 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:36.718268 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcf9fd-dbba-4c89-8d31-0c34ebcf7a42 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:36.718541 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcf9fd-dbba-4c89-8d31-0c34ebcf7a42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:36.738802 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:36.800080 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fcf9fd-dbba-4c89-8d31-0c34ebcf7a42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:36.802661 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fcf9fd-dbba-4c89-8d31-0c34ebcf7a42 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:36.804347 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895c463-e3e5-4934-b676-c160026dd1d0 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:36.823574 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:36.849434 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99063bda-887f-4fea-b59d-44ce0c5bdb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:36.850963 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99063bda-887f-4fea-b59d-44ce0c5bdb1c None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:36.851433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99063bda-887f-4fea-b59d-44ce0c5bdb1c None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:36.851952 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99063bda-887f-4fea-b59d-44ce0c5bdb1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:36.925029 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 99/199] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:31:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:31:36.925963 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fcf9fd-dbba-4c89-8d31-0c34ebcf7a42 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:36.949442 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99063bda-887f-4fea-b59d-44ce0c5bdb1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:36.951728 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99063bda-887f-4fea-b59d-44ce0c5bdb1c None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:37.016816 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:37.046404 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fcf9fd-dbba-4c89-8d31-0c34ebcf7a42 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:37.072558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 101/200] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:31:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:31:37.072909 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:37.073984 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99063bda-887f-4fea-b59d-44ce0c5bdb1c None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:37.095147 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a2ac5-c429-4685-89f6-26fec4c54779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:37.096774 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a2ac5-c429-4685-89f6-26fec4c54779 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:37.097061 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a2ac5-c429-4685-89f6-26fec4c54779 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:37.097332 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a2ac5-c429-4685-89f6-26fec4c54779 None admin] PATH_INFO: `/v3/users/0aedfa9b55274d9b81df542b048a105e` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:37.098571 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a2ac5-c429-4685-89f6-26fec4c54779 None admin] RBAC: Authorizing `identity:get_user(user_id=0aedfa9b55274d9b81df542b048a105e)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:37.100830 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a2ac5-c429-4685-89f6-26fec4c54779 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:37.103455 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 100/201] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:36 2022] GET /identity/v3/users/0aedfa9b55274d9b81df542b048a105e => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:37.104492 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a2ac5-c429-4685-89f6-26fec4c54779 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:37.188886 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99063bda-887f-4fea-b59d-44ce0c5bdb1c None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:37.229481 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e82490-6e04-4b03-909c-b23d90209a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:37.230351 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e82490-6e04-4b03-909c-b23d90209a1d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:37.230634 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e82490-6e04-4b03-909c-b23d90209a1d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:37.230911 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e82490-6e04-4b03-909c-b23d90209a1d None admin] PATH_INFO: `/v3/projects/a941dd7311514444b64e1778320ae963` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:37.232062 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a2ac5-c429-4685-89f6-26fec4c54779 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:37.232180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e82490-6e04-4b03-909c-b23d90209a1d None admin] RBAC: Authorizing `identity:get_project(project_id=a941dd7311514444b64e1778320ae963)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:37.233711 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e82490-6e04-4b03-909c-b23d90209a1d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:37.235761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 102/202] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:37 2022] GET /identity/v3/projects/a941dd7311514444b64e1778320ae963 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:37.236425 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e82490-6e04-4b03-909c-b23d90209a1d None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:37.258728 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:37.272444 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb01ec-8c41-438c-adee-6ca89b25fca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:37.273294 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb01ec-8c41-438c-adee-6ca89b25fca1 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:37.274724 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb01ec-8c41-438c-adee-6ca89b25fca1 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:37.274724 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb01ec-8c41-438c-adee-6ca89b25fca1 None admin] PATH_INFO: `/v3/projects/a941dd7311514444b64e1778320ae963` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:37.275326 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb01ec-8c41-438c-adee-6ca89b25fca1 None admin] RBAC: Authorizing `identity:get_project(project_id=a941dd7311514444b64e1778320ae963)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:37.277384 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb01ec-8c41-438c-adee-6ca89b25fca1 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:37.283845 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 101/203] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:37 2022] GET /identity/v3/projects/a941dd7311514444b64e1778320ae963 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:37.283845 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb01ec-8c41-438c-adee-6ca89b25fca1 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:37.354590 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:37.369373 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e82490-6e04-4b03-909c-b23d90209a1d None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:37.415583 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb01ec-8c41-438c-adee-6ca89b25fca1 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:37.420344 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c910d7b-c4a4-4b8e-970d-0cba976e9459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:37.421283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c910d7b-c4a4-4b8e-970d-0cba976e9459 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:37.421806 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c910d7b-c4a4-4b8e-970d-0cba976e9459 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:37.422280 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c910d7b-c4a4-4b8e-970d-0cba976e9459 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:37.451907 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73fd35-7030-46b0-972c-59717d97925e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:37.452495 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73fd35-7030-46b0-972c-59717d97925e None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:37.452780 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73fd35-7030-46b0-972c-59717d97925e None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:37.453065 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73fd35-7030-46b0-972c-59717d97925e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:37.453906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73fd35-7030-46b0-972c-59717d97925e None admin] RBAC: Adding query filter params (role.id=25b0f48c10474bf6b98aad8f093868ee, scope.project.id=a941dd7311514444b64e1778320ae963, user.id=86f94ad775e24030979ad9af891ca3b8) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:37.454218 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73fd35-7030-46b0-972c-59717d97925e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:37.456280 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73fd35-7030-46b0-972c-59717d97925e None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:37.461989 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 102/204] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:31:37 2022] GET /identity/v3/role_assignments?user.id=86f94ad775e24030979ad9af891ca3b8&scope.project.id=a941dd7311514444b64e1778320ae963&role.id=25b0f48c10474bf6b98aad8f093868ee => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:37.462772 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73fd35-7030-46b0-972c-59717d97925e None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:37.503393 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c910d7b-c4a4-4b8e-970d-0cba976e9459 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:37.505258 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c910d7b-c4a4-4b8e-970d-0cba976e9459 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:37.524825 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:37.576081 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73fd35-7030-46b0-972c-59717d97925e None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:37.590263 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:37.614619 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a19c4-4008-4540-b1f3-75eb5198b43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:37.615531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a19c4-4008-4540-b1f3-75eb5198b43a None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:37.616007 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a19c4-4008-4540-b1f3-75eb5198b43a None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:37.616438 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a19c4-4008-4540-b1f3-75eb5198b43a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:37.617476 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a19c4-4008-4540-b1f3-75eb5198b43a None admin] RBAC: Adding query filter params (role.id=be32d79ae2964b4b93a1efff3a9aa70b, scope.project.id=a941dd7311514444b64e1778320ae963, user.id=86f94ad775e24030979ad9af891ca3b8) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:37.617967 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a19c4-4008-4540-b1f3-75eb5198b43a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:37.619594 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a19c4-4008-4540-b1f3-75eb5198b43a None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:37.626348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 103/205] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:31:37 2022] GET /identity/v3/role_assignments?user.id=86f94ad775e24030979ad9af891ca3b8&scope.project.id=a941dd7311514444b64e1778320ae963&role.id=be32d79ae2964b4b93a1efff3a9aa70b => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:37.636441 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 103/206] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:31:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:31:37.643237 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a19c4-4008-4540-b1f3-75eb5198b43a None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:37.775915 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a19c4-4008-4540-b1f3-75eb5198b43a None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:37.815794 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b4376-9073-49a6-817b-5f978fe2c8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:37.816685 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b4376-9073-49a6-817b-5f978fe2c8fd None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:37.816969 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b4376-9073-49a6-817b-5f978fe2c8fd None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:37.817248 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b4376-9073-49a6-817b-5f978fe2c8fd None admin] PATH_INFO: `/v3/projects/65208cd21fc9480e843b073170fa9fff` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:37.819446 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b4376-9073-49a6-817b-5f978fe2c8fd None admin] RBAC: Authorizing `identity:get_project(project_id=65208cd21fc9480e843b073170fa9fff)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:37.820990 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b4376-9073-49a6-817b-5f978fe2c8fd None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:37.822841 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 104/207] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:37 2022] GET /identity/v3/projects/65208cd21fc9480e843b073170fa9fff => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:37.829047 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c910d7b-c4a4-4b8e-970d-0cba976e9459 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:37.960072 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c910d7b-c4a4-4b8e-970d-0cba976e9459 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:37.990274 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:38.014912 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077e983-3b2f-4349-b05b-7b677b18dced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:38.015587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077e983-3b2f-4349-b05b-7b677b18dced None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:38.015931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077e983-3b2f-4349-b05b-7b677b18dced None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:38.016222 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077e983-3b2f-4349-b05b-7b677b18dced None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:38.017071 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e077e983-3b2f-4349-b05b-7b677b18dced None admin] RBAC: Adding query filter params (role.id=0263e334bab74e7cb5d062a03089b3f7, scope.project.id=65208cd21fc9480e843b073170fa9fff, user.id=0aedfa9b55274d9b81df542b048a105e) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:38.018239 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e077e983-3b2f-4349-b05b-7b677b18dced None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:38.018861 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e077e983-3b2f-4349-b05b-7b677b18dced None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:38.028118 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 104/208] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:31:37 2022] GET /identity/v3/role_assignments?user.id=0aedfa9b55274d9b81df542b048a105e&scope.project.id=65208cd21fc9480e843b073170fa9fff&role.id=0263e334bab74e7cb5d062a03089b3f7 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:38.797421 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fad0c9-1569-412b-8de4-47287fb99060 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:38.799055 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fad0c9-1569-412b-8de4-47287fb99060 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:38.799575 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fad0c9-1569-412b-8de4-47287fb99060 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:38.801456 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 105/209] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:38.807127 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1718b6-290a-46a4-9aa8-b4ed14973c29 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:38.807672 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1718b6-290a-46a4-9aa8-b4ed14973c29 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:38.808455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1718b6-290a-46a4-9aa8-b4ed14973c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:38.827138 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-df1718b6-290a-46a4-9aa8-b4ed14973c29 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:38.828669 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-df1718b6-290a-46a4-9aa8-b4ed14973c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:38.893126 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d62e41-e9d0-4f92-8a37-caf10ed04bc1 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:38.893749 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d62e41-e9d0-4f92-8a37-caf10ed04bc1 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:38.894220 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d62e41-e9d0-4f92-8a37-caf10ed04bc1 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:38.895878 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 106/210] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:31:38.906677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356ff34-99db-4153-b210-26613a34ad87 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:38.907013 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356ff34-99db-4153-b210-26613a34ad87 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:38.907524 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356ff34-99db-4153-b210-26613a34ad87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:38.916324 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 105/211] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:38.930911 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-d356ff34-99db-4153-b210-26613a34ad87 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:38.932470 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-d356ff34-99db-4153-b210-26613a34ad87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:38.941405 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1718b6-290a-46a4-9aa8-b4ed14973c29 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:38.989482 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:39.025849 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 107/212] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:39.050702 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356ff34-99db-4153-b210-26613a34ad87 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:39.068025 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1718b6-290a-46a4-9aa8-b4ed14973c29 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:39.082710 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:39.112208 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5634e9e-3267-4901-8531-43c576bdee6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:39.113481 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5634e9e-3267-4901-8531-43c576bdee6a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:39.114144 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5634e9e-3267-4901-8531-43c576bdee6a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:39.114777 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5634e9e-3267-4901-8531-43c576bdee6a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:39.129552 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5634e9e-3267-4901-8531-43c576bdee6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:39.140456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-f5634e9e-3267-4901-8531-43c576bdee6a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:31:39.140456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:39.140456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:39.140456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:39.140456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:39.140456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:39.140456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:39.140456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:39.140456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:39.140456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:39.140456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:39.140456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:39.140456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:39.140456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:39.140456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:39.140456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:39.141323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:39.141323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:39.141323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:39.141323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:39.141323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:39.141323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:39.141323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:39.141323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:39.141323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:39.141323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:39.141323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:39.141323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:39.141323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:39.141323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:39.141323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:39.141323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:39.142121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:39.142121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:39.142121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:39.142121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:39.142121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:39.142121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:39.142121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:39.142121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:39.142121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:39.142121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:39.142121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:31:39.142121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:31:39.142121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 106/213] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:31:39.149381 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5634e9e-3267-4901-8531-43c576bdee6a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:39.188013 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356ff34-99db-4153-b210-26613a34ad87 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:39.224496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac71cc-dbe7-4ce1-83bf-29c0f18892a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:39.225353 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac71cc-dbe7-4ce1-83bf-29c0f18892a1 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:39.225639 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac71cc-dbe7-4ce1-83bf-29c0f18892a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:39.225963 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac71cc-dbe7-4ce1-83bf-29c0f18892a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:39.227212 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac71cc-dbe7-4ce1-83bf-29c0f18892a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:39.228773 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac71cc-dbe7-4ce1-83bf-29c0f18892a1 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:39.235093 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 108/214] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:39.236017 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac71cc-dbe7-4ce1-83bf-29c0f18892a1 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:39.271352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5634e9e-3267-4901-8531-43c576bdee6a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:39.293285 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:39.308631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808d5ae-87e2-4fe5-9e0e-3400c7d5bc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:39.309405 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808d5ae-87e2-4fe5-9e0e-3400c7d5bc96 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:39.309756 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808d5ae-87e2-4fe5-9e0e-3400c7d5bc96 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:39.309975 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808d5ae-87e2-4fe5-9e0e-3400c7d5bc96 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:39.310737 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808d5ae-87e2-4fe5-9e0e-3400c7d5bc96 None admin] RBAC: Adding query filter params (name=member) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:39.311048 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808d5ae-87e2-4fe5-9e0e-3400c7d5bc96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:39.312483 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808d5ae-87e2-4fe5-9e0e-3400c7d5bc96 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:39.326946 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 107/215] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 08:31:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:39.328025 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808d5ae-87e2-4fe5-9e0e-3400c7d5bc96 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:39.361963 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:39.362910 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac71cc-dbe7-4ce1-83bf-29c0f18892a1 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:39.400992 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171677d-78a1-4645-af80-504d21f385e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:39.402014 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171677d-78a1-4645-af80-504d21f385e5 None admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:39.402513 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171677d-78a1-4645-af80-504d21f385e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:39.402980 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171677d-78a1-4645-af80-504d21f385e5 None admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:39.403931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171677d-78a1-4645-af80-504d21f385e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:39.405674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171677d-78a1-4645-af80-504d21f385e5 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:39.436539 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808d5ae-87e2-4fe5-9e0e-3400c7d5bc96 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:39.472886 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20491231-07b6-48fb-b794-8b486eaa7aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:39.473759 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20491231-07b6-48fb-b794-8b486eaa7aac None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:39.474048 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20491231-07b6-48fb-b794-8b486eaa7aac None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:39.474328 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20491231-07b6-48fb-b794-8b486eaa7aac None admin] PATH_INFO: `/v3/users/f43c5b813d5d4ecb9a368bd5c793f5dc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:39.488595 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20491231-07b6-48fb-b794-8b486eaa7aac None admin] RBAC: Authorizing `identity:get_user(user_id=f43c5b813d5d4ecb9a368bd5c793f5dc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:39.490053 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20491231-07b6-48fb-b794-8b486eaa7aac None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:39.491927 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 108/216] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:39 2022] GET /identity/v3/users/f43c5b813d5d4ecb9a368bd5c793f5dc => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:39.497053 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20491231-07b6-48fb-b794-8b486eaa7aac None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:39.505597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 109/217] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jul 25 08:31:39 2022] POST /identity/v3/users => generated 297 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:31:39.607998 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:39.619397 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20491231-07b6-48fb-b794-8b486eaa7aac None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:39.688516 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67f11a-a52d-43c5-ba6e-44d5b5414b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:39.689830 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67f11a-a52d-43c5-ba6e-44d5b5414b75 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:39.690365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67f11a-a52d-43c5-ba6e-44d5b5414b75 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:39.690737 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67f11a-a52d-43c5-ba6e-44d5b5414b75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:39.763470 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67f11a-a52d-43c5-ba6e-44d5b5414b75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:39.764972 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67f11a-a52d-43c5-ba6e-44d5b5414b75 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:39.785540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa814b6-dce2-4423-8817-47b6f0b2d8b8 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:39.785877 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa814b6-dce2-4423-8817-47b6f0b2d8b8 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:39.786091 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa814b6-dce2-4423-8817-47b6f0b2d8b8 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:39.787467 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 110/218] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:31:39.799272 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ea9bb-5269-45d6-a020-c78856e1d3ce None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:39.799879 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ea9bb-5269-45d6-a020-c78856e1d3ce None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:39.799879 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ea9bb-5269-45d6-a020-c78856e1d3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:39.833739 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-904ea9bb-5269-45d6-a020-c78856e1d3ce None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:39.834948 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-904ea9bb-5269-45d6-a020-c78856e1d3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:39.877835 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:39.889146 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 109/219] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:31:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 08:31:39.891171 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bc092-9698-4601-be42-494839a71c0a None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:39.891171 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bc092-9698-4601-be42-494839a71c0a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:39.891171 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bc092-9698-4601-be42-494839a71c0a None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:39.893176 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 110/220] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:39.899893 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796bc092-9698-4601-be42-494839a71c0a None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:39.921931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 111/221] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:31:39.923216 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f90778-e9b2-4762-8ee9-fafa35eafc6d None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:39.923565 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f90778-e9b2-4762-8ee9-fafa35eafc6d None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:39.923868 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f90778-e9b2-4762-8ee9-fafa35eafc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:39.945673 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-34f90778-e9b2-4762-8ee9-fafa35eafc6d None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:39.946869 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-34f90778-e9b2-4762-8ee9-fafa35eafc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:39.977320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:40.019380 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796bc092-9698-4601-be42-494839a71c0a None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:40.043639 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 112/222] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:40.043639 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f90778-e9b2-4762-8ee9-fafa35eafc6d None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:40.077446 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0260a-3e91-4a89-9f27-605217fb71d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:40.078966 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0260a-3e91-4a89-9f27-605217fb71d0 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:40.079439 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0260a-3e91-4a89-9f27-605217fb71d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:40.079922 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0260a-3e91-4a89-9f27-605217fb71d0 None admin] PATH_INFO: `/v3/projects/a941dd7311514444b64e1778320ae963` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:40.081589 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0260a-3e91-4a89-9f27-605217fb71d0 None admin] RBAC: Authorizing `identity:get_project(project_id=a941dd7311514444b64e1778320ae963)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:40.083382 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0260a-3e91-4a89-9f27-605217fb71d0 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:40.085482 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 111/223] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:39 2022] GET /identity/v3/projects/a941dd7311514444b64e1778320ae963 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:40.086484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0260a-3e91-4a89-9f27-605217fb71d0 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:40.164126 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:40.166042 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f90778-e9b2-4762-8ee9-fafa35eafc6d None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:40.197184 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0260a-3e91-4a89-9f27-605217fb71d0 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:40.211550 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91041f70-53ec-4a9e-9e5c-a59d0edd9b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:40.211550 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91041f70-53ec-4a9e-9e5c-a59d0edd9b2f None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:40.211550 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91041f70-53ec-4a9e-9e5c-a59d0edd9b2f None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:40.211550 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91041f70-53ec-4a9e-9e5c-a59d0edd9b2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:40.229918 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91041f70-53ec-4a9e-9e5c-a59d0edd9b2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:40.240259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-91041f70-53ec-4a9e-9e5c-a59d0edd9b2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:31:40.240259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:40.240259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:40.240259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:40.240259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:40.240259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:40.240259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:40.240259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:40.240259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:40.240259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:40.240259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:40.240259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:40.240259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:40.240259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:40.240259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:40.240259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:40.241146 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:40.241146 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:40.241146 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:40.241146 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:40.241146 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:40.241146 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:40.241146 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:40.241146 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:40.241146 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:40.241146 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:40.241146 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:40.241146 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:40.241146 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:40.241146 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:40.241146 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:40.241146 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:40.241950 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:40.241950 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:40.241950 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:40.241950 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:40.241950 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:40.241950 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:40.241950 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:40.241950 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:40.241950 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:40.241950 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:40.241950 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:31:40.241950 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:31:40.241950 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 113/224] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:31:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:40.244239 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d3501-fa80-4c47-9619-ced946d92ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:40.245306 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d3501-fa80-4c47-9619-ced946d92ddb None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:40.245807 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d3501-fa80-4c47-9619-ced946d92ddb None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:40.246294 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d3501-fa80-4c47-9619-ced946d92ddb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:40.248485 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91041f70-53ec-4a9e-9e5c-a59d0edd9b2f None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:40.261097 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d3501-fa80-4c47-9619-ced946d92ddb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:40.270520 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-322d3501-fa80-4c47-9619-ced946d92ddb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:31:40.270520 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:40.270520 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:40.270520 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:40.270520 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:40.270520 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:40.270520 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:40.270520 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:40.270520 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:40.270520 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:40.270520 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:40.270520 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:40.270520 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:40.270520 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:40.270520 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:40.270520 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:40.271414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:40.271414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:40.271414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:40.271414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:40.271414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:40.271414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:40.271414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:40.271414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:40.271414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:40.271414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:40.271414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:40.271414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:40.271414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:40.271414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:40.271414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:40.271414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:40.272216 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:40.272216 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:40.272216 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:40.272216 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:40.272216 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:40.272216 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:40.272216 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:40.272216 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:40.272216 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:40.272216 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:40.272216 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:31:40.272216 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:31:40.272799 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:40.272866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 112/225] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 08:31:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:40.273407 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d3501-fa80-4c47-9619-ced946d92ddb None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:40.365126 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91041f70-53ec-4a9e-9e5c-a59d0edd9b2f None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:40.403741 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab20338-067a-40d6-861b-e168cfbf2335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:40.404873 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab20338-067a-40d6-861b-e168cfbf2335 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:40.405363 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab20338-067a-40d6-861b-e168cfbf2335 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:40.405829 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab20338-067a-40d6-861b-e168cfbf2335 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:40.407003 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab20338-067a-40d6-861b-e168cfbf2335 None admin] RBAC: Adding query filter params (role.id=2cb5ed3eb0484858a5f7cbdce69092ed, scope.project.id=a941dd7311514444b64e1778320ae963, user.id=f43c5b813d5d4ecb9a368bd5c793f5dc) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:40.407556 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab20338-067a-40d6-861b-e168cfbf2335 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:40.409401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab20338-067a-40d6-861b-e168cfbf2335 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:40.410520 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d3501-fa80-4c47-9619-ced946d92ddb None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:40.417037 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 114/226] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:31:40 2022] GET /identity/v3/role_assignments?user.id=f43c5b813d5d4ecb9a368bd5c793f5dc&scope.project.id=a941dd7311514444b64e1778320ae963&role.id=2cb5ed3eb0484858a5f7cbdce69092ed => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:40.418155 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab20338-067a-40d6-861b-e168cfbf2335 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:40.433630 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:40.464469 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cafd1a4-ff34-41cd-b825-fc5e5d11590a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:40.465727 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafd1a4-ff34-41cd-b825-fc5e5d11590a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:40.468038 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafd1a4-ff34-41cd-b825-fc5e5d11590a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:40.468858 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafd1a4-ff34-41cd-b825-fc5e5d11590a None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:40.470433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cafd1a4-ff34-41cd-b825-fc5e5d11590a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:40.471830 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cafd1a4-ff34-41cd-b825-fc5e5d11590a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:40.476423 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cafd1a4-ff34-41cd-b825-fc5e5d11590a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:40.496174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 113/227] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:40.499932 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cafd1a4-ff34-41cd-b825-fc5e5d11590a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:40.559757 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:40.592754 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab20338-067a-40d6-861b-e168cfbf2335 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:40.630325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ee2b1-d13b-4ac0-9d21-b6327cdec9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:40.631004 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ee2b1-d13b-4ac0-9d21-b6327cdec9c0 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:40.631289 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ee2b1-d13b-4ac0-9d21-b6327cdec9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:40.631568 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ee2b1-d13b-4ac0-9d21-b6327cdec9c0 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:40.632377 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ee2b1-d13b-4ac0-9d21-b6327cdec9c0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:40.632694 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ee2b1-d13b-4ac0-9d21-b6327cdec9c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:40.634092 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ee2b1-d13b-4ac0-9d21-b6327cdec9c0 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:40.644247 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 115/228] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:31:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:40.651072 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ee2b1-d13b-4ac0-9d21-b6327cdec9c0 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:40.667813 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cafd1a4-ff34-41cd-b825-fc5e5d11590a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:40.708010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ea528-9e90-4219-99b5-7756c3cb8621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:40.709462 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ea528-9e90-4219-99b5-7756c3cb8621 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:40.709920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ea528-9e90-4219-99b5-7756c3cb8621 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:40.715633 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ea528-9e90-4219-99b5-7756c3cb8621 None admin] PATH_INFO: `/v3/users/86f94ad775e24030979ad9af891ca3b8` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:40.715633 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ea528-9e90-4219-99b5-7756c3cb8621 None admin] RBAC: Authorizing `identity:get_user(user_id=86f94ad775e24030979ad9af891ca3b8)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:40.715633 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ea528-9e90-4219-99b5-7756c3cb8621 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:40.716058 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 114/229] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:40 2022] GET /identity/v3/users/86f94ad775e24030979ad9af891ca3b8 => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:40.725003 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ea528-9e90-4219-99b5-7756c3cb8621 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:40.804017 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:40.858199 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ea528-9e90-4219-99b5-7756c3cb8621 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:40.872228 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ee2b1-d13b-4ac0-9d21-b6327cdec9c0 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:40.898838 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82701db-ff30-4a79-b8b3-4fca448127da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:40.899794 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82701db-ff30-4a79-b8b3-4fca448127da None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:40.900084 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82701db-ff30-4a79-b8b3-4fca448127da None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:40.900365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82701db-ff30-4a79-b8b3-4fca448127da None admin] PATH_INFO: `/v3/projects/a941dd7311514444b64e1778320ae963` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:40.901738 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82701db-ff30-4a79-b8b3-4fca448127da None admin] RBAC: Authorizing `identity:get_project(project_id=a941dd7311514444b64e1778320ae963)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:40.903195 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82701db-ff30-4a79-b8b3-4fca448127da None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:40.906170 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 115/230] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:40 2022] GET /identity/v3/projects/a941dd7311514444b64e1778320ae963 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:40.913613 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82701db-ff30-4a79-b8b3-4fca448127da None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:40.976341 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aface1-f3bf-461d-b640-49ad43b408bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:40.977643 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aface1-f3bf-461d-b640-49ad43b408bd None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:40.978127 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aface1-f3bf-461d-b640-49ad43b408bd None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:40.978598 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aface1-f3bf-461d-b640-49ad43b408bd None admin] PATH_INFO: `/v3/users/86f94ad775e24030979ad9af891ca3b8` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:40.980062 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aface1-f3bf-461d-b640-49ad43b408bd None admin] RBAC: Authorizing `identity:get_user(user_id=86f94ad775e24030979ad9af891ca3b8)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:40.981742 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aface1-f3bf-461d-b640-49ad43b408bd None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:40.987424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 116/231] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:40 2022] GET /identity/v3/users/86f94ad775e24030979ad9af891ca3b8 => generated 283 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:40.991205 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aface1-f3bf-461d-b640-49ad43b408bd None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:41.031663 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:41.033452 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82701db-ff30-4a79-b8b3-4fca448127da None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:41.060641 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:41.073920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a512e-5220-46dc-868d-d358c0dbc6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:41.075161 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a512e-5220-46dc-868d-d358c0dbc6e2 None admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:41.075703 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a512e-5220-46dc-868d-d358c0dbc6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:41.076205 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a512e-5220-46dc-868d-d358c0dbc6e2 None admin] PATH_INFO: `/v3/projects/a941dd7311514444b64e1778320ae963/users/86f94ad775e24030979ad9af891ca3b8/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:41.078471 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a512e-5220-46dc-868d-d358c0dbc6e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=a941dd7311514444b64e1778320ae963, user_id=86f94ad775e24030979ad9af891ca3b8, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:41.081125 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a512e-5220-46dc-868d-d358c0dbc6e2 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:41.161297 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 116/232] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 08:31:40 2022] PUT /identity/v3/projects/a941dd7311514444b64e1778320ae963/users/86f94ad775e24030979ad9af891ca3b8/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:31:41.172321 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aface1-f3bf-461d-b640-49ad43b408bd None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:41.212222 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710fafa-5e91-47a2-9245-81b4da83d5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:41.213467 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710fafa-5e91-47a2-9245-81b4da83d5a3 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:41.213931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710fafa-5e91-47a2-9245-81b4da83d5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:41.214381 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710fafa-5e91-47a2-9245-81b4da83d5a3 None admin] PATH_INFO: `/v3/projects/a941dd7311514444b64e1778320ae963` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:41.215908 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710fafa-5e91-47a2-9245-81b4da83d5a3 None admin] RBAC: Authorizing `identity:get_project(project_id=a941dd7311514444b64e1778320ae963)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:41.217599 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710fafa-5e91-47a2-9245-81b4da83d5a3 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:41.219841 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 117/233] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:40 2022] GET /identity/v3/projects/a941dd7311514444b64e1778320ae963 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:41.226492 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a512e-5220-46dc-868d-d358c0dbc6e2 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:41.354851 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a512e-5220-46dc-868d-d358c0dbc6e2 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:41.403265 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e14c5-f05e-47ca-aee3-7e231dfc6531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:41.404489 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e14c5-f05e-47ca-aee3-7e231dfc6531 None admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:41.404982 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e14c5-f05e-47ca-aee3-7e231dfc6531 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:41.405434 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e14c5-f05e-47ca-aee3-7e231dfc6531 None admin] PATH_INFO: `/v3/projects/a941dd7311514444b64e1778320ae963/users/86f94ad775e24030979ad9af891ca3b8/roles/be32d79ae2964b4b93a1efff3a9aa70b` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:41.408055 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e14c5-f05e-47ca-aee3-7e231dfc6531 None admin] RBAC: Authorizing `identity:create_grant(project_id=a941dd7311514444b64e1778320ae963, user_id=86f94ad775e24030979ad9af891ca3b8, role_id=be32d79ae2964b4b93a1efff3a9aa70b)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:41.409719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e14c5-f05e-47ca-aee3-7e231dfc6531 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:41.539074 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 117/234] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 08:31:41 2022] PUT /identity/v3/projects/a941dd7311514444b64e1778320ae963/users/86f94ad775e24030979ad9af891ca3b8/roles/be32d79ae2964b4b93a1efff3a9aa70b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:31:41.928823 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa38ce-8875-4aef-a7fb-c656c1a4455e None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:41.929306 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa38ce-8875-4aef-a7fb-c656c1a4455e None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:41.929306 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa38ce-8875-4aef-a7fb-c656c1a4455e None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:41.931000 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 118/235] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:41.936171 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc1024-29a4-40e5-8ef1-b8e2ec140c78 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:41.936463 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc1024-29a4-40e5-8ef1-b8e2ec140c78 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:41.936741 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc1024-29a4-40e5-8ef1-b8e2ec140c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:41.956470 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-defc1024-29a4-40e5-8ef1-b8e2ec140c78 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:41.957650 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-defc1024-29a4-40e5-8ef1-b8e2ec140c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:41.988429 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:42.050328 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 118/236] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:42.086679 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa38ce-8875-4aef-a7fb-c656c1a4455e None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:42.179732 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:42.182694 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcab24b-feba-4abd-a09b-a492be28c169 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:42.183131 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcab24b-feba-4abd-a09b-a492be28c169 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:42.183310 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcab24b-feba-4abd-a09b-a492be28c169 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:42.186067 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 119/237] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:42.190732 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faeda08-c283-4c0d-8d05-5e480edecaa1 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:42.191027 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faeda08-c283-4c0d-8d05-5e480edecaa1 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:42.191310 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faeda08-c283-4c0d-8d05-5e480edecaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:42.205585 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa38ce-8875-4aef-a7fb-c656c1a4455e None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:42.237197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-5faeda08-c283-4c0d-8d05-5e480edecaa1 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:42.238408 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-5faeda08-c283-4c0d-8d05-5e480edecaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:42.259988 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ceb3ba-ec63-47e3-b3c8-97c7ca1e28c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:42.260843 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ceb3ba-ec63-47e3-b3c8-97c7ca1e28c0 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:42.261136 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ceb3ba-ec63-47e3-b3c8-97c7ca1e28c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:42.261416 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ceb3ba-ec63-47e3-b3c8-97c7ca1e28c0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:42.279665 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ceb3ba-ec63-47e3-b3c8-97c7ca1e28c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:42.289010 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-58ceb3ba-ec63-47e3-b3c8-97c7ca1e28c0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:31:42.289010 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:42.289010 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:42.289010 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:42.289010 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:42.289010 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:42.289010 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:42.289010 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:42.289010 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:42.289010 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:42.289010 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:42.289010 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:42.289010 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:42.289010 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:42.289010 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:42.289010 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:42.289906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:42.289906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:42.289906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:42.289906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:42.289906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:42.289906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:42.289906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:42.289906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:42.289906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:42.289906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:42.289906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:42.289906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:42.289906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:42.289906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:42.289906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:42.289906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:42.290678 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:42.290678 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:42.290678 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:42.290678 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:42.290678 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:42.290678 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:42.290678 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:42.290678 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:42.290678 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:42.290678 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:42.290678 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:31:42.290678 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:31:42.290678 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 119/238] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:42.299148 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ceb3ba-ec63-47e3-b3c8-97c7ca1e28c0 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:42.378340 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 120/239] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:31:42.413255 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ceb3ba-ec63-47e3-b3c8-97c7ca1e28c0 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:42.433876 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faeda08-c283-4c0d-8d05-5e480edecaa1 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:42.453806 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2950d64-267a-4190-89b7-f7894fe4b6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:42.454627 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2950d64-267a-4190-89b7-f7894fe4b6b3 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:42.455641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2950d64-267a-4190-89b7-f7894fe4b6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:42.455939 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2950d64-267a-4190-89b7-f7894fe4b6b3 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:42.456709 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2950d64-267a-4190-89b7-f7894fe4b6b3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:42.457020 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2950d64-267a-4190-89b7-f7894fe4b6b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:42.458408 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2950d64-267a-4190-89b7-f7894fe4b6b3 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:42.479090 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 120/240] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 08:31:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:42.482941 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2950d64-267a-4190-89b7-f7894fe4b6b3 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:42.487932 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:42.613134 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:42.620226 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faeda08-c283-4c0d-8d05-5e480edecaa1 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:42.662552 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f9a40-3da0-4af9-bad8-b884c780c2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:42.663362 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f9a40-3da0-4af9-bad8-b884c780c2e5 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:42.663718 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f9a40-3da0-4af9-bad8-b884c780c2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:42.663997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f9a40-3da0-4af9-bad8-b884c780c2e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:42.665412 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f9a40-3da0-4af9-bad8-b884c780c2e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:42.667289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f9a40-3da0-4af9-bad8-b884c780c2e5 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:42.669287 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 121/241] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:42.676148 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f9a40-3da0-4af9-bad8-b884c780c2e5 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:42.682575 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2950d64-267a-4190-89b7-f7894fe4b6b3 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:42.788322 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce21da1-c9e8-4cc2-94d2-724c71f7857d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:42.789400 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce21da1-c9e8-4cc2-94d2-724c71f7857d None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:42.789759 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce21da1-c9e8-4cc2-94d2-724c71f7857d None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:42.790108 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce21da1-c9e8-4cc2-94d2-724c71f7857d None admin] PATH_INFO: `/v3/users/e02c40cf28cd4d709b999ceb860dfdfa` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:42.821298 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f9a40-3da0-4af9-bad8-b884c780c2e5 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:42.828339 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce21da1-c9e8-4cc2-94d2-724c71f7857d None admin] RBAC: Authorizing `identity:get_user(user_id=e02c40cf28cd4d709b999ceb860dfdfa)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:42.830574 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce21da1-c9e8-4cc2-94d2-724c71f7857d None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:42.836805 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 121/242] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:42 2022] GET /identity/v3/users/e02c40cf28cd4d709b999ceb860dfdfa => generated 297 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:42.839469 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce21da1-c9e8-4cc2-94d2-724c71f7857d None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:42.865097 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b097438-fb8a-4140-bc15-85606db60450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:42.866486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b097438-fb8a-4140-bc15-85606db60450 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:42.867322 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b097438-fb8a-4140-bc15-85606db60450 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:42.867784 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b097438-fb8a-4140-bc15-85606db60450 None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:42.868692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b097438-fb8a-4140-bc15-85606db60450 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:42.870428 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b097438-fb8a-4140-bc15-85606db60450 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:42.931096 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:42.973564 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce21da1-c9e8-4cc2-94d2-724c71f7857d None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:42.975352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 122/243] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jul 25 08:31:42 2022] POST /identity/v3/users => generated 293 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:31:42.982232 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ceb73c-d276-408d-a4d1-94c341f44772 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:42.982734 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ceb73c-d276-408d-a4d1-94c341f44772 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:42.983155 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ceb73c-d276-408d-a4d1-94c341f44772 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:42.986332 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 123/244] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:42.993387 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d2f34-24a1-4107-acce-6fb53a3bcaa9 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:42.993684 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d2f34-24a1-4107-acce-6fb53a3bcaa9 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:42.993980 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d2f34-24a1-4107-acce-6fb53a3bcaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:43.034254 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f1ba3-096d-4d4c-aedf-d31325f9251e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:43.035447 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f1ba3-096d-4d4c-aedf-d31325f9251e None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:43.035902 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f1ba3-096d-4d4c-aedf-d31325f9251e None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:43.036320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f1ba3-096d-4d4c-aedf-d31325f9251e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:43.049937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-601d2f34-24a1-4107-acce-6fb53a3bcaa9 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:43.053117 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-601d2f34-24a1-4107-acce-6fb53a3bcaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:43.088906 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:43.182187 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f1ba3-096d-4d4c-aedf-d31325f9251e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:43.184025 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f1ba3-096d-4d4c-aedf-d31325f9251e None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:43.191144 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 124/245] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:43.218045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d2f34-24a1-4107-acce-6fb53a3bcaa9 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:43.247529 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:43.293335 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 122/246] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:31:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:31:43.309004 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f1ba3-096d-4d4c-aedf-d31325f9251e None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:43.343547 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d2f34-24a1-4107-acce-6fb53a3bcaa9 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:43.391580 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47cb5d-8f9e-4a01-bb01-9bb2c4b24ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:43.392846 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47cb5d-8f9e-4a01-bb01-9bb2c4b24ed1 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:43.393327 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47cb5d-8f9e-4a01-bb01-9bb2c4b24ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:43.393793 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47cb5d-8f9e-4a01-bb01-9bb2c4b24ed1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:43.405481 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c47cb5d-8f9e-4a01-bb01-9bb2c4b24ed1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:43.414071 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-1c47cb5d-8f9e-4a01-bb01-9bb2c4b24ed1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:31:43.414071 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:43.414071 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:43.414071 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:43.414071 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:43.414071 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:43.414071 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:43.414071 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:43.414071 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:43.414071 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:43.414071 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:43.414071 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:43.414071 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:43.414071 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:43.414071 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:43.414071 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:43.414958 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:43.414958 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:43.414958 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:43.414958 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:43.414958 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:43.414958 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:43.414958 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:43.414958 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:43.414958 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:43.414958 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:43.414958 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:43.414958 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:43.414958 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:43.414958 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:43.414958 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:43.414958 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:43.417853 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:43.417853 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:43.417853 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:43.417853 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:43.417853 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:43.417853 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:43.417853 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:43.417853 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:43.417853 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:43.417853 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:43.417853 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:31:43.417853 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:31:43.420216 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 125/247] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:43.428612 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47cb5d-8f9e-4a01-bb01-9bb2c4b24ed1 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:43.438801 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f1ba3-096d-4d4c-aedf-d31325f9251e None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:43.449970 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:43.503305 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2c0fe-70fc-4856-a1c2-47f16360e74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:43.504141 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2c0fe-70fc-4856-a1c2-47f16360e74f None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:43.504601 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2c0fe-70fc-4856-a1c2-47f16360e74f None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:43.504929 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2c0fe-70fc-4856-a1c2-47f16360e74f None admin] PATH_INFO: `/v3/projects/a941dd7311514444b64e1778320ae963` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:43.506140 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2c0fe-70fc-4856-a1c2-47f16360e74f None admin] RBAC: Authorizing `identity:get_project(project_id=a941dd7311514444b64e1778320ae963)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:43.507711 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2c0fe-70fc-4856-a1c2-47f16360e74f None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:43.509421 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 123/248] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:43 2022] GET /identity/v3/projects/a941dd7311514444b64e1778320ae963 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:43.515408 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2c0fe-70fc-4856-a1c2-47f16360e74f None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:43.550944 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:43.582328 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47cb5d-8f9e-4a01-bb01-9bb2c4b24ed1 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:43.620884 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeff9d1-5f17-4082-b637-fd070e69f714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:43.622065 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeff9d1-5f17-4082-b637-fd070e69f714 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:43.622558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeff9d1-5f17-4082-b637-fd070e69f714 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:43.623258 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeff9d1-5f17-4082-b637-fd070e69f714 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:43.624494 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeff9d1-5f17-4082-b637-fd070e69f714 None admin] RBAC: Adding query filter params (name=member) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:43.625242 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeff9d1-5f17-4082-b637-fd070e69f714 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:43.627676 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeff9d1-5f17-4082-b637-fd070e69f714 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:43.630197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2c0fe-70fc-4856-a1c2-47f16360e74f None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:43.638623 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 126/249] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 08:31:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:43.645393 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeff9d1-5f17-4082-b637-fd070e69f714 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:43.680554 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5de2ae-b621-43f3-a0c0-50f63e137f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:43.681748 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5de2ae-b621-43f3-a0c0-50f63e137f29 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:43.682411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5de2ae-b621-43f3-a0c0-50f63e137f29 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:43.682789 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5de2ae-b621-43f3-a0c0-50f63e137f29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:43.684032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5de2ae-b621-43f3-a0c0-50f63e137f29 None admin] RBAC: Adding query filter params (role.id=0263e334bab74e7cb5d062a03089b3f7, scope.project.id=a941dd7311514444b64e1778320ae963, user.id=e02c40cf28cd4d709b999ceb860dfdfa) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:43.684470 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5de2ae-b621-43f3-a0c0-50f63e137f29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:43.686884 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5de2ae-b621-43f3-a0c0-50f63e137f29 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:43.699816 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 124/250] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:31:43 2022] GET /identity/v3/role_assignments?user.id=e02c40cf28cd4d709b999ceb860dfdfa&scope.project.id=a941dd7311514444b64e1778320ae963&role.id=0263e334bab74e7cb5d062a03089b3f7 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:43.701035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98644a1-b750-414e-ae8a-7baf924a453a None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:43.701325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98644a1-b750-414e-ae8a-7baf924a453a None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:43.701602 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98644a1-b750-414e-ae8a-7baf924a453a None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:43.703059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 125/251] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:43.711261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8bde8-d3b7-44f2-b428-8bf1eb83388d None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:43.711548 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8bde8-d3b7-44f2-b428-8bf1eb83388d None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:43.711876 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8bde8-d3b7-44f2-b428-8bf1eb83388d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:43.746494 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:43.753664 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-75c8bde8-d3b7-44f2-b428-8bf1eb83388d None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:43.755018 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-75c8bde8-d3b7-44f2-b428-8bf1eb83388d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:43.791843 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeff9d1-5f17-4082-b637-fd070e69f714 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:43.856791 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 126/252] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:43.861747 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244f2d3-7a7e-41e4-9ca5-7aa8264978e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:43.862847 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244f2d3-7a7e-41e4-9ca5-7aa8264978e3 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:43.863312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244f2d3-7a7e-41e4-9ca5-7aa8264978e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:43.863793 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244f2d3-7a7e-41e4-9ca5-7aa8264978e3 None admin] PATH_INFO: `/v3/users/f43c5b813d5d4ecb9a368bd5c793f5dc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:43.865179 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244f2d3-7a7e-41e4-9ca5-7aa8264978e3 None admin] RBAC: Authorizing `identity:get_user(user_id=f43c5b813d5d4ecb9a368bd5c793f5dc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:43.866814 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244f2d3-7a7e-41e4-9ca5-7aa8264978e3 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:43.868964 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 127/253] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:43 2022] GET /identity/v3/users/f43c5b813d5d4ecb9a368bd5c793f5dc => generated 297 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:43.876780 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8bde8-d3b7-44f2-b428-8bf1eb83388d None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:43.908722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:43.910450 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244f2d3-7a7e-41e4-9ca5-7aa8264978e3 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:44.038466 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8bde8-d3b7-44f2-b428-8bf1eb83388d None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:44.047276 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244f2d3-7a7e-41e4-9ca5-7aa8264978e3 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:44.086299 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e8f81-b60c-4add-9764-0e8ec184e087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:44.087181 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e8f81-b60c-4add-9764-0e8ec184e087 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:44.087461 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e8f81-b60c-4add-9764-0e8ec184e087 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:44.087783 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e8f81-b60c-4add-9764-0e8ec184e087 None admin] PATH_INFO: `/v3/projects/a941dd7311514444b64e1778320ae963` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:44.092917 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e8f81-b60c-4add-9764-0e8ec184e087 None admin] RBAC: Authorizing `identity:get_project(project_id=a941dd7311514444b64e1778320ae963)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:44.094400 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e8f81-b60c-4add-9764-0e8ec184e087 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:44.096348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 127/254] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:43 2022] GET /identity/v3/projects/a941dd7311514444b64e1778320ae963 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:44.097589 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c910529-6ca0-4762-9778-b8113fcb09b4 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:44.097875 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c910529-6ca0-4762-9778-b8113fcb09b4 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:44.098153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c910529-6ca0-4762-9778-b8113fcb09b4 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:44.105036 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 128/255] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:44.105694 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3b8e6-e000-4ea2-bea1-af88b39eb029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:44.106517 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3b8e6-e000-4ea2-bea1-af88b39eb029 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:44.106807 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3b8e6-e000-4ea2-bea1-af88b39eb029 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:44.107087 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3b8e6-e000-4ea2-bea1-af88b39eb029 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:44.108340 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c910529-6ca0-4762-9778-b8113fcb09b4 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:44.128882 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:44.136571 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3b8e6-e000-4ea2-bea1-af88b39eb029 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:44.150180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-7da3b8e6-e000-4ea2-bea1-af88b39eb029 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:31:44.150180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:44.150180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:44.150180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:44.150180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:44.150180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:44.150180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:44.150180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:44.150180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:44.150180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:44.150180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:44.150180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:44.150180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:44.150180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:44.150180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:44.150180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:44.151120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:44.151120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:44.151120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:44.151120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:44.151120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:44.151120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:44.151120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:44.151120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:44.151120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:44.151120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:44.151120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:44.151120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:44.151120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:44.151120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:44.151120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:44.151120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:44.151955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:44.151955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:44.151955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:44.151955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:44.151955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:44.151955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:44.151955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:44.151955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:44.151955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:44.151955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:44.151955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:31:44.151955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:31:44.151955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 128/256] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:31:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:44.153105 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2568d-7877-43b6-a589-e6df01215cdd None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:44.153105 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2568d-7877-43b6-a589-e6df01215cdd None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:44.153430 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2568d-7877-43b6-a589-e6df01215cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:44.200775 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-37c2568d-7877-43b6-a589-e6df01215cdd None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:44.201976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-37c2568d-7877-43b6-a589-e6df01215cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:44.275697 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:44.277262 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c910529-6ca0-4762-9778-b8113fcb09b4 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:44.323554 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb658527-8ac6-4b79-91d7-ee2f8461965c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:44.324975 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb658527-8ac6-4b79-91d7-ee2f8461965c None admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:44.325460 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb658527-8ac6-4b79-91d7-ee2f8461965c None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:44.325932 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb658527-8ac6-4b79-91d7-ee2f8461965c None admin] PATH_INFO: `/v3/projects/a941dd7311514444b64e1778320ae963/users/f43c5b813d5d4ecb9a368bd5c793f5dc/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:44.329175 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb658527-8ac6-4b79-91d7-ee2f8461965c None admin] RBAC: Authorizing `identity:create_grant(project_id=a941dd7311514444b64e1778320ae963, user_id=f43c5b813d5d4ecb9a368bd5c793f5dc, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:44.330994 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb658527-8ac6-4b79-91d7-ee2f8461965c None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:44.349207 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 129/257] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:44.350105 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2568d-7877-43b6-a589-e6df01215cdd None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:44.419307 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 129/258] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 08:31:44 2022] PUT /identity/v3/projects/a941dd7311514444b64e1778320ae963/users/f43c5b813d5d4ecb9a368bd5c793f5dc/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:31:44.419979 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb658527-8ac6-4b79-91d7-ee2f8461965c None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:44.508956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2568d-7877-43b6-a589-e6df01215cdd None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:44.546534 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:44.553999 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b905e3-8b5b-460f-8650-2cf95fb2cb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:44.554919 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b905e3-8b5b-460f-8650-2cf95fb2cb16 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:44.555353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b905e3-8b5b-460f-8650-2cf95fb2cb16 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:44.555801 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b905e3-8b5b-460f-8650-2cf95fb2cb16 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:44.562257 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b905e3-8b5b-460f-8650-2cf95fb2cb16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:44.562257 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b905e3-8b5b-460f-8650-2cf95fb2cb16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:44.562257 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b905e3-8b5b-460f-8650-2cf95fb2cb16 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:44.570013 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 130/259] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:44.575941 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b905e3-8b5b-460f-8650-2cf95fb2cb16 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:44.674490 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb658527-8ac6-4b79-91d7-ee2f8461965c None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:44.729366 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b905e3-8b5b-460f-8650-2cf95fb2cb16 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:44.764459 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fe344-eb00-47b7-971e-22ce0961dc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:44.765277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fe344-eb00-47b7-971e-22ce0961dc63 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:44.765559 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fe344-eb00-47b7-971e-22ce0961dc63 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:44.765832 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fe344-eb00-47b7-971e-22ce0961dc63 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:44.771549 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a851f-c804-4ca9-a764-ce5a2dbc03dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:44.772760 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a851f-c804-4ca9-a764-ce5a2dbc03dc None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:44.773492 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a851f-c804-4ca9-a764-ce5a2dbc03dc None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:44.774429 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a851f-c804-4ca9-a764-ce5a2dbc03dc None admin] PATH_INFO: `/v3/users/86f94ad775e24030979ad9af891ca3b8` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:44.775867 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a851f-c804-4ca9-a764-ce5a2dbc03dc None admin] RBAC: Authorizing `identity:get_user(user_id=86f94ad775e24030979ad9af891ca3b8)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:44.777787 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a851f-c804-4ca9-a764-ce5a2dbc03dc None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:44.780225 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 131/260] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:44 2022] GET /identity/v3/users/86f94ad775e24030979ad9af891ca3b8 => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:44.788634 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a851f-c804-4ca9-a764-ce5a2dbc03dc None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:44.788876 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1fe344-eb00-47b7-971e-22ce0961dc63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:44.795639 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-ef1fe344-eb00-47b7-971e-22ce0961dc63 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:31:44.795639 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:44.795639 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:44.795639 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:44.795639 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:44.795639 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:44.795639 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:44.795639 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:44.795639 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:44.795639 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:44.795639 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:44.795639 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:44.795639 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:44.795639 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:44.795639 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:44.795639 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:44.796500 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:44.796500 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:44.796500 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:44.796500 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:44.796500 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:44.796500 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:44.796500 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:44.796500 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:44.796500 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:44.796500 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:44.796500 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:44.796500 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:44.796500 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:44.796500 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:44.796500 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:44.796500 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:44.797299 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:44.797299 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:44.797299 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:44.797299 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:44.797299 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:44.797299 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:44.797299 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:44.797299 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:44.797299 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:44.797299 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:44.797299 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:31:44.797299 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:31:44.805421 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 130/261] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 08:31:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:44.811761 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fe344-eb00-47b7-971e-22ce0961dc63 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:44.835358 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:44.921914 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:44.996601 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a851f-c804-4ca9-a764-ce5a2dbc03dc None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:45.011002 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fe344-eb00-47b7-971e-22ce0961dc63 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:45.061338 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37e387-18ff-4acf-ac21-0d2b1f7c950b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:45.062000 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37e387-18ff-4acf-ac21-0d2b1f7c950b None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:45.062577 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37e387-18ff-4acf-ac21-0d2b1f7c950b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:45.062995 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37e387-18ff-4acf-ac21-0d2b1f7c950b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:45.071689 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91daf5ca-9f52-4a9d-8266-b91e571c7314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:45.072883 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91daf5ca-9f52-4a9d-8266-b91e571c7314 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:45.073308 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91daf5ca-9f52-4a9d-8266-b91e571c7314 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:45.073749 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91daf5ca-9f52-4a9d-8266-b91e571c7314 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:45.074640 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91daf5ca-9f52-4a9d-8266-b91e571c7314 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:45.075090 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91daf5ca-9f52-4a9d-8266-b91e571c7314 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:45.076707 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91daf5ca-9f52-4a9d-8266-b91e571c7314 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:45.094178 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 131/262] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:31:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:45.100246 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91daf5ca-9f52-4a9d-8266-b91e571c7314 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:45.193305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37e387-18ff-4acf-ac21-0d2b1f7c950b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:45.194815 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37e387-18ff-4acf-ac21-0d2b1f7c950b None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:45.247215 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:45.300936 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91daf5ca-9f52-4a9d-8266-b91e571c7314 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:45.312965 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:45.338611 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2c495-6ba6-42a7-b061-c363250aee71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:45.339491 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2c495-6ba6-42a7-b061-c363250aee71 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:45.339810 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2c495-6ba6-42a7-b061-c363250aee71 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:45.340160 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2c495-6ba6-42a7-b061-c363250aee71 None admin] PATH_INFO: `/v3/users/86f94ad775e24030979ad9af891ca3b8` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:45.341357 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2c495-6ba6-42a7-b061-c363250aee71 None admin] RBAC: Authorizing `identity:get_user(user_id=86f94ad775e24030979ad9af891ca3b8)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:45.342819 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2c495-6ba6-42a7-b061-c363250aee71 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:45.344848 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 132/263] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:45 2022] GET /identity/v3/users/86f94ad775e24030979ad9af891ca3b8 => generated 283 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:45.351450 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2c495-6ba6-42a7-b061-c363250aee71 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:45.392644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 132/264] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:31:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:31:45.398218 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37e387-18ff-4acf-ac21-0d2b1f7c950b None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:45.500931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2c495-6ba6-42a7-b061-c363250aee71 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:45.538750 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0cdb91-43ac-4edf-92d5-c5f9e6056acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:45.539406 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0cdb91-43ac-4edf-92d5-c5f9e6056acb None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:45.539735 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0cdb91-43ac-4edf-92d5-c5f9e6056acb None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:45.540012 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0cdb91-43ac-4edf-92d5-c5f9e6056acb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:45.551935 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:45.611945 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0cdb91-43ac-4edf-92d5-c5f9e6056acb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:45.613443 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0cdb91-43ac-4edf-92d5-c5f9e6056acb None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:45.652863 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37e387-18ff-4acf-ac21-0d2b1f7c950b None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:45.719289 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 133/265] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:31:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 08:31:45.725822 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0cdb91-43ac-4edf-92d5-c5f9e6056acb None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:45.728857 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80099eba-1947-44be-8609-70a6784cc713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:45.729747 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80099eba-1947-44be-8609-70a6784cc713 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:45.730035 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80099eba-1947-44be-8609-70a6784cc713 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:45.730319 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80099eba-1947-44be-8609-70a6784cc713 None admin] PATH_INFO: `/v3/projects/a941dd7311514444b64e1778320ae963` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:45.734846 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80099eba-1947-44be-8609-70a6784cc713 None admin] RBAC: Authorizing `identity:get_project(project_id=a941dd7311514444b64e1778320ae963)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:45.736517 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80099eba-1947-44be-8609-70a6784cc713 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:45.738448 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 133/266] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:45 2022] GET /identity/v3/projects/a941dd7311514444b64e1778320ae963 => generated 302 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:45.745087 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80099eba-1947-44be-8609-70a6784cc713 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:45.799987 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:45.800190 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:45.906276 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0cdb91-43ac-4edf-92d5-c5f9e6056acb None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:45.937604 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80099eba-1947-44be-8609-70a6784cc713 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:45.953948 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444fb3b-150b-49aa-a60f-7e8db57784ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:45.955658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444fb3b-150b-49aa-a60f-7e8db57784ce None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:45.955658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444fb3b-150b-49aa-a60f-7e8db57784ce None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:45.955940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444fb3b-150b-49aa-a60f-7e8db57784ce None admin] PATH_INFO: `/v3/projects/a941dd7311514444b64e1778320ae963` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:45.957139 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b444fb3b-150b-49aa-a60f-7e8db57784ce None admin] RBAC: Authorizing `identity:get_project(project_id=a941dd7311514444b64e1778320ae963)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:45.958586 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b444fb3b-150b-49aa-a60f-7e8db57784ce None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:45.960623 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 134/267] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:45 2022] GET /identity/v3/projects/a941dd7311514444b64e1778320ae963 => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:45.966341 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444fb3b-150b-49aa-a60f-7e8db57784ce None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:45.984790 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a76c05-9fca-4519-8b70-aef71ce79e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:45.985454 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a76c05-9fca-4519-8b70-aef71ce79e29 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:45.985778 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a76c05-9fca-4519-8b70-aef71ce79e29 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:45.986482 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a76c05-9fca-4519-8b70-aef71ce79e29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:45.987029 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a76c05-9fca-4519-8b70-aef71ce79e29 None admin] RBAC: Adding query filter params (role.id=25b0f48c10474bf6b98aad8f093868ee, scope.project.id=a941dd7311514444b64e1778320ae963, user.id=86f94ad775e24030979ad9af891ca3b8) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:45.987346 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a76c05-9fca-4519-8b70-aef71ce79e29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:45.988817 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a76c05-9fca-4519-8b70-aef71ce79e29 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:45.995115 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 134/268] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:31:45 2022] GET /identity/v3/role_assignments?user.id=86f94ad775e24030979ad9af891ca3b8&scope.project.id=a941dd7311514444b64e1778320ae963&role.id=25b0f48c10474bf6b98aad8f093868ee => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:46.074991 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444fb3b-150b-49aa-a60f-7e8db57784ce None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:46.085749 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:46.112762 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ade94-a243-4cda-97f3-81d8bb99969c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:46.113440 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ade94-a243-4cda-97f3-81d8bb99969c None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:46.113722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ade94-a243-4cda-97f3-81d8bb99969c None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:46.113996 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ade94-a243-4cda-97f3-81d8bb99969c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:46.114861 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ade94-a243-4cda-97f3-81d8bb99969c None admin] RBAC: Adding query filter params (role.id=be32d79ae2964b4b93a1efff3a9aa70b, scope.project.id=a941dd7311514444b64e1778320ae963, user.id=86f94ad775e24030979ad9af891ca3b8) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:46.115173 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ade94-a243-4cda-97f3-81d8bb99969c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:46.116770 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ade94-a243-4cda-97f3-81d8bb99969c None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:46.123809 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 135/269] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:31:45 2022] GET /identity/v3/role_assignments?user.id=86f94ad775e24030979ad9af891ca3b8&scope.project.id=a941dd7311514444b64e1778320ae963&role.id=be32d79ae2964b4b93a1efff3a9aa70b => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:46.292082 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d21cb-8074-4493-bb1e-b5bed45147db None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:46.292429 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d21cb-8074-4493-bb1e-b5bed45147db None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:46.292643 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d21cb-8074-4493-bb1e-b5bed45147db None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:46.294291 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 135/270] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:46.300756 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cef059-eb9e-4eb8-b37d-f4a813658b4c None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:46.301045 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cef059-eb9e-4eb8-b37d-f4a813658b4c None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:46.301321 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cef059-eb9e-4eb8-b37d-f4a813658b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:46.322258 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-d7cef059-eb9e-4eb8-b37d-f4a813658b4c None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:46.323457 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-d7cef059-eb9e-4eb8-b37d-f4a813658b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:46.396681 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 136/271] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:46.422121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d21cb-8074-4493-bb1e-b5bed45147db None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:46.527830 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:46.539017 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d21cb-8074-4493-bb1e-b5bed45147db None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:46.581395 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0ec9f-576b-4fe2-9e9d-9159c4c4b7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:46.582141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0ec9f-576b-4fe2-9e9d-9159c4c4b7b0 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:46.582426 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0ec9f-576b-4fe2-9e9d-9159c4c4b7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:46.582702 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0ec9f-576b-4fe2-9e9d-9159c4c4b7b0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:46.594167 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0ec9f-576b-4fe2-9e9d-9159c4c4b7b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:46.602646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-81b0ec9f-576b-4fe2-9e9d-9159c4c4b7b0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:31:46.602646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:46.602646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:46.602646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:46.602646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:46.602646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:46.602646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:46.602646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:46.602646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:46.602646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:46.602646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:46.602646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:46.602646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:46.602646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:46.602646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:46.602646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:46.603534 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:46.603534 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:46.603534 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:46.603534 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:46.603534 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:46.603534 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:46.603534 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:46.603534 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:46.603534 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:46.603534 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:46.603534 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:46.603534 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:46.603534 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:46.603534 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:46.603534 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:46.603534 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:46.604388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:46.604388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:46.604388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:46.604388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:46.604388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:46.604388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:46.604388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:46.604388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:46.604388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:46.604388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:46.604388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:31:46.604388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:31:46.604388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 136/272] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:46.611821 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cef059-eb9e-4eb8-b37d-f4a813658b4c None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:46.716373 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cef059-eb9e-4eb8-b37d-f4a813658b4c None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:46.727995 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:46.752575 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e13a5-42c5-4d5a-8295-9926bdd6de3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:46.753243 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e13a5-42c5-4d5a-8295-9926bdd6de3c None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:46.753523 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e13a5-42c5-4d5a-8295-9926bdd6de3c None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:46.753796 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e13a5-42c5-4d5a-8295-9926bdd6de3c None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:46.754548 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e13a5-42c5-4d5a-8295-9926bdd6de3c None admin] RBAC: Adding query filter params (name=reader) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:46.754848 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e13a5-42c5-4d5a-8295-9926bdd6de3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:46.756261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e13a5-42c5-4d5a-8295-9926bdd6de3c None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:46.764676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 137/273] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 08:31:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:46.770374 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0ec9f-576b-4fe2-9e9d-9159c4c4b7b0 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:46.807035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e340616-d351-4cda-b225-be7ed81e6852 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:46.807720 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e340616-d351-4cda-b225-be7ed81e6852 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:46.808575 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e340616-d351-4cda-b225-be7ed81e6852 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:46.810253 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 138/274] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:31:46.816476 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e10be-fd0f-480d-85ed-fe85abf36b15 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:46.817015 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e10be-fd0f-480d-85ed-fe85abf36b15 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:46.817493 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e10be-fd0f-480d-85ed-fe85abf36b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:46.837368 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-c03e10be-fd0f-480d-85ed-fe85abf36b15 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:46.838873 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-c03e10be-fd0f-480d-85ed-fe85abf36b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:46.887872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0ec9f-576b-4fe2-9e9d-9159c4c4b7b0 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:46.911335 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 139/275] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:46.917072 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d39eb-0f31-407b-b4e6-a6b9bc44adf2 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:46.917593 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d39eb-0f31-407b-b4e6-a6b9bc44adf2 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:46.918060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d39eb-0f31-407b-b4e6-a6b9bc44adf2 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:46.919817 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 140/276] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:46.926567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74b0d6-7d25-43ae-9a10-968074f2420e None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:46.927138 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74b0d6-7d25-43ae-9a10-968074f2420e None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:46.927686 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74b0d6-7d25-43ae-9a10-968074f2420e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:46.928598 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e0231-2fb3-4b5c-b2c4-f51c547e9b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:46.929651 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e0231-2fb3-4b5c-b2c4-f51c547e9b7e None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:46.930007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e0231-2fb3-4b5c-b2c4-f51c547e9b7e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:46.930378 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e0231-2fb3-4b5c-b2c4-f51c547e9b7e None admin] PATH_INFO: `/v3/users/e02c40cf28cd4d709b999ceb860dfdfa` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:46.931920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e0231-2fb3-4b5c-b2c4-f51c547e9b7e None admin] RBAC: Authorizing `identity:get_user(user_id=e02c40cf28cd4d709b999ceb860dfdfa)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:46.933598 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e0231-2fb3-4b5c-b2c4-f51c547e9b7e None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:46.935365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 137/277] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:46 2022] GET /identity/v3/users/e02c40cf28cd4d709b999ceb860dfdfa => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:46.937470 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e0231-2fb3-4b5c-b2c4-f51c547e9b7e None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:46.950370 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-6c74b0d6-7d25-43ae-9a10-968074f2420e None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:46.951566 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-6c74b0d6-7d25-43ae-9a10-968074f2420e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:46.961685 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:47.026577 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 141/278] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:47.027723 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74b0d6-7d25-43ae-9a10-968074f2420e None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:47.041587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e0231-2fb3-4b5c-b2c4-f51c547e9b7e None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:47.065843 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:47.078020 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db32e8-43e4-4569-b943-15adae6bc03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:47.078820 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db32e8-43e4-4569-b943-15adae6bc03c None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:47.079105 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db32e8-43e4-4569-b943-15adae6bc03c None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:47.079434 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db32e8-43e4-4569-b943-15adae6bc03c None admin] PATH_INFO: `/v3/roles/member` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:47.090866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db32e8-43e4-4569-b943-15adae6bc03c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:47.098733 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-f7db32e8-43e4-4569-b943-15adae6bc03c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:31:47.098733 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:47.098733 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:47.098733 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:47.098733 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:47.098733 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:47.098733 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:47.098733 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:47.098733 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:47.098733 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:47.098733 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:47.098733 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:47.098733 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:47.098733 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:47.098733 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:47.098733 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:47.099645 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:47.099645 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:47.099645 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:47.099645 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:47.099645 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:47.099645 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:47.099645 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:47.099645 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:47.099645 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:47.099645 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:47.099645 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:47.099645 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:47.099645 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:47.099645 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:47.099645 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:47.099645 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:47.100464 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:47.100464 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:47.100464 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:47.100464 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:47.100464 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:47.100464 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:47.100464 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:47.100464 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:47.100464 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:47.100464 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:47.100464 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:31:47.100464 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:31:47.100464 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 138/279] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:47.101166 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db32e8-43e4-4569-b943-15adae6bc03c None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:47.147894 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74b0d6-7d25-43ae-9a10-968074f2420e None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:47.186818 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b1af7-0c4c-42e1-88f2-b8f63918ec0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:47.187734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b1af7-0c4c-42e1-88f2-b8f63918ec0e None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:47.188334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b1af7-0c4c-42e1-88f2-b8f63918ec0e None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:47.188616 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b1af7-0c4c-42e1-88f2-b8f63918ec0e None admin] PATH_INFO: `/v3/projects/a941dd7311514444b64e1778320ae963` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:47.190698 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b1af7-0c4c-42e1-88f2-b8f63918ec0e None admin] RBAC: Authorizing `identity:get_project(project_id=a941dd7311514444b64e1778320ae963)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:47.191586 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:47.193038 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b1af7-0c4c-42e1-88f2-b8f63918ec0e None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:47.195102 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 142/280] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:47 2022] GET /identity/v3/projects/a941dd7311514444b64e1778320ae963 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:47.196400 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b1af7-0c4c-42e1-88f2-b8f63918ec0e None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:47.214033 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db32e8-43e4-4569-b943-15adae6bc03c None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:47.249055 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d9bb9-b88b-42f0-b25e-21286abad7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:47.249854 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d9bb9-b88b-42f0-b25e-21286abad7d5 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:47.250178 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d9bb9-b88b-42f0-b25e-21286abad7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:47.250464 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d9bb9-b88b-42f0-b25e-21286abad7d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:47.252284 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d9bb9-b88b-42f0-b25e-21286abad7d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:47.253728 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d9bb9-b88b-42f0-b25e-21286abad7d5 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:47.255351 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 139/281] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:47.256120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d9bb9-b88b-42f0-b25e-21286abad7d5 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:47.291754 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:47.300724 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b1af7-0c4c-42e1-88f2-b8f63918ec0e None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:47.334154 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964eda24-d9ce-4276-a20b-550dc91a83a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:47.334820 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964eda24-d9ce-4276-a20b-550dc91a83a2 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:47.335102 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964eda24-d9ce-4276-a20b-550dc91a83a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:47.335382 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964eda24-d9ce-4276-a20b-550dc91a83a2 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:47.336194 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964eda24-d9ce-4276-a20b-550dc91a83a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:47.336477 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964eda24-d9ce-4276-a20b-550dc91a83a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:47.337851 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964eda24-d9ce-4276-a20b-550dc91a83a2 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:47.345827 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 143/282] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 08:31:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:47.348937 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20beb85-ddda-4229-88f9-9f81a42fa428 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:47.349235 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20beb85-ddda-4229-88f9-9f81a42fa428 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:47.349522 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20beb85-ddda-4229-88f9-9f81a42fa428 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:47.350812 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 144/283] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:47.352404 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20beb85-ddda-4229-88f9-9f81a42fa428 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:47.353082 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d9bb9-b88b-42f0-b25e-21286abad7d5 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:47.388518 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cafb85-d3e6-45e4-80d8-3d7d01c2720f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:47.389414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cafb85-d3e6-45e4-80d8-3d7d01c2720f None admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:47.389701 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cafb85-d3e6-45e4-80d8-3d7d01c2720f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:47.389982 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cafb85-d3e6-45e4-80d8-3d7d01c2720f None admin] PATH_INFO: `/v3/projects/a941dd7311514444b64e1778320ae963/users/e02c40cf28cd4d709b999ceb860dfdfa/roles/0263e334bab74e7cb5d062a03089b3f7` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:47.392002 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cafb85-d3e6-45e4-80d8-3d7d01c2720f None admin] RBAC: Authorizing `identity:create_grant(project_id=a941dd7311514444b64e1778320ae963, user_id=e02c40cf28cd4d709b999ceb860dfdfa, role_id=0263e334bab74e7cb5d062a03089b3f7)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:47.393592 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cafb85-d3e6-45e4-80d8-3d7d01c2720f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:47.453894 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20beb85-ddda-4229-88f9-9f81a42fa428 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:47.474577 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 140/284] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 08:31:47 2022] PUT /identity/v3/projects/a941dd7311514444b64e1778320ae963/users/e02c40cf28cd4d709b999ceb860dfdfa/roles/0263e334bab74e7cb5d062a03089b3f7 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:31:47.476082 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cafb85-d3e6-45e4-80d8-3d7d01c2720f None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:47.488622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24d837-c643-4db9-b802-fb6d7e920668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:47.489330 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24d837-c643-4db9-b802-fb6d7e920668 None admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:47.489611 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24d837-c643-4db9-b802-fb6d7e920668 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:47.489891 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24d837-c643-4db9-b802-fb6d7e920668 None admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:47.490644 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24d837-c643-4db9-b802-fb6d7e920668 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:47.492385 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24d837-c643-4db9-b802-fb6d7e920668 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:47.499241 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:47.595656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 145/285] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jul 25 08:31:47 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:31:47.595656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eebfbc-9915-49de-8de8-af9856ae2c77 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:47.595656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eebfbc-9915-49de-8de8-af9856ae2c77 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:47.595656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eebfbc-9915-49de-8de8-af9856ae2c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:47.606940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cafb85-d3e6-45e4-80d8-3d7d01c2720f None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:47.612431 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-c8eebfbc-9915-49de-8de8-af9856ae2c77 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:47.613687 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-c8eebfbc-9915-49de-8de8-af9856ae2c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:47.617269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:47.650182 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25983aa-39f6-43a8-82ff-8d32c5b6dce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:47.651120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25983aa-39f6-43a8-82ff-8d32c5b6dce7 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:47.651403 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25983aa-39f6-43a8-82ff-8d32c5b6dce7 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:47.651705 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25983aa-39f6-43a8-82ff-8d32c5b6dce7 None admin] PATH_INFO: `/v3/users/68a7929c7e22436c964a38135e0a1071` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:47.671778 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25983aa-39f6-43a8-82ff-8d32c5b6dce7 None admin] RBAC: Authorizing `identity:get_user(user_id=68a7929c7e22436c964a38135e0a1071)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:47.674558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25983aa-39f6-43a8-82ff-8d32c5b6dce7 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:47.676461 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 141/286] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:47 2022] GET /identity/v3/users/68a7929c7e22436c964a38135e0a1071 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:47.682731 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25983aa-39f6-43a8-82ff-8d32c5b6dce7 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:47.703003 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 146/287] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:47.726203 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eebfbc-9915-49de-8de8-af9856ae2c77 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:47.775105 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:47.816364 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25983aa-39f6-43a8-82ff-8d32c5b6dce7 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:47.842727 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eebfbc-9915-49de-8de8-af9856ae2c77 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:47.859560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119d799-0d50-42f1-8119-681b75917862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:47.860327 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119d799-0d50-42f1-8119-681b75917862 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:47.861134 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119d799-0d50-42f1-8119-681b75917862 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:47.861519 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119d799-0d50-42f1-8119-681b75917862 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:47.862767 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119d799-0d50-42f1-8119-681b75917862 None admin] RBAC: Adding query filter params (role.id=2cb5ed3eb0484858a5f7cbdce69092ed, user.id=68a7929c7e22436c964a38135e0a1071, scope.system=all) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:47.863189 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119d799-0d50-42f1-8119-681b75917862 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:47.865184 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119d799-0d50-42f1-8119-681b75917862 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:47.871422 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 142/288] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Jul 25 08:31:47 2022] GET /identity/v3/role_assignments?user.id=68a7929c7e22436c964a38135e0a1071&scope.system=all&role.id=2cb5ed3eb0484858a5f7cbdce69092ed => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:47.885083 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ebb687-4047-40f3-a812-215620cc4c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:47.885915 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebb687-4047-40f3-a812-215620cc4c06 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:47.886199 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebb687-4047-40f3-a812-215620cc4c06 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:47.886476 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebb687-4047-40f3-a812-215620cc4c06 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:47.900152 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:47.904253 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ebb687-4047-40f3-a812-215620cc4c06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:47.914229 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-01ebb687-4047-40f3-a812-215620cc4c06 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:31:47.914229 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:47.914229 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:47.914229 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:47.914229 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:47.914229 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:47.914229 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:47.914229 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:47.914229 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:47.914229 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:47.914229 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:47.914229 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:47.914229 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:47.914229 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:47.914229 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:47.914229 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:47.915172 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:47.915172 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:47.915172 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:47.915172 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:47.915172 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:47.915172 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:47.915172 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:47.915172 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:47.915172 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:47.915172 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:47.915172 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:47.915172 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:47.915172 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:47.915172 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:47.915172 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:47.915172 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:47.915977 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:47.915977 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:47.915977 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:47.915977 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:47.915977 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:47.915977 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:47.915977 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:47.915977 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:47.915977 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:47.915977 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:47.915977 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:31:47.915977 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:31:47.917430 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 147/289] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:31:47.923385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119d799-0d50-42f1-8119-681b75917862 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:48.054172 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119d799-0d50-42f1-8119-681b75917862 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:48.086338 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:48.092577 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e67570-456b-4e7b-a3ef-29a89e42b285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:48.093499 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e67570-456b-4e7b-a3ef-29a89e42b285 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:48.094004 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e67570-456b-4e7b-a3ef-29a89e42b285 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:48.094475 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e67570-456b-4e7b-a3ef-29a89e42b285 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:48.095627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e67570-456b-4e7b-a3ef-29a89e42b285 None admin] RBAC: Adding query filter params (name=member) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:48.096230 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e67570-456b-4e7b-a3ef-29a89e42b285 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:48.097831 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e67570-456b-4e7b-a3ef-29a89e42b285 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:48.107382 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 143/290] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 08:31:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:48.113444 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ebb687-4047-40f3-a812-215620cc4c06 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:48.242915 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ebb687-4047-40f3-a812-215620cc4c06 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:48.290034 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25f991-b1ea-48be-90ae-e033d9e214ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:48.290920 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25f991-b1ea-48be-90ae-e033d9e214ea None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:48.291202 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25f991-b1ea-48be-90ae-e033d9e214ea None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:48.291478 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25f991-b1ea-48be-90ae-e033d9e214ea None admin] PATH_INFO: `/v3/users/f43c5b813d5d4ecb9a368bd5c793f5dc` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:48.294055 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25f991-b1ea-48be-90ae-e033d9e214ea None admin] RBAC: Authorizing `identity:get_user(user_id=f43c5b813d5d4ecb9a368bd5c793f5dc)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:48.295511 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25f991-b1ea-48be-90ae-e033d9e214ea None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:48.297503 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 148/291] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:48 2022] GET /identity/v3/users/f43c5b813d5d4ecb9a368bd5c793f5dc => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:48.303975 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e67570-456b-4e7b-a3ef-29a89e42b285 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:48.457854 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e67570-456b-4e7b-a3ef-29a89e42b285 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:48.500571 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e12a1-3e07-4219-857d-00e64609fa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:48.502522 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e12a1-3e07-4219-857d-00e64609fa23 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:48.502999 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e12a1-3e07-4219-857d-00e64609fa23 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:48.503490 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e12a1-3e07-4219-857d-00e64609fa23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:48.590088 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:48.602798 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e12a1-3e07-4219-857d-00e64609fa23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:48.604530 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e12a1-3e07-4219-857d-00e64609fa23 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:48.738755 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 144/292] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:31:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:31:48.748797 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25f991-b1ea-48be-90ae-e033d9e214ea None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:48.839147 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:48.891276 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25f991-b1ea-48be-90ae-e033d9e214ea None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:48.935152 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b1a8d-8001-4825-ad5a-b78e9839afcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:48.936055 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b1a8d-8001-4825-ad5a-b78e9839afcd None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:48.936343 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b1a8d-8001-4825-ad5a-b78e9839afcd None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:48.936624 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b1a8d-8001-4825-ad5a-b78e9839afcd None admin] PATH_INFO: `/v3/projects/a941dd7311514444b64e1778320ae963` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:48.937844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b1a8d-8001-4825-ad5a-b78e9839afcd None admin] RBAC: Authorizing `identity:get_project(project_id=a941dd7311514444b64e1778320ae963)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:48.939949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b1a8d-8001-4825-ad5a-b78e9839afcd None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:48.941671 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 149/293] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:48 2022] GET /identity/v3/projects/a941dd7311514444b64e1778320ae963 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:48.948680 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e12a1-3e07-4219-857d-00e64609fa23 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:49.073924 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:49.087443 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e12a1-3e07-4219-857d-00e64609fa23 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:49.137357 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31144239-b636-473f-a564-ad8435308e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:49.138025 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31144239-b636-473f-a564-ad8435308e93 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:49.138314 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31144239-b636-473f-a564-ad8435308e93 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:49.138592 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31144239-b636-473f-a564-ad8435308e93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:49.139448 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31144239-b636-473f-a564-ad8435308e93 None admin] RBAC: Adding query filter params (role.id=2cb5ed3eb0484858a5f7cbdce69092ed, scope.project.id=a941dd7311514444b64e1778320ae963, user.id=f43c5b813d5d4ecb9a368bd5c793f5dc) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:49.139799 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31144239-b636-473f-a564-ad8435308e93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:49.141241 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31144239-b636-473f-a564-ad8435308e93 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:49.152152 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 145/294] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:31:48 2022] GET /identity/v3/role_assignments?user.id=f43c5b813d5d4ecb9a368bd5c793f5dc&scope.project.id=a941dd7311514444b64e1778320ae963&role.id=2cb5ed3eb0484858a5f7cbdce69092ed => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:49.844011 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abadc66-9978-4925-9b32-764f7f672d47 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:49.844513 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abadc66-9978-4925-9b32-764f7f672d47 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:49.844612 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abadc66-9978-4925-9b32-764f7f672d47 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:49.846993 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 150/295] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:49.852387 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cf541-d458-40d0-966a-a3514bc5c76e None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:49.852808 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cf541-d458-40d0-966a-a3514bc5c76e None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:49.852980 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cf541-d458-40d0-966a-a3514bc5c76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:49.874359 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-677cf541-d458-40d0-966a-a3514bc5c76e None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:49.875564 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-677cf541-d458-40d0-966a-a3514bc5c76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:49.946962 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 146/296] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:49.969044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abadc66-9978-4925-9b32-764f7f672d47 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:50.075556 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abadc66-9978-4925-9b32-764f7f672d47 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:50.111223 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422487db-b5ae-4e68-9762-de33ba0eb5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:50.112299 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422487db-b5ae-4e68-9762-de33ba0eb5c5 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:50.112586 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422487db-b5ae-4e68-9762-de33ba0eb5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:50.112861 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422487db-b5ae-4e68-9762-de33ba0eb5c5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:50.115921 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:50.125193 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422487db-b5ae-4e68-9762-de33ba0eb5c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:50.133737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-422487db-b5ae-4e68-9762-de33ba0eb5c5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:31:50.133737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:50.133737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:50.133737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:50.133737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:50.133737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:50.133737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:50.133737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:50.133737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:50.133737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:50.133737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:50.133737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:50.133737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:50.133737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:50.133737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:50.133737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:50.136471 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:50.136471 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:50.136471 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:50.136471 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:50.136471 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:50.136471 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:50.136471 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:50.136471 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:50.136471 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:50.136471 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:50.136471 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:50.136471 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:50.136471 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:50.136471 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:50.136471 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:50.136471 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:50.137266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:50.137266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:50.137266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:50.137266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:50.137266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:50.137266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:50.137266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:50.137266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:50.137266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:50.137266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:50.137266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:31:50.137266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:31:50.137266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 151/297] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:50.145013 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677cf541-d458-40d0-966a-a3514bc5c76e None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:50.176943 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd148f-f59e-4a7a-9906-14c6df6f9cdd None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:50.177455 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd148f-f59e-4a7a-9906-14c6df6f9cdd None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:50.177902 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd148f-f59e-4a7a-9906-14c6df6f9cdd None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:50.179413 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 152/298] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:31:50.184766 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878952e6-bdad-42ab-a36f-93b31365eb92 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:50.185249 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878952e6-bdad-42ab-a36f-93b31365eb92 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:50.185724 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878952e6-bdad-42ab-a36f-93b31365eb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:50.205743 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-878952e6-bdad-42ab-a36f-93b31365eb92 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:50.207243 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-878952e6-bdad-42ab-a36f-93b31365eb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:50.244199 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:50.254718 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677cf541-d458-40d0-966a-a3514bc5c76e None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:50.288002 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 153/299] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:50.290911 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a7639-3173-4bcd-a76a-36e7e02a0d93 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:50.291209 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a7639-3173-4bcd-a76a-36e7e02a0d93 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:50.291493 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a7639-3173-4bcd-a76a-36e7e02a0d93 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:50.292870 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 154/300] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:31:50.298718 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06247f9-8815-4186-84da-260af062fbf9 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:50.299236 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06247f9-8815-4186-84da-260af062fbf9 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:50.299875 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06247f9-8815-4186-84da-260af062fbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:50.300179 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734a4ac-0fbc-4e79-827e-2d0a802218e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:50.300912 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734a4ac-0fbc-4e79-827e-2d0a802218e3 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:50.301201 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734a4ac-0fbc-4e79-827e-2d0a802218e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:50.301479 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734a4ac-0fbc-4e79-827e-2d0a802218e3 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:50.302243 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734a4ac-0fbc-4e79-827e-2d0a802218e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:50.302551 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734a4ac-0fbc-4e79-827e-2d0a802218e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:50.304042 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734a4ac-0fbc-4e79-827e-2d0a802218e3 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:50.312855 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 147/301] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 08:31:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:50.314742 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121f037-a4cb-43a1-8433-4c8f45f02611 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:50.315032 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121f037-a4cb-43a1-8433-4c8f45f02611 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:50.315307 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121f037-a4cb-43a1-8433-4c8f45f02611 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:50.316557 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 148/302] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:50.317433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121f037-a4cb-43a1-8433-4c8f45f02611 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:50.321068 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-b06247f9-8815-4186-84da-260af062fbf9 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:50.322573 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-b06247f9-8815-4186-84da-260af062fbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:50.387956 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 155/303] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:31:50.392368 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06247f9-8815-4186-84da-260af062fbf9 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:50.417691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121f037-a4cb-43a1-8433-4c8f45f02611 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:50.444263 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:50.451080 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376c12f-9782-40fd-9297-40fb3893ccc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:50.455327 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376c12f-9782-40fd-9297-40fb3893ccc9 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:50.455327 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376c12f-9782-40fd-9297-40fb3893ccc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:50.455327 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376c12f-9782-40fd-9297-40fb3893ccc9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:50.462206 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376c12f-9782-40fd-9297-40fb3893ccc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:50.470415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-3376c12f-9782-40fd-9297-40fb3893ccc9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:31:50.470415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:50.470415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:50.470415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:50.470415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:50.470415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:50.470415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:50.470415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:50.470415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:50.470415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:50.470415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:50.470415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:50.470415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:50.470415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:50.470415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:50.470415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:50.471509 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:50.471509 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:50.471509 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:50.471509 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:50.471509 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:50.471509 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:50.471509 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:50.471509 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:50.471509 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:50.471509 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:50.471509 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:50.471509 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:50.471509 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:50.471509 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:50.471509 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:50.471509 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:50.477273 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:50.477273 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:50.477273 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:50.477273 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:50.477273 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:50.477273 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:50.477273 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:50.477273 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:50.477273 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:50.477273 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:50.477273 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:31:50.477273 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:31:50.477273 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 149/304] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:50.477273 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f247570-ce06-41ad-8128-72b4453401d2 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:50.478055 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f247570-ce06-41ad-8128-72b4453401d2 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:50.478055 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f247570-ce06-41ad-8128-72b4453401d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:50.488553 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06247f9-8815-4186-84da-260af062fbf9 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:50.492573 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-3f247570-ce06-41ad-8128-72b4453401d2 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:50.493756 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-3f247570-ce06-41ad-8128-72b4453401d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:50.495928 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:50.523477 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f8b8d-7920-4c94-993b-39fdca2d79b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:50.524690 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f8b8d-7920-4c94-993b-39fdca2d79b0 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:50.524970 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f8b8d-7920-4c94-993b-39fdca2d79b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:50.525239 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f8b8d-7920-4c94-993b-39fdca2d79b0 None admin] PATH_INFO: `/v3/users/e02c40cf28cd4d709b999ceb860dfdfa` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:50.526415 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f8b8d-7920-4c94-993b-39fdca2d79b0 None admin] RBAC: Authorizing `identity:get_user(user_id=e02c40cf28cd4d709b999ceb860dfdfa)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:50.527871 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f8b8d-7920-4c94-993b-39fdca2d79b0 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:50.529479 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 156/305] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:50 2022] GET /identity/v3/users/e02c40cf28cd4d709b999ceb860dfdfa => generated 297 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:50.530233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f8b8d-7920-4c94-993b-39fdca2d79b0 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:50.562011 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 150/306] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:50.562853 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f247570-ce06-41ad-8128-72b4453401d2 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:50.668468 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f8b8d-7920-4c94-993b-39fdca2d79b0 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:50.691317 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:50.703025 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfba116-a5c8-42e0-9a57-f8cb5f30afc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:50.703859 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfba116-a5c8-42e0-9a57-f8cb5f30afc7 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:50.704145 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfba116-a5c8-42e0-9a57-f8cb5f30afc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:50.704960 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f247570-ce06-41ad-8128-72b4453401d2 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:50.705078 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfba116-a5c8-42e0-9a57-f8cb5f30afc7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:50.716301 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfba116-a5c8-42e0-9a57-f8cb5f30afc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:50.724106 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-fdfba116-a5c8-42e0-9a57-f8cb5f30afc7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:31:50.724106 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:50.724106 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:50.724106 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:50.724106 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:50.724106 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:50.724106 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:50.724106 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:50.724106 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:50.724106 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:50.724106 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:50.724106 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:50.724106 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:50.724106 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:50.724106 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:50.724106 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:50.725094 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:50.725094 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:50.725094 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:50.725094 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:50.725094 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:50.725094 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:50.725094 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:50.725094 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:50.725094 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:50.725094 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:50.725094 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:50.725094 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:50.725094 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:50.725094 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:50.725094 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:50.725094 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:50.726098 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:50.726098 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:50.726098 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:50.726098 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:50.726098 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:50.726098 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:50.726098 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:50.726098 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:50.726098 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:50.726098 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:50.726098 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:31:50.726098 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:31:50.726098 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 157/307] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:50.726098 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfba116-a5c8-42e0-9a57-f8cb5f30afc7 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:50.740547 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e49fa-a495-40c7-8f5b-9404d55f6161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:50.741217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e49fa-a495-40c7-8f5b-9404d55f6161 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:50.741507 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e49fa-a495-40c7-8f5b-9404d55f6161 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:50.741784 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e49fa-a495-40c7-8f5b-9404d55f6161 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:50.742540 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e49fa-a495-40c7-8f5b-9404d55f6161 None admin] RBAC: Adding query filter params (name=member) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:50.742854 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e49fa-a495-40c7-8f5b-9404d55f6161 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:50.744266 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e49fa-a495-40c7-8f5b-9404d55f6161 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:50.749309 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:50.753803 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 151/308] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 08:31:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:50.754579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e49fa-a495-40c7-8f5b-9404d55f6161 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:50.829254 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfba116-a5c8-42e0-9a57-f8cb5f30afc7 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:50.853875 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e49fa-a495-40c7-8f5b-9404d55f6161 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:50.862441 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68074c-6633-42a4-a6a1-296c9cdcc8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:50.863180 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68074c-6633-42a4-a6a1-296c9cdcc8d5 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:50.863483 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68074c-6633-42a4-a6a1-296c9cdcc8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:50.863792 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68074c-6633-42a4-a6a1-296c9cdcc8d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:50.889493 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e222b84-b119-469e-81e1-18bb7ef98058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:50.890281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e222b84-b119-469e-81e1-18bb7ef98058 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:50.890571 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e222b84-b119-469e-81e1-18bb7ef98058 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:50.890869 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e222b84-b119-469e-81e1-18bb7ef98058 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:50.892085 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e222b84-b119-469e-81e1-18bb7ef98058 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:50.893517 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e222b84-b119-469e-81e1-18bb7ef98058 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:50.895300 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 152/309] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:50.896003 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e222b84-b119-469e-81e1-18bb7ef98058 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:50.917278 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:50.932691 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68074c-6633-42a4-a6a1-296c9cdcc8d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:50.934166 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68074c-6633-42a4-a6a1-296c9cdcc8d5 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:50.960589 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:50.993663 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e222b84-b119-469e-81e1-18bb7ef98058 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:51.027686 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea4c8c-c39d-49c0-a203-6d68bfd18ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:51.028314 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea4c8c-c39d-49c0-a203-6d68bfd18ce3 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:51.028599 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea4c8c-c39d-49c0-a203-6d68bfd18ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:51.028875 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea4c8c-c39d-49c0-a203-6d68bfd18ce3 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:51.029617 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea4c8c-c39d-49c0-a203-6d68bfd18ce3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:51.029924 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea4c8c-c39d-49c0-a203-6d68bfd18ce3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:51.030789 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 158/310] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:31:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:31:51.031287 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea4c8c-c39d-49c0-a203-6d68bfd18ce3 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:51.031647 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68074c-6633-42a4-a6a1-296c9cdcc8d5 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:51.043252 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 153/311] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 08:31:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:51.044430 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea4c8c-c39d-49c0-a203-6d68bfd18ce3 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:51.118794 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:51.134314 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68074c-6633-42a4-a6a1-296c9cdcc8d5 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:51.144309 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea4c8c-c39d-49c0-a203-6d68bfd18ce3 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:51.167443 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb88e8-7a57-44eb-957b-08eb3a852758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:51.168340 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb88e8-7a57-44eb-957b-08eb3a852758 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:51.168628 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb88e8-7a57-44eb-957b-08eb3a852758 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:51.168906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb88e8-7a57-44eb-957b-08eb3a852758 None admin] PATH_INFO: `/v3/users/68a7929c7e22436c964a38135e0a1071` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:51.170097 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb88e8-7a57-44eb-957b-08eb3a852758 None admin] RBAC: Authorizing `identity:get_user(user_id=68a7929c7e22436c964a38135e0a1071)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:51.171554 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb88e8-7a57-44eb-957b-08eb3a852758 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:51.171723 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:51.173829 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 159/312] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:51 2022] GET /identity/v3/users/68a7929c7e22436c964a38135e0a1071 => generated 293 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:51.174588 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb88e8-7a57-44eb-957b-08eb3a852758 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:51.181258 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26112d30-89d7-40ab-8063-275a2a889a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:51.182097 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26112d30-89d7-40ab-8063-275a2a889a7d None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:51.182378 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26112d30-89d7-40ab-8063-275a2a889a7d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:51.183643 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26112d30-89d7-40ab-8063-275a2a889a7d None admin] PATH_INFO: `/v3/groups` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:51.183643 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26112d30-89d7-40ab-8063-275a2a889a7d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:51.184912 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26112d30-89d7-40ab-8063-275a2a889a7d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:51.251891 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 154/313] 10.222.0.18 () {60 vars in 1134 bytes} [Mon Jul 25 08:31:51 2022] POST /identity/v3/groups => generated 229 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:31:51.253028 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26112d30-89d7-40ab-8063-275a2a889a7d None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:51.278356 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb88e8-7a57-44eb-957b-08eb3a852758 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:51.318629 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad80838-87ef-4e69-b788-b3cccac365c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:51.319576 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad80838-87ef-4e69-b788-b3cccac365c1 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:51.319945 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad80838-87ef-4e69-b788-b3cccac365c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:51.320228 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad80838-87ef-4e69-b788-b3cccac365c1 None admin] PATH_INFO: `/v3/projects/a941dd7311514444b64e1778320ae963` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:51.321712 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad80838-87ef-4e69-b788-b3cccac365c1 None admin] RBAC: Authorizing `identity:get_project(project_id=a941dd7311514444b64e1778320ae963)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:51.323247 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad80838-87ef-4e69-b788-b3cccac365c1 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:51.331058 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 160/314] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:51 2022] GET /identity/v3/projects/a941dd7311514444b64e1778320ae963 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:51.331058 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad80838-87ef-4e69-b788-b3cccac365c1 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:51.356097 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:51.369378 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26112d30-89d7-40ab-8063-275a2a889a7d None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:51.407822 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244519cf-6524-4b2f-affe-cf7eb23c0244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:51.408849 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244519cf-6524-4b2f-affe-cf7eb23c0244 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:51.409138 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244519cf-6524-4b2f-affe-cf7eb23c0244 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:51.409418 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244519cf-6524-4b2f-affe-cf7eb23c0244 None admin] PATH_INFO: `/v3/users/85615772b3b84f219812bcf366b4a646` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:51.424557 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244519cf-6524-4b2f-affe-cf7eb23c0244 None admin] RBAC: Authorizing `identity:get_user(user_id=85615772b3b84f219812bcf366b4a646)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:51.426234 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244519cf-6524-4b2f-affe-cf7eb23c0244 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:51.432608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 155/315] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:51 2022] GET /identity/v3/users/85615772b3b84f219812bcf366b4a646 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:51.432608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244519cf-6524-4b2f-affe-cf7eb23c0244 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:51.448626 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad80838-87ef-4e69-b788-b3cccac365c1 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:51.484675 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:51.486030 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a672c45-7897-4690-96d2-e686301fdf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:51.486961 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a672c45-7897-4690-96d2-e686301fdf00 None admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:51.487243 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a672c45-7897-4690-96d2-e686301fdf00 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:51.487523 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a672c45-7897-4690-96d2-e686301fdf00 None admin] PATH_INFO: `/v3/system/users/68a7929c7e22436c964a38135e0a1071/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:51.489502 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a672c45-7897-4690-96d2-e686301fdf00 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=68a7929c7e22436c964a38135e0a1071, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:51.491323 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a672c45-7897-4690-96d2-e686301fdf00 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:51.535273 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244519cf-6524-4b2f-affe-cf7eb23c0244 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:51.569554 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6f8a8-5389-4d00-bb1a-4593cff0d5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:51.570209 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6f8a8-5389-4d00-bb1a-4593cff0d5d4 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:51.570493 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6f8a8-5389-4d00-bb1a-4593cff0d5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:51.570767 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6f8a8-5389-4d00-bb1a-4593cff0d5d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:51.571694 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d6f8a8-5389-4d00-bb1a-4593cff0d5d4 None admin] RBAC: Adding query filter params (role.id=0263e334bab74e7cb5d062a03089b3f7, scope.project.id=a941dd7311514444b64e1778320ae963, user.id=e02c40cf28cd4d709b999ceb860dfdfa) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:51.572007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d6f8a8-5389-4d00-bb1a-4593cff0d5d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:51.573430 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d6f8a8-5389-4d00-bb1a-4593cff0d5d4 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:51.579156 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 156/316] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:31:51 2022] GET /identity/v3/role_assignments?user.id=e02c40cf28cd4d709b999ceb860dfdfa&scope.project.id=a941dd7311514444b64e1778320ae963&role.id=0263e334bab74e7cb5d062a03089b3f7 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:51.580521 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6f8a8-5389-4d00-bb1a-4593cff0d5d4 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:51.627650 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 161/317] 10.222.0.18 () {58 vars in 1334 bytes} [Mon Jul 25 08:31:51 2022] PUT /identity/v3/system/users/68a7929c7e22436c964a38135e0a1071/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:31:51.730962 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6f8a8-5389-4d00-bb1a-4593cff0d5d4 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:51.749388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:51.775115 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a095f-41ca-44c3-bb6a-c46f2c6b77c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:51.776202 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a095f-41ca-44c3-bb6a-c46f2c6b77c5 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:51.776744 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a095f-41ca-44c3-bb6a-c46f2c6b77c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:51.777226 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a095f-41ca-44c3-bb6a-c46f2c6b77c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:51.778306 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a095f-41ca-44c3-bb6a-c46f2c6b77c5 None admin] RBAC: Adding query filter params (role.id=0263e334bab74e7cb5d062a03089b3f7, user.id=85615772b3b84f219812bcf366b4a646, scope.system=all) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:51.778823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a095f-41ca-44c3-bb6a-c46f2c6b77c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:51.780593 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a095f-41ca-44c3-bb6a-c46f2c6b77c5 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:51.787731 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 157/318] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Jul 25 08:31:51 2022] GET /identity/v3/role_assignments?user.id=85615772b3b84f219812bcf366b4a646&scope.system=all&role.id=0263e334bab74e7cb5d062a03089b3f7 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:53.328312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d495a-90db-4da7-9134-8280738002f1 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:53.328827 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d495a-90db-4da7-9134-8280738002f1 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:53.328902 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d495a-90db-4da7-9134-8280738002f1 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:53.330997 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 162/319] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:53.335975 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be51b22-5a63-4768-a4a3-f66d24ef7656 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:53.336358 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be51b22-5a63-4768-a4a3-f66d24ef7656 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:53.336533 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be51b22-5a63-4768-a4a3-f66d24ef7656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:53.354866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-9be51b22-5a63-4768-a4a3-f66d24ef7656 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:53.356104 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9be51b22-5a63-4768-a4a3-f66d24ef7656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:53.423338 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 158/320] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:53.445695 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d495a-90db-4da7-9134-8280738002f1 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:53.532327 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:53.549863 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d495a-90db-4da7-9134-8280738002f1 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:53.585682 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd9206-3831-429d-8478-bf6d15e05b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:53.586408 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd9206-3831-429d-8478-bf6d15e05b0b None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:53.586691 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd9206-3831-429d-8478-bf6d15e05b0b None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:53.586965 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd9206-3831-429d-8478-bf6d15e05b0b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:53.588257 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd9206-3831-429d-8478-bf6d15e05b0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:53.589709 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd9206-3831-429d-8478-bf6d15e05b0b None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:53.591526 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 163/321] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:31:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:53.597283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be51b22-5a63-4768-a4a3-f66d24ef7656 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:53.675571 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eec5f0-9a1f-43ea-8600-97376a3364b1 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:53.675923 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eec5f0-9a1f-43ea-8600-97376a3364b1 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:53.676165 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eec5f0-9a1f-43ea-8600-97376a3364b1 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:53.677677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 164/322] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:31:53.682280 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f16ef-117c-4b9b-a929-ea50cd716622 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:53.682571 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f16ef-117c-4b9b-a929-ea50cd716622 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:53.682847 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f16ef-117c-4b9b-a929-ea50cd716622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:53.703716 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-3c6f16ef-117c-4b9b-a929-ea50cd716622 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:53.705669 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-3c6f16ef-117c-4b9b-a929-ea50cd716622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:53.706237 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be51b22-5a63-4768-a4a3-f66d24ef7656 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:53.718815 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:53.746641 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f0e1d-3a10-459e-bf14-463c5efbd177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:53.747316 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f0e1d-3a10-459e-bf14-463c5efbd177 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:53.747601 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f0e1d-3a10-459e-bf14-463c5efbd177 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:53.747908 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f0e1d-3a10-459e-bf14-463c5efbd177 None admin] PATH_INFO: `/v3/groups` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:53.748608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f0e1d-3a10-459e-bf14-463c5efbd177 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:53.750056 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f0e1d-3a10-459e-bf14-463c5efbd177 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:53.774850 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 165/323] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:31:53.776204 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1c1ca-338d-4ed1-9de1-cfe188b480aa None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:53.776492 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1c1ca-338d-4ed1-9de1-cfe188b480aa None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:53.776765 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1c1ca-338d-4ed1-9de1-cfe188b480aa None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:53.778017 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 166/324] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:53.783020 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b355c-0f67-4dbe-b13b-dda9a364d3b2 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:53.783313 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b355c-0f67-4dbe-b13b-dda9a364d3b2 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:53.783741 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b355c-0f67-4dbe-b13b-dda9a364d3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:53.802511 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-9c7b355c-0f67-4dbe-b13b-dda9a364d3b2 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:53.803720 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-9c7b355c-0f67-4dbe-b13b-dda9a364d3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:53.859751 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 159/325] 10.222.0.18 () {60 vars in 1134 bytes} [Mon Jul 25 08:31:53 2022] POST /identity/v3/groups => generated 226 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:31:53.859751 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f0e1d-3a10-459e-bf14-463c5efbd177 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:53.881917 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 167/326] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:31:53.904408 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b355c-0f67-4dbe-b13b-dda9a364d3b2 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:53.919582 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:53.971723 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f0e1d-3a10-459e-bf14-463c5efbd177 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:54.009320 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171e0ec-b212-4fe5-8d93-c9492916831b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:54.010121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171e0ec-b212-4fe5-8d93-c9492916831b None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:54.010417 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171e0ec-b212-4fe5-8d93-c9492916831b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:54.010688 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171e0ec-b212-4fe5-8d93-c9492916831b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:54.020713 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b355c-0f67-4dbe-b13b-dda9a364d3b2 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:54.022506 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8171e0ec-b212-4fe5-8d93-c9492916831b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:54.030597 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-8171e0ec-b212-4fe5-8d93-c9492916831b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:31:54.030597 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:54.030597 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:54.030597 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:54.030597 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:54.030597 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:54.030597 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:54.030597 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:54.030597 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:54.030597 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:54.030597 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:54.030597 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:54.030597 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:54.030597 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:54.030597 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:54.030597 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:54.032631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:54.032631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:54.032631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:54.032631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:54.032631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:54.032631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:54.032631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:54.032631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:54.032631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:54.032631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:54.032631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:54.032631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:54.032631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:54.032631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:54.032631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:54.032631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:54.033436 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:54.033436 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:54.033436 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:54.033436 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:54.033436 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:54.033436 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:54.033436 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:54.033436 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:54.033436 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:54.033436 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:54.033436 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:31:54.033436 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:31:54.034040 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 160/327] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:54.040533 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171e0ec-b212-4fe5-8d93-c9492916831b None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:54.063042 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4c1c5-9189-44ba-b2bd-a2e22adc27aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:54.064170 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4c1c5-9189-44ba-b2bd-a2e22adc27aa None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:54.064621 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4c1c5-9189-44ba-b2bd-a2e22adc27aa None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:54.064908 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4c1c5-9189-44ba-b2bd-a2e22adc27aa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:54.075282 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4c1c5-9189-44ba-b2bd-a2e22adc27aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:54.078993 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:54.085184 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-8ba4c1c5-9189-44ba-b2bd-a2e22adc27aa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:31:54.085184 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:54.085184 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:54.085184 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:54.085184 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:54.085184 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:54.085184 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:54.085184 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:54.085184 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:54.085184 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:54.085184 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:54.085184 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:54.085184 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:54.085184 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:54.085184 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:54.085184 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:54.086105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:54.086105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:54.086105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:54.086105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:54.086105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:54.086105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:54.086105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:54.086105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:54.086105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:54.086105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:54.086105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:54.086105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:54.086105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:54.086105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:54.086105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:54.086105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:54.086939 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:54.086939 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:54.086939 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:54.086939 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:54.086939 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:54.086939 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:54.086939 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:54.086939 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:54.086939 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:54.086939 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:54.086939 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:31:54.086939 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:31:54.086939 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 168/328] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:31:54.091988 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4c1c5-9189-44ba-b2bd-a2e22adc27aa None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:54.178852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171e0ec-b212-4fe5-8d93-c9492916831b None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:54.192585 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:54.218748 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90394d06-fc20-4029-91c7-339c95044c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:54.219690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90394d06-fc20-4029-91c7-339c95044c6f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:54.220707 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90394d06-fc20-4029-91c7-339c95044c6f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:54.221133 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90394d06-fc20-4029-91c7-339c95044c6f None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:54.222044 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90394d06-fc20-4029-91c7-339c95044c6f None admin] RBAC: Adding query filter params (name=member) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:54.222501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90394d06-fc20-4029-91c7-339c95044c6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:54.224069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90394d06-fc20-4029-91c7-339c95044c6f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:54.228090 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4c1c5-9189-44ba-b2bd-a2e22adc27aa None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:54.234644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 161/329] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 08:31:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:54.240605 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90394d06-fc20-4029-91c7-339c95044c6f None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:54.275352 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525eef3-107f-4812-aac4-7938fba16543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:54.279097 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525eef3-107f-4812-aac4-7938fba16543 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:54.279097 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525eef3-107f-4812-aac4-7938fba16543 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:54.279097 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525eef3-107f-4812-aac4-7938fba16543 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:54.279097 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525eef3-107f-4812-aac4-7938fba16543 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:54.279097 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525eef3-107f-4812-aac4-7938fba16543 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:54.280056 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525eef3-107f-4812-aac4-7938fba16543 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:54.299894 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 169/330] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 08:31:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:54.305920 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525eef3-107f-4812-aac4-7938fba16543 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:54.363627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:54.380908 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90394d06-fc20-4029-91c7-339c95044c6f None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:54.420469 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525eef3-107f-4812-aac4-7938fba16543 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:54.427818 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d936bb-6c04-4fb0-aa6c-c146f0b72177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:54.429387 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d936bb-6c04-4fb0-aa6c-c146f0b72177 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:54.429839 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d936bb-6c04-4fb0-aa6c-c146f0b72177 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:54.430268 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d936bb-6c04-4fb0-aa6c-c146f0b72177 None admin] PATH_INFO: `/v3/users/68a7929c7e22436c964a38135e0a1071` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:54.432099 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d936bb-6c04-4fb0-aa6c-c146f0b72177 None admin] RBAC: Authorizing `identity:get_user(user_id=68a7929c7e22436c964a38135e0a1071)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:54.434338 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d936bb-6c04-4fb0-aa6c-c146f0b72177 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:54.437046 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 162/331] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:54 2022] GET /identity/v3/users/68a7929c7e22436c964a38135e0a1071 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:54.443504 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d936bb-6c04-4fb0-aa6c-c146f0b72177 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:54.465507 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e4d4d-ad61-4d51-bc0c-f5e04655ec7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:54.466558 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e4d4d-ad61-4d51-bc0c-f5e04655ec7f None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:54.466945 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e4d4d-ad61-4d51-bc0c-f5e04655ec7f None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:54.467324 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e4d4d-ad61-4d51-bc0c-f5e04655ec7f None admin] PATH_INFO: `/v3/users/85615772b3b84f219812bcf366b4a646` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:54.469217 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e4d4d-ad61-4d51-bc0c-f5e04655ec7f None admin] RBAC: Authorizing `identity:get_user(user_id=85615772b3b84f219812bcf366b4a646)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:54.471495 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e4d4d-ad61-4d51-bc0c-f5e04655ec7f None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:54.473314 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 170/332] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:54 2022] GET /identity/v3/users/85615772b3b84f219812bcf366b4a646 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:54.478983 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e4d4d-ad61-4d51-bc0c-f5e04655ec7f None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:54.483891 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:54.587919 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d936bb-6c04-4fb0-aa6c-c146f0b72177 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:54.601848 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e4d4d-ad61-4d51-bc0c-f5e04655ec7f None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:54.648174 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4d67b-be7e-41ed-94b5-5fe4ec60aadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:54.649526 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4d67b-be7e-41ed-94b5-5fe4ec60aadc None admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:54.650052 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4d67b-be7e-41ed-94b5-5fe4ec60aadc None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:54.650475 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4d67b-be7e-41ed-94b5-5fe4ec60aadc None admin] PATH_INFO: `/v3/system/users/85615772b3b84f219812bcf366b4a646/roles/0263e334bab74e7cb5d062a03089b3f7` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:54.652212 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4d67b-be7e-41ed-94b5-5fe4ec60aadc None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=85615772b3b84f219812bcf366b4a646, role_id=0263e334bab74e7cb5d062a03089b3f7)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:54.653752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4d67b-be7e-41ed-94b5-5fe4ec60aadc None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:54.653885 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497884b0-8e30-497e-82a6-07c354077047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:54.654645 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497884b0-8e30-497e-82a6-07c354077047 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:54.655070 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497884b0-8e30-497e-82a6-07c354077047 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:54.655448 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497884b0-8e30-497e-82a6-07c354077047 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:54.656505 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497884b0-8e30-497e-82a6-07c354077047 None admin] RBAC: Adding query filter params (role.id=2cb5ed3eb0484858a5f7cbdce69092ed, user.id=68a7929c7e22436c964a38135e0a1071, scope.system=all) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:54.656942 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497884b0-8e30-497e-82a6-07c354077047 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:54.659195 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497884b0-8e30-497e-82a6-07c354077047 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:54.676083 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 163/333] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Jul 25 08:31:54 2022] GET /identity/v3/role_assignments?user.id=68a7929c7e22436c964a38135e0a1071&scope.system=all&role.id=2cb5ed3eb0484858a5f7cbdce69092ed => generated 510 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:31:54.760999 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 171/334] 10.222.0.18 () {58 vars in 1334 bytes} [Mon Jul 25 08:31:54 2022] PUT /identity/v3/system/users/85615772b3b84f219812bcf366b4a646/roles/0263e334bab74e7cb5d062a03089b3f7 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:31:56.440321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51743696-ca80-46d9-b463-e06f8a471da5 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:56.442784 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51743696-ca80-46d9-b463-e06f8a471da5 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:56.442784 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51743696-ca80-46d9-b463-e06f8a471da5 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:56.442784 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 164/335] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:56.449026 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe5264-6703-4f2e-a18b-c125a717b554 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:56.449464 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe5264-6703-4f2e-a18b-c125a717b554 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:56.449649 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe5264-6703-4f2e-a18b-c125a717b554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:56.480664 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-3ffe5264-6703-4f2e-a18b-c125a717b554 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:56.481873 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-3ffe5264-6703-4f2e-a18b-c125a717b554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:56.549739 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:56.558375 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 172/336] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:31:56.582745 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51743696-ca80-46d9-b463-e06f8a471da5 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:56.614585 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:56.642581 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19621f-fb34-4e1d-8385-4f3dfc6e0ef9 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:56.643595 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19621f-fb34-4e1d-8385-4f3dfc6e0ef9 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:56.644208 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19621f-fb34-4e1d-8385-4f3dfc6e0ef9 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:56.646473 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 173/337] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:56.653031 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e65ff-17be-4213-aa58-6c80bd8d641c None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:56.653604 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e65ff-17be-4213-aa58-6c80bd8d641c None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:56.654123 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e65ff-17be-4213-aa58-6c80bd8d641c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:56.675178 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-8a1e65ff-17be-4213-aa58-6c80bd8d641c None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:56.676827 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-8a1e65ff-17be-4213-aa58-6c80bd8d641c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:56.770583 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51743696-ca80-46d9-b463-e06f8a471da5 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:56.792863 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 174/338] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:31:56.821236 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9358a15-bed0-427b-b06c-a64a995f23bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:56.822062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9358a15-bed0-427b-b06c-a64a995f23bb None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:56.822350 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9358a15-bed0-427b-b06c-a64a995f23bb None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:56.822632 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9358a15-bed0-427b-b06c-a64a995f23bb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:56.833240 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e65ff-17be-4213-aa58-6c80bd8d641c None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:56.841812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9358a15-bed0-427b-b06c-a64a995f23bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:56.850872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-d9358a15-bed0-427b-b06c-a64a995f23bb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:31:56.850872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:56.850872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:56.850872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:56.850872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:56.850872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:56.850872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:56.850872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:56.850872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:56.850872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:56.850872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:56.850872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:56.850872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:56.850872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:56.850872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:56.850872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:56.851803 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:56.851803 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:56.851803 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:56.851803 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:56.851803 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:56.851803 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:56.851803 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:56.851803 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:56.851803 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:56.851803 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:56.851803 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:56.851803 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:56.851803 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:56.851803 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:56.851803 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:56.851803 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:56.852586 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:56.852586 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:56.852586 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:56.852586 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:56.852586 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:56.852586 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:56.852586 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:56.852586 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:56.852586 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:56.852586 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:56.852586 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:31:56.852586 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:31:56.854591 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 165/339] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 08:31:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:56.861218 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9358a15-bed0-427b-b06c-a64a995f23bb None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:56.993661 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:57.029934 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9358a15-bed0-427b-b06c-a64a995f23bb None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:57.064469 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e65ff-17be-4213-aa58-6c80bd8d641c None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:57.098450 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0cdf4-a1b1-4b7f-9b57-e16b376bb035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:57.099196 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0cdf4-a1b1-4b7f-9b57-e16b376bb035 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:57.099487 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0cdf4-a1b1-4b7f-9b57-e16b376bb035 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:57.099793 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0cdf4-a1b1-4b7f-9b57-e16b376bb035 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:57.100561 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0cdf4-a1b1-4b7f-9b57-e16b376bb035 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:57.100871 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0cdf4-a1b1-4b7f-9b57-e16b376bb035 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:57.102254 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0cdf4-a1b1-4b7f-9b57-e16b376bb035 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:57.113265 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 166/340] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:31:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:57.114311 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:57.120138 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0cdf4-a1b1-4b7f-9b57-e16b376bb035 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:57.134088 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016fa4e-e05d-4b68-bdd3-4f3a164b1c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:57.134901 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016fa4e-e05d-4b68-bdd3-4f3a164b1c6f None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:57.135188 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016fa4e-e05d-4b68-bdd3-4f3a164b1c6f None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:57.135690 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016fa4e-e05d-4b68-bdd3-4f3a164b1c6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:57.156111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5016fa4e-e05d-4b68-bdd3-4f3a164b1c6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:57.164947 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-5016fa4e-e05d-4b68-bdd3-4f3a164b1c6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:31:57.164947 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:57.164947 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:57.164947 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:57.164947 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:57.164947 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:57.164947 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:57.164947 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:57.164947 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:57.164947 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:57.164947 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:57.164947 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:57.164947 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:57.164947 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:57.164947 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:57.164947 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:57.167059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:57.167059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:57.167059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:57.167059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:57.167059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:57.167059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:57.167059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:57.167059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:57.167059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:57.167059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:57.167059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:57.167059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:57.167059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:57.167059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:57.167059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:57.167059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:57.169090 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:57.169090 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:57.169090 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:57.169090 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:57.169090 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:57.169090 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:57.169090 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:57.169090 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:57.169090 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:57.169090 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:57.169090 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:31:57.169090 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:31:57.169090 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 175/341] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:57.175665 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016fa4e-e05d-4b68-bdd3-4f3a164b1c6f None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:57.285854 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0cdf4-a1b1-4b7f-9b57-e16b376bb035 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:57.328483 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016fa4e-e05d-4b68-bdd3-4f3a164b1c6f None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:57.364907 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe909a4b-68a7-4dae-a4c6-f8ff844806a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:57.365577 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe909a4b-68a7-4dae-a4c6-f8ff844806a8 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:57.365867 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe909a4b-68a7-4dae-a4c6-f8ff844806a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:57.366151 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe909a4b-68a7-4dae-a4c6-f8ff844806a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:57.379950 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:57.383028 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458d427-d476-411a-8bfa-ead1ff1c76d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:57.383731 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458d427-d476-411a-8bfa-ead1ff1c76d5 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:57.384022 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458d427-d476-411a-8bfa-ead1ff1c76d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:57.384313 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458d427-d476-411a-8bfa-ead1ff1c76d5 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:57.385063 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458d427-d476-411a-8bfa-ead1ff1c76d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:57.385374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458d427-d476-411a-8bfa-ead1ff1c76d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:57.386772 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458d427-d476-411a-8bfa-ead1ff1c76d5 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:57.400793 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 176/342] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 08:31:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:57.406171 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458d427-d476-411a-8bfa-ead1ff1c76d5 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:57.473434 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe909a4b-68a7-4dae-a4c6-f8ff844806a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:57.474928 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe909a4b-68a7-4dae-a4c6-f8ff844806a8 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:57.506063 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:57.597293 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458d427-d476-411a-8bfa-ead1ff1c76d5 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:57.634263 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 167/343] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:31:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:31:57.644720 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe909a4b-68a7-4dae-a4c6-f8ff844806a8 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:57.658330 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69c486-b9a0-4b6a-968d-b1c45877542b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:57.659040 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69c486-b9a0-4b6a-968d-b1c45877542b None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:57.659323 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69c486-b9a0-4b6a-968d-b1c45877542b None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:57.659893 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69c486-b9a0-4b6a-968d-b1c45877542b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:57.719887 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:57.751171 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69c486-b9a0-4b6a-968d-b1c45877542b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:57.753130 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69c486-b9a0-4b6a-968d-b1c45877542b None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:57.824063 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:57.828069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe909a4b-68a7-4dae-a4c6-f8ff844806a8 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:57.871201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 177/344] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:31:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 08:31:57.873249 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eabf1c-9ae5-4427-96bc-e3ded4df5714 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:57.873746 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eabf1c-9ae5-4427-96bc-e3ded4df5714 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:57.874462 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eabf1c-9ae5-4427-96bc-e3ded4df5714 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:57.876386 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 178/345] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:57.880985 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eabf1c-9ae5-4427-96bc-e3ded4df5714 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:57.882275 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d5c80-cb7b-4bbd-a9cc-95d35fb9a091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:57.883778 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d5c80-cb7b-4bbd-a9cc-95d35fb9a091 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:57.892982 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d5c80-cb7b-4bbd-a9cc-95d35fb9a091 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:57.893546 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d5c80-cb7b-4bbd-a9cc-95d35fb9a091 None admin] PATH_INFO: `/v3/projects/65208cd21fc9480e843b073170fa9fff` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:57.897361 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d5c80-cb7b-4bbd-a9cc-95d35fb9a091 None admin] RBAC: Authorizing `identity:get_project(project_id=65208cd21fc9480e843b073170fa9fff)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:57.899047 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d5c80-cb7b-4bbd-a9cc-95d35fb9a091 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:57.901360 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 168/346] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:57 2022] GET /identity/v3/projects/65208cd21fc9480e843b073170fa9fff => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:57.902819 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a60c8-4c99-4517-9c55-ba3e213a2207 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:57.904906 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a60c8-4c99-4517-9c55-ba3e213a2207 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:57.905495 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a60c8-4c99-4517-9c55-ba3e213a2207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:57.940615 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-eb3a60c8-4c99-4517-9c55-ba3e213a2207 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:57.946886 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-eb3a60c8-4c99-4517-9c55-ba3e213a2207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:58.042735 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eabf1c-9ae5-4427-96bc-e3ded4df5714 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:58.068479 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 169/347] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:58.069911 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a60c8-4c99-4517-9c55-ba3e213a2207 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:58.081693 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a92b93-1367-4aa7-8855-e7e1eb7d1c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:58.082551 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a92b93-1367-4aa7-8855-e7e1eb7d1c6e None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:58.082826 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a92b93-1367-4aa7-8855-e7e1eb7d1c6e None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:58.083096 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a92b93-1367-4aa7-8855-e7e1eb7d1c6e None admin] PATH_INFO: `/v3/projects/65208cd21fc9480e843b073170fa9fff` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:58.084323 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a92b93-1367-4aa7-8855-e7e1eb7d1c6e None admin] RBAC: Authorizing `identity:get_project(project_id=65208cd21fc9480e843b073170fa9fff)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:58.085882 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a92b93-1367-4aa7-8855-e7e1eb7d1c6e None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:58.088054 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 179/348] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:31:57 2022] GET /identity/v3/projects/65208cd21fc9480e843b073170fa9fff => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:58.089121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aaefeb-b100-4193-a5c1-7f4dbb10acb2 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:58.089383 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aaefeb-b100-4193-a5c1-7f4dbb10acb2 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:58.089650 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aaefeb-b100-4193-a5c1-7f4dbb10acb2 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:58.090856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 180/349] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:58.097624 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aaefeb-b100-4193-a5c1-7f4dbb10acb2 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:58.120359 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:58.122274 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:58.211911 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a60c8-4c99-4517-9c55-ba3e213a2207 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:58.223985 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aaefeb-b100-4193-a5c1-7f4dbb10acb2 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:58.256764 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba52ca3-f578-4549-8e88-06a08e8ceb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:58.258047 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba52ca3-f578-4549-8e88-06a08e8ceb27 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:58.259537 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba52ca3-f578-4549-8e88-06a08e8ceb27 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:58.259537 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba52ca3-f578-4549-8e88-06a08e8ceb27 None admin] PATH_INFO: `/v3/groups/83422cba961044af87596a3eb738af4b` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:58.264366 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b483a00-630c-4013-9052-a92013d65815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:58.265457 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b483a00-630c-4013-9052-a92013d65815 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:58.265920 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b483a00-630c-4013-9052-a92013d65815 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:58.266365 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b483a00-630c-4013-9052-a92013d65815 None admin] PATH_INFO: `/v3/groups/83422cba961044af87596a3eb738af4b` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:58.267147 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba52ca3-f578-4549-8e88-06a08e8ceb27 None admin] RBAC: Authorizing `identity:get_group(group_id=83422cba961044af87596a3eb738af4b)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:58.268519 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b483a00-630c-4013-9052-a92013d65815 None admin] RBAC: Authorizing `identity:get_group(group_id=83422cba961044af87596a3eb738af4b)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:58.269177 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba52ca3-f578-4549-8e88-06a08e8ceb27 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:58.270303 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b483a00-630c-4013-9052-a92013d65815 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:58.271463 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 170/350] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jul 25 08:31:58 2022] GET /identity/v3/groups/83422cba961044af87596a3eb738af4b => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:58.272369 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba52ca3-f578-4549-8e88-06a08e8ceb27 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:58.273098 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 181/351] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jul 25 08:31:58 2022] GET /identity/v3/groups/83422cba961044af87596a3eb738af4b => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:58.274437 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda6f17-de8d-43c0-a11a-853bb7045347 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:58.274895 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda6f17-de8d-43c0-a11a-853bb7045347 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:58.275348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda6f17-de8d-43c0-a11a-853bb7045347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:58.301148 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-3bda6f17-de8d-43c0-a11a-853bb7045347 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:58.302338 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-3bda6f17-de8d-43c0-a11a-853bb7045347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:58.397162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 182/352] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:58.397325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42622cf4-cb08-4f40-9f7b-174b5494975a None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:58.397544 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42622cf4-cb08-4f40-9f7b-174b5494975a None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:58.397836 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42622cf4-cb08-4f40-9f7b-174b5494975a None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:58.401374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 183/353] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:58.401374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42622cf4-cb08-4f40-9f7b-174b5494975a None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:58.421348 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:58.425288 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:58.428245 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba52ca3-f578-4549-8e88-06a08e8ceb27 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:58.481594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede684d-5d53-4a73-ae5b-98ac4b64d99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:58.481594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede684d-5d53-4a73-ae5b-98ac4b64d99e None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:58.482320 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede684d-5d53-4a73-ae5b-98ac4b64d99e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:58.482320 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede684d-5d53-4a73-ae5b-98ac4b64d99e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:58.499031 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede684d-5d53-4a73-ae5b-98ac4b64d99e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:58.508293 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-eede684d-5d53-4a73-ae5b-98ac4b64d99e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:31:58.508293 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:58.508293 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:58.508293 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:58.508293 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:58.508293 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:58.508293 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:58.508293 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:58.508293 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:58.508293 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:58.508293 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:58.508293 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:58.508293 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:58.508293 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:58.508293 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:58.508293 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:58.509279 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:58.509279 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:58.509279 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:58.509279 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:58.509279 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:58.509279 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:58.509279 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:58.509279 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:58.509279 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:58.509279 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:58.509279 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:58.509279 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:58.509279 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:58.509279 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:58.509279 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:58.509279 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:58.510292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:58.510292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:58.510292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:58.510292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:58.510292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:58.510292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:58.510292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:58.510292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:58.510292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:58.510292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:58.510292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 08:31:58.510292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:31:58.510292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 171/354] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:58.510292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede684d-5d53-4a73-ae5b-98ac4b64d99e None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:58.545842 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42622cf4-cb08-4f40-9f7b-174b5494975a None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:58.586337 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c8163-fca5-4bd1-8829-ef021ee4be95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:58.587031 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c8163-fca5-4bd1-8829-ef021ee4be95 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:58.587332 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c8163-fca5-4bd1-8829-ef021ee4be95 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:58.590686 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c8163-fca5-4bd1-8829-ef021ee4be95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:58.590686 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c8163-fca5-4bd1-8829-ef021ee4be95 None admin] RBAC: Adding query filter params (group.id=83422cba961044af87596a3eb738af4b, role.id=be32d79ae2964b4b93a1efff3a9aa70b, scope.project.id=65208cd21fc9480e843b073170fa9fff) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:58.590686 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c8163-fca5-4bd1-8829-ef021ee4be95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:58.590686 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c8163-fca5-4bd1-8829-ef021ee4be95 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:58.598398 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 184/355] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Jul 25 08:31:58 2022] GET /identity/v3/role_assignments?group.id=83422cba961044af87596a3eb738af4b&scope.project.id=65208cd21fc9480e843b073170fa9fff&role.id=be32d79ae2964b4b93a1efff3a9aa70b => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:58.599266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48468f-d4d1-4792-bc03-33b28e17652c None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:58.599403 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48468f-d4d1-4792-bc03-33b28e17652c None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:58.599753 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48468f-d4d1-4792-bc03-33b28e17652c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:58.622632 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-ba48468f-d4d1-4792-bc03-33b28e17652c None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:58.624005 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-ba48468f-d4d1-4792-bc03-33b28e17652c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:58.669084 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede684d-5d53-4a73-ae5b-98ac4b64d99e None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:58.721656 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f397d-ee61-40f5-99e6-4d3597c1d0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:58.723004 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f397d-ee61-40f5-99e6-4d3597c1d0f4 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:58.725699 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f397d-ee61-40f5-99e6-4d3597c1d0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:58.726018 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f397d-ee61-40f5-99e6-4d3597c1d0f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:58.726919 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f397d-ee61-40f5-99e6-4d3597c1d0f4 None admin] RBAC: Adding query filter params (group.id=83422cba961044af87596a3eb738af4b, role.id=2cb5ed3eb0484858a5f7cbdce69092ed, scope.project.id=65208cd21fc9480e843b073170fa9fff) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:58.727241 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f397d-ee61-40f5-99e6-4d3597c1d0f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:58.728809 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f397d-ee61-40f5-99e6-4d3597c1d0f4 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:58.736584 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 172/356] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Jul 25 08:31:58 2022] GET /identity/v3/role_assignments?group.id=83422cba961044af87596a3eb738af4b&scope.project.id=65208cd21fc9480e843b073170fa9fff&role.id=2cb5ed3eb0484858a5f7cbdce69092ed => generated 260 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:58.737353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f397d-ee61-40f5-99e6-4d3597c1d0f4 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:58.739069 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 185/357] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:58.745287 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48468f-d4d1-4792-bc03-33b28e17652c None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:58.764328 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:58.792069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:58.895507 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48468f-d4d1-4792-bc03-33b28e17652c None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:58.908626 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f397d-ee61-40f5-99e6-4d3597c1d0f4 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:58.950397 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266c2b4-87d2-4fb5-b8b4-ab71af878d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:58.951007 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266c2b4-87d2-4fb5-b8b4-ab71af878d09 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:58.951293 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266c2b4-87d2-4fb5-b8b4-ab71af878d09 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:58.951570 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266c2b4-87d2-4fb5-b8b4-ab71af878d09 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:58.952376 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266c2b4-87d2-4fb5-b8b4-ab71af878d09 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:58.955283 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266c2b4-87d2-4fb5-b8b4-ab71af878d09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:58.955283 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266c2b4-87d2-4fb5-b8b4-ab71af878d09 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:58.959982 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db5c88-c5dc-42b0-a7e6-c24703fb2db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:58.961065 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db5c88-c5dc-42b0-a7e6-c24703fb2db5 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:58.961571 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db5c88-c5dc-42b0-a7e6-c24703fb2db5 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:58.962040 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db5c88-c5dc-42b0-a7e6-c24703fb2db5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:58.963811 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 186/358] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 08:31:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:58.968386 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266c2b4-87d2-4fb5-b8b4-ab71af878d09 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:58.975295 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db5c88-c5dc-42b0-a7e6-c24703fb2db5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:58.983810 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-38db5c88-c5dc-42b0-a7e6-c24703fb2db5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:31:58.983810 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:58.983810 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:58.983810 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:58.983810 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:58.983810 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:58.983810 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:58.983810 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:58.983810 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:58.983810 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:58.983810 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:58.983810 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:58.983810 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:58.983810 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:58.983810 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:58.983810 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:58.984704 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:58.984704 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:58.984704 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:58.984704 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:58.984704 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:58.984704 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:58.984704 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:58.984704 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:58.984704 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:58.984704 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:58.984704 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:58.984704 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:58.984704 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:58.984704 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:58.984704 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:58.984704 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:58.985686 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:58.985686 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:58.985686 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:58.985686 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:58.985686 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:58.985686 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:58.985686 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:58.985686 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:58.985686 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:58.985686 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:58.985686 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:31:58.985686 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:31:58.988423 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 173/359] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:31:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:58.990028 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf396ea-93a6-4fd7-af27-c7b6d31ad722 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:58.990522 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf396ea-93a6-4fd7-af27-c7b6d31ad722 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:58.991017 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf396ea-93a6-4fd7-af27-c7b6d31ad722 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:58.992522 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 174/360] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:31:58.993387 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf396ea-93a6-4fd7-af27-c7b6d31ad722 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:59.080021 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:59.085248 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:59.085557 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266c2b4-87d2-4fb5-b8b4-ab71af878d09 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:59.105851 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf396ea-93a6-4fd7-af27-c7b6d31ad722 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:59.121273 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aba96a-f955-4212-9b0a-18c7b0d24379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:59.122091 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aba96a-f955-4212-9b0a-18c7b0d24379 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:59.122373 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aba96a-f955-4212-9b0a-18c7b0d24379 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:59.122646 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aba96a-f955-4212-9b0a-18c7b0d24379 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:59.135086 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aba96a-f955-4212-9b0a-18c7b0d24379 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:59.144091 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-80aba96a-f955-4212-9b0a-18c7b0d24379 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:31:59.144091 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:59.144091 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:59.144091 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:59.144091 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:59.144091 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:59.144091 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:59.144091 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:59.144091 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:59.144091 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:59.144091 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:59.144091 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:59.144091 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:59.144091 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:59.144091 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:59.144091 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:59.144985 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:59.144985 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:59.144985 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:59.144985 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:59.144985 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:59.144985 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:59.144985 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:59.144985 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:59.144985 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:59.144985 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:59.144985 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:59.144985 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:59.144985 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:59.144985 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:59.144985 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:59.144985 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:59.145763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:59.145763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:59.145763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:59.145763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:59.145763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:59.145763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:59.145763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:59.145763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:59.145763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:59.145763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:59.145763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:31:59.145763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:31:59.145763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 187/361] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 08:31:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:59.146416 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aba96a-f955-4212-9b0a-18c7b0d24379 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:59.148527 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54d5cf-27dd-4627-850e-6db8eefecab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:59.149576 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54d5cf-27dd-4627-850e-6db8eefecab3 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:59.150003 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54d5cf-27dd-4627-850e-6db8eefecab3 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:59.150416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54d5cf-27dd-4627-850e-6db8eefecab3 None admin] PATH_INFO: `/v3/users/85615772b3b84f219812bcf366b4a646` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:59.151859 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff54d5cf-27dd-4627-850e-6db8eefecab3 None admin] RBAC: Authorizing `identity:get_user(user_id=85615772b3b84f219812bcf366b4a646)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:59.153501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff54d5cf-27dd-4627-850e-6db8eefecab3 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:59.159809 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 175/362] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:31:58 2022] GET /identity/v3/users/85615772b3b84f219812bcf366b4a646 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:59.161379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e8233-83e6-40a2-a3cf-0b57dd2c1b38 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:59.161813 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e8233-83e6-40a2-a3cf-0b57dd2c1b38 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:59.162288 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e8233-83e6-40a2-a3cf-0b57dd2c1b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:59.182796 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-694e8233-83e6-40a2-a3cf-0b57dd2c1b38 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:31:59.184379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-694e8233-83e6-40a2-a3cf-0b57dd2c1b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:31:59.262503 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 176/363] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:31:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:31:59.263463 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e8233-83e6-40a2-a3cf-0b57dd2c1b38 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:59.288858 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aba96a-f955-4212-9b0a-18c7b0d24379 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:59.327538 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:59.336369 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6c366-c2ba-4726-9e61-d4fe71682cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:59.337451 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6c366-c2ba-4726-9e61-d4fe71682cc6 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:59.338190 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6c366-c2ba-4726-9e61-d4fe71682cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:59.348544 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6c366-c2ba-4726-9e61-d4fe71682cc6 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:59.348544 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6c366-c2ba-4726-9e61-d4fe71682cc6 None admin] RBAC: Adding query filter params (name=member) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:59.348544 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6c366-c2ba-4726-9e61-d4fe71682cc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:59.348544 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6c366-c2ba-4726-9e61-d4fe71682cc6 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:59.358237 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 188/364] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 08:31:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:59.359096 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6c366-c2ba-4726-9e61-d4fe71682cc6 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:59.375024 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:59.384600 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e8233-83e6-40a2-a3cf-0b57dd2c1b38 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:59.430447 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a20f8d-5b78-479b-8af5-68e86cfb508f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:59.431526 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a20f8d-5b78-479b-8af5-68e86cfb508f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:59.431849 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a20f8d-5b78-479b-8af5-68e86cfb508f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:59.432132 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a20f8d-5b78-479b-8af5-68e86cfb508f None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:59.433058 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a20f8d-5b78-479b-8af5-68e86cfb508f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:59.433658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a20f8d-5b78-479b-8af5-68e86cfb508f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:59.435052 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a20f8d-5b78-479b-8af5-68e86cfb508f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:59.447389 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 177/365] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:31:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:59.448402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a20f8d-5b78-479b-8af5-68e86cfb508f None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:59.506962 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6c366-c2ba-4726-9e61-d4fe71682cc6 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:59.557263 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea878f3-f623-40d1-a370-8b5360d64ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:59.557998 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea878f3-f623-40d1-a370-8b5360d64ab0 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:59.558654 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea878f3-f623-40d1-a370-8b5360d64ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:59.558934 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea878f3-f623-40d1-a370-8b5360d64ab0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:59.560105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea878f3-f623-40d1-a370-8b5360d64ab0 None admin] RBAC: Adding query filter params (role.id=0263e334bab74e7cb5d062a03089b3f7, user.id=85615772b3b84f219812bcf366b4a646, scope.system=all) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:31:59.560425 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea878f3-f623-40d1-a370-8b5360d64ab0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:59.562172 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea878f3-f623-40d1-a370-8b5360d64ab0 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:59.578624 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 189/366] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Jul 25 08:31:59 2022] GET /identity/v3/role_assignments?user.id=85615772b3b84f219812bcf366b4a646&scope.system=all&role.id=0263e334bab74e7cb5d062a03089b3f7 => generated 510 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:31:59.584179 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea878f3-f623-40d1-a370-8b5360d64ab0 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:59.591398 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a20f8d-5b78-479b-8af5-68e86cfb508f None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:59.665034 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2740f-fce9-4d53-a853-0c26afcfcb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:59.665927 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2740f-fce9-4d53-a853-0c26afcfcb1a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:59.666213 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2740f-fce9-4d53-a853-0c26afcfcb1a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:59.666491 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2740f-fce9-4d53-a853-0c26afcfcb1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:59.682740 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:59.687720 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2740f-fce9-4d53-a853-0c26afcfcb1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:31:59.697654 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-fdd2740f-fce9-4d53-a853-0c26afcfcb1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:31:59.697654 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:31:59.697654 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:31:59.697654 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:31:59.697654 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:31:59.697654 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:31:59.697654 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:31:59.697654 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:31:59.697654 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:31:59.697654 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:31:59.697654 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:31:59.697654 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:31:59.697654 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:31:59.697654 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:31:59.697654 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:31:59.697654 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:31:59.698608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:31:59.698608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:31:59.698608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:31:59.698608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:31:59.698608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:31:59.698608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:31:59.698608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:31:59.698608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:31:59.698608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:31:59.698608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:31:59.698608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:31:59.698608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:31:59.698608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:31:59.698608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:31:59.698608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:31:59.698608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:31:59.699389 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:31:59.699389 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:31:59.699389 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:31:59.699389 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:31:59.699389 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:31:59.699389 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:31:59.699389 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:31:59.699389 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:31:59.699389 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:31:59.699389 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:31:59.699389 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:31:59.699389 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:31:59.699389 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 178/367] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:31:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:31:59.700691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2740f-fce9-4d53-a853-0c26afcfcb1a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:31:59.712549 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:31:59.806854 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea878f3-f623-40d1-a370-8b5360d64ab0 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:59.862661 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d34a69-844f-4cc5-9942-0c2639722f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:59.863259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d34a69-844f-4cc5-9942-0c2639722f09 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:59.863523 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d34a69-844f-4cc5-9942-0c2639722f09 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:59.863869 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d34a69-844f-4cc5-9942-0c2639722f09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:59.887459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2740f-fce9-4d53-a853-0c26afcfcb1a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:31:59.927647 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64d8f7-fed9-4ac0-bf0f-a2b891eb1b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:31:59.928612 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64d8f7-fed9-4ac0-bf0f-a2b891eb1b73 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:31:59.929043 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64d8f7-fed9-4ac0-bf0f-a2b891eb1b73 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:31:59.929465 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64d8f7-fed9-4ac0-bf0f-a2b891eb1b73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:31:59.937773 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d34a69-844f-4cc5-9942-0c2639722f09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:31:59.939437 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d34a69-844f-4cc5-9942-0c2639722f09 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:31:59.995250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:00.014378 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64d8f7-fed9-4ac0-bf0f-a2b891eb1b73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:00.016126 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64d8f7-fed9-4ac0-bf0f-a2b891eb1b73 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:00.020635 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:00.054830 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 190/368] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:31:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:32:00.055716 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d34a69-844f-4cc5-9942-0c2639722f09 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:00.134042 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 179/369] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:31:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:32:00.135173 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64d8f7-fed9-4ac0-bf0f-a2b891eb1b73 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:00.168266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d34a69-844f-4cc5-9942-0c2639722f09 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:00.204241 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05956c-9463-4df3-ae0d-442e10026867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:00.204937 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05956c-9463-4df3-ae0d-442e10026867 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:00.205225 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05956c-9463-4df3-ae0d-442e10026867 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:00.205506 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05956c-9463-4df3-ae0d-442e10026867 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:00.206280 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e05956c-9463-4df3-ae0d-442e10026867 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:00.206600 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e05956c-9463-4df3-ae0d-442e10026867 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:00.208081 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e05956c-9463-4df3-ae0d-442e10026867 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:00.218895 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 191/370] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:32:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:00.220511 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05956c-9463-4df3-ae0d-442e10026867 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:00.235891 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:00.247790 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64d8f7-fed9-4ac0-bf0f-a2b891eb1b73 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:00.251884 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:00.292949 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a23b8-a4da-45e8-a8be-f243fd0cfbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:00.293820 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a23b8-a4da-45e8-a8be-f243fd0cfbc6 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:00.294101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a23b8-a4da-45e8-a8be-f243fd0cfbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:00.294376 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a23b8-a4da-45e8-a8be-f243fd0cfbc6 None admin] PATH_INFO: `/v3/projects/a941dd7311514444b64e1778320ae963` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:00.295574 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a23b8-a4da-45e8-a8be-f243fd0cfbc6 None admin] RBAC: Authorizing `identity:get_project(project_id=a941dd7311514444b64e1778320ae963)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:00.297192 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a23b8-a4da-45e8-a8be-f243fd0cfbc6 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:00.300365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 180/371] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:32:00 2022] GET /identity/v3/projects/a941dd7311514444b64e1778320ae963 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:00.305653 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a23b8-a4da-45e8-a8be-f243fd0cfbc6 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:00.332798 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05956c-9463-4df3-ae0d-442e10026867 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:00.370525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65da5a2-f9b8-4343-be8b-c0efa39c3073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:00.371447 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65da5a2-f9b8-4343-be8b-c0efa39c3073 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:00.371776 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65da5a2-f9b8-4343-be8b-c0efa39c3073 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:00.372054 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65da5a2-f9b8-4343-be8b-c0efa39c3073 None admin] PATH_INFO: `/v3/projects/a941dd7311514444b64e1778320ae963` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:00.373256 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65da5a2-f9b8-4343-be8b-c0efa39c3073 None admin] RBAC: Authorizing `identity:get_project(project_id=a941dd7311514444b64e1778320ae963)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:00.374702 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65da5a2-f9b8-4343-be8b-c0efa39c3073 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:00.377359 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 192/372] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:32:00 2022] GET /identity/v3/projects/a941dd7311514444b64e1778320ae963 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:00.378202 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65da5a2-f9b8-4343-be8b-c0efa39c3073 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:00.411248 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a23b8-a4da-45e8-a8be-f243fd0cfbc6 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:00.460395 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a76db-0170-4141-8311-8618344d33bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:00.461357 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a76db-0170-4141-8311-8618344d33bb None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:00.461639 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a76db-0170-4141-8311-8618344d33bb None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:00.461917 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a76db-0170-4141-8311-8618344d33bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:00.483598 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:00.505863 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65da5a2-f9b8-4343-be8b-c0efa39c3073 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:00.513839 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:00.546164 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6346ae-5fa6-42f8-95e8-2898155eed11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:00.546399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a76db-0170-4141-8311-8618344d33bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:00.547039 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6346ae-5fa6-42f8-95e8-2898155eed11 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:00.547326 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6346ae-5fa6-42f8-95e8-2898155eed11 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:00.548253 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6346ae-5fa6-42f8-95e8-2898155eed11 None admin] PATH_INFO: `/v3/groups/83422cba961044af87596a3eb738af4b` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:00.548355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a76db-0170-4141-8311-8618344d33bb None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:00.549703 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6346ae-5fa6-42f8-95e8-2898155eed11 None admin] RBAC: Authorizing `identity:get_group(group_id=83422cba961044af87596a3eb738af4b)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:00.551303 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6346ae-5fa6-42f8-95e8-2898155eed11 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:00.553318 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 193/373] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jul 25 08:32:00 2022] GET /identity/v3/groups/83422cba961044af87596a3eb738af4b => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:00.554102 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6346ae-5fa6-42f8-95e8-2898155eed11 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:00.665798 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6346ae-5fa6-42f8-95e8-2898155eed11 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:00.667198 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 181/374] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:32:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:32:00.668281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a76db-0170-4141-8311-8618344d33bb None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:00.703002 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9a369-6c6c-4b4c-a1a2-c9c4f443b185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:00.704725 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9a369-6c6c-4b4c-a1a2-c9c4f443b185 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:00.704881 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9a369-6c6c-4b4c-a1a2-c9c4f443b185 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:00.705144 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9a369-6c6c-4b4c-a1a2-c9c4f443b185 None admin] PATH_INFO: `/v3/groups/83422cba961044af87596a3eb738af4b` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:00.707204 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9a369-6c6c-4b4c-a1a2-c9c4f443b185 None admin] RBAC: Authorizing `identity:get_group(group_id=83422cba961044af87596a3eb738af4b)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:00.710822 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9a369-6c6c-4b4c-a1a2-c9c4f443b185 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:00.712763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 194/375] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jul 25 08:32:00 2022] GET /identity/v3/groups/83422cba961044af87596a3eb738af4b => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:00.713700 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9a369-6c6c-4b4c-a1a2-c9c4f443b185 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:00.740654 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:00.749619 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:00.778476 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a76db-0170-4141-8311-8618344d33bb None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:00.816597 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15038540-a3cf-4930-8000-b69d0dea6035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:00.817260 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15038540-a3cf-4930-8000-b69d0dea6035 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:00.817565 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15038540-a3cf-4930-8000-b69d0dea6035 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:00.817839 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15038540-a3cf-4930-8000-b69d0dea6035 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:00.818936 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15038540-a3cf-4930-8000-b69d0dea6035 None admin] RBAC: Adding query filter params (group.id=83422cba961044af87596a3eb738af4b, role.id=2cb5ed3eb0484858a5f7cbdce69092ed, scope.project.id=a941dd7311514444b64e1778320ae963) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:00.819058 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15038540-a3cf-4930-8000-b69d0dea6035 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:00.820518 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15038540-a3cf-4930-8000-b69d0dea6035 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:00.832049 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 182/376] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Jul 25 08:32:00 2022] GET /identity/v3/role_assignments?group.id=83422cba961044af87596a3eb738af4b&scope.project.id=a941dd7311514444b64e1778320ae963&role.id=2cb5ed3eb0484858a5f7cbdce69092ed => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:00.833016 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15038540-a3cf-4930-8000-b69d0dea6035 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:00.835928 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9a369-6c6c-4b4c-a1a2-c9c4f443b185 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:00.875387 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7796689-845f-40d5-b23c-5aee3b40129a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:00.876925 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7796689-845f-40d5-b23c-5aee3b40129a None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:00.877434 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7796689-845f-40d5-b23c-5aee3b40129a None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:00.877856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7796689-845f-40d5-b23c-5aee3b40129a None admin] PATH_INFO: `/v3/projects/dc9626b4086645e5810dd68fb6d20d03` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:00.879295 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7796689-845f-40d5-b23c-5aee3b40129a None admin] RBAC: Authorizing `identity:get_project(project_id=dc9626b4086645e5810dd68fb6d20d03)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:00.880962 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7796689-845f-40d5-b23c-5aee3b40129a None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:00.883255 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 195/377] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:32:00 2022] GET /identity/v3/projects/dc9626b4086645e5810dd68fb6d20d03 => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:00.888568 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7796689-845f-40d5-b23c-5aee3b40129a None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:01.004098 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:01.009729 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7796689-845f-40d5-b23c-5aee3b40129a None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:01.065209 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15038540-a3cf-4930-8000-b69d0dea6035 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:01.077009 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eef62e-c1e5-4d0f-96b7-e59bf8e91dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:01.077931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eef62e-c1e5-4d0f-96b7-e59bf8e91dcf None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:01.078211 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eef62e-c1e5-4d0f-96b7-e59bf8e91dcf None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:01.078485 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eef62e-c1e5-4d0f-96b7-e59bf8e91dcf None admin] PATH_INFO: `/v3/groups/3e749e9c937e4cb5a2e8560336dfcf1b` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:01.089215 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eef62e-c1e5-4d0f-96b7-e59bf8e91dcf None admin] RBAC: Authorizing `identity:get_group(group_id=3e749e9c937e4cb5a2e8560336dfcf1b)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:01.090706 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eef62e-c1e5-4d0f-96b7-e59bf8e91dcf None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:01.093122 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 196/378] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jul 25 08:32:00 2022] GET /identity/v3/groups/3e749e9c937e4cb5a2e8560336dfcf1b => generated 229 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:01.094538 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5a34e-8851-4e95-8872-55fa790f1822 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:01.094836 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5a34e-8851-4e95-8872-55fa790f1822 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:01.095314 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5a34e-8851-4e95-8872-55fa790f1822 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:01.096945 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 197/379] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:01.099698 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5a34e-8851-4e95-8872-55fa790f1822 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:01.118574 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa8ce7-0858-481b-a0d0-40a958503a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:01.119241 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa8ce7-0858-481b-a0d0-40a958503a91 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:01.119523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa8ce7-0858-481b-a0d0-40a958503a91 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:01.119840 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa8ce7-0858-481b-a0d0-40a958503a91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:01.120795 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa8ce7-0858-481b-a0d0-40a958503a91 None admin] RBAC: Adding query filter params (group.id=83422cba961044af87596a3eb738af4b, role.id=be32d79ae2964b4b93a1efff3a9aa70b, scope.project.id=a941dd7311514444b64e1778320ae963) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:01.121109 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa8ce7-0858-481b-a0d0-40a958503a91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:01.122652 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa8ce7-0858-481b-a0d0-40a958503a91 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:01.128262 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:01.130369 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 183/380] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Jul 25 08:32:00 2022] GET /identity/v3/role_assignments?group.id=83422cba961044af87596a3eb738af4b&scope.project.id=a941dd7311514444b64e1778320ae963&role.id=be32d79ae2964b4b93a1efff3a9aa70b => generated 260 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:01.131634 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8c33f-1db6-4954-b387-de9ef4c21553 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:01.132647 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8c33f-1db6-4954-b387-de9ef4c21553 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:01.132934 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8c33f-1db6-4954-b387-de9ef4c21553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:01.168756 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-4eb8c33f-1db6-4954-b387-de9ef4c21553 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:01.170300 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4eb8c33f-1db6-4954-b387-de9ef4c21553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:01.276530 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5a34e-8851-4e95-8872-55fa790f1822 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:01.286502 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 184/381] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:32:01.308590 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8c33f-1db6-4954-b387-de9ef4c21553 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:01.330213 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a1b88-49ab-436f-a64d-c0a357c030e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:01.330891 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a1b88-49ab-436f-a64d-c0a357c030e4 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:01.331178 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a1b88-49ab-436f-a64d-c0a357c030e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:01.331456 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a1b88-49ab-436f-a64d-c0a357c030e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:01.332615 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a1b88-49ab-436f-a64d-c0a357c030e4 None admin] RBAC: Adding query filter params (group.id=3e749e9c937e4cb5a2e8560336dfcf1b, role.id=25b0f48c10474bf6b98aad8f093868ee, scope.project.id=dc9626b4086645e5810dd68fb6d20d03) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:01.332930 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a1b88-49ab-436f-a64d-c0a357c030e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:01.334441 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a1b88-49ab-436f-a64d-c0a357c030e4 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:01.349422 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 198/382] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Jul 25 08:32:01 2022] GET /identity/v3/role_assignments?group.id=3e749e9c937e4cb5a2e8560336dfcf1b&scope.project.id=dc9626b4086645e5810dd68fb6d20d03&role.id=25b0f48c10474bf6b98aad8f093868ee => generated 260 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:01.415004 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b22706-945e-42e5-a4cb-dd409123cb9d None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:01.415321 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b22706-945e-42e5-a4cb-dd409123cb9d None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:01.415574 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b22706-945e-42e5-a4cb-dd409123cb9d None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:01.417249 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 199/383] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:32:01.423468 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74609b30-3a25-41d5-bc8d-e6bdee9bf6a7 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:01.423887 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74609b30-3a25-41d5-bc8d-e6bdee9bf6a7 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:01.424044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74609b30-3a25-41d5-bc8d-e6bdee9bf6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:01.445125 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-74609b30-3a25-41d5-bc8d-e6bdee9bf6a7 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:01.446411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-74609b30-3a25-41d5-bc8d-e6bdee9bf6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:01.455921 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:01.480828 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8c33f-1db6-4954-b387-de9ef4c21553 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:01.547528 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:01.548244 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 200/384] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:32:01.573673 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87ef3f-6c0f-43a4-a50f-a9db6a77b70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:01.574021 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74609b30-3a25-41d5-bc8d-e6bdee9bf6a7 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:01.574956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87ef3f-6c0f-43a4-a50f-a9db6a77b70a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:01.575406 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87ef3f-6c0f-43a4-a50f-a9db6a77b70a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:01.575854 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87ef3f-6c0f-43a4-a50f-a9db6a77b70a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:01.597379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f87ef3f-6c0f-43a4-a50f-a9db6a77b70a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:01.606873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-5f87ef3f-6c0f-43a4-a50f-a9db6a77b70a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:32:01.606873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:01.606873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:01.606873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:01.606873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:01.606873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:01.606873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:01.606873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:01.606873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:01.606873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:01.606873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:01.606873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:01.606873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:01.606873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:01.606873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:01.606873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:01.607989 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:01.607989 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:01.607989 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:01.607989 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:01.607989 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:01.607989 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:01.607989 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:01.607989 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:01.607989 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:01.607989 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:01.607989 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:01.607989 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:01.607989 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:01.607989 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:01.607989 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:01.607989 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:01.608971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:01.608971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:01.608971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:01.608971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:01.608971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:01.608971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:01.608971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:01.608971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:01.608971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:01.608971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:01.608971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:32:01.608971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:01.611815 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 185/385] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 08:32:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:32:01.619145 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87ef3f-6c0f-43a4-a50f-a9db6a77b70a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:01.739822 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74609b30-3a25-41d5-bc8d-e6bdee9bf6a7 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:01.806901 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87ef3f-6c0f-43a4-a50f-a9db6a77b70a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:01.828997 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e9096-b656-4d5c-b3c3-e4735f9bc301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:01.830662 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e9096-b656-4d5c-b3c3-e4735f9bc301 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:01.830922 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e9096-b656-4d5c-b3c3-e4735f9bc301 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:01.831199 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e9096-b656-4d5c-b3c3-e4735f9bc301 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:01.852974 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083e525-8101-4e12-aff4-bbf8a0c8ccfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:01.854114 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083e525-8101-4e12-aff4-bbf8a0c8ccfc None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:01.854608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083e525-8101-4e12-aff4-bbf8a0c8ccfc None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:01.855084 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083e525-8101-4e12-aff4-bbf8a0c8ccfc None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:01.856073 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083e525-8101-4e12-aff4-bbf8a0c8ccfc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:01.857042 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083e525-8101-4e12-aff4-bbf8a0c8ccfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:01.858689 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083e525-8101-4e12-aff4-bbf8a0c8ccfc None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:01.864592 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e9096-b656-4d5c-b3c3-e4735f9bc301 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:01.868752 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 186/386] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:32:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:01.874086 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-723e9096-b656-4d5c-b3c3-e4735f9bc301 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:32:01.874086 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:01.874086 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:01.874086 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:01.874086 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:01.874086 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:01.874086 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:01.874086 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:01.874086 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:01.874086 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:01.874086 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:01.874086 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:01.874086 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:01.874086 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:01.874086 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:01.874086 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:01.874982 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:01.874982 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:01.874982 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:01.874982 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:01.874982 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:01.874982 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:01.874982 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:01.874982 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:01.874982 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:01.874982 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:01.874982 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:01.874982 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:01.874982 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:01.874982 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:01.874982 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:01.874982 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:01.876347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:01.876347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:01.876347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:01.876347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:01.876347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:01.876347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:01.876347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:01.876347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:01.876347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:01.876347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:01.876347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:32:01.876347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:01.876347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 201/387] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:32:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:32:01.877413 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083e525-8101-4e12-aff4-bbf8a0c8ccfc None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:01.881316 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e9096-b656-4d5c-b3c3-e4735f9bc301 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:01.886788 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:01.971930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:02.066632 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083e525-8101-4e12-aff4-bbf8a0c8ccfc None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:02.084366 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e9096-b656-4d5c-b3c3-e4735f9bc301 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:02.136906 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297be304-b93e-4625-a055-b97d24e990a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:02.137843 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297be304-b93e-4625-a055-b97d24e990a2 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:02.138125 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297be304-b93e-4625-a055-b97d24e990a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:02.138409 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297be304-b93e-4625-a055-b97d24e990a2 None admin] PATH_INFO: `/v3/groups/83422cba961044af87596a3eb738af4b` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:02.139635 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297be304-b93e-4625-a055-b97d24e990a2 None admin] RBAC: Authorizing `identity:get_group(group_id=83422cba961044af87596a3eb738af4b)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:02.141145 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297be304-b93e-4625-a055-b97d24e990a2 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:02.144889 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 187/388] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jul 25 08:32:01 2022] GET /identity/v3/groups/83422cba961044af87596a3eb738af4b => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:02.147372 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befa682-aad5-4899-8dba-bed8ccb7d0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:02.148107 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befa682-aad5-4899-8dba-bed8ccb7d0da None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:02.148388 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befa682-aad5-4899-8dba-bed8ccb7d0da None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:02.148667 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befa682-aad5-4899-8dba-bed8ccb7d0da None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:02.149513 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befa682-aad5-4899-8dba-bed8ccb7d0da None admin] RBAC: Adding query filter params (name=member) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:02.149824 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befa682-aad5-4899-8dba-bed8ccb7d0da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:02.150312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297be304-b93e-4625-a055-b97d24e990a2 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:02.151211 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befa682-aad5-4899-8dba-bed8ccb7d0da None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:02.164842 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 202/389] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 08:32:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:02.171299 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befa682-aad5-4899-8dba-bed8ccb7d0da None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:02.269170 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:02.306282 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297be304-b93e-4625-a055-b97d24e990a2 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:02.311739 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befa682-aad5-4899-8dba-bed8ccb7d0da None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:02.338005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:02.365387 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbda019-579a-4516-90cf-47894cd952e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:02.366262 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbda019-579a-4516-90cf-47894cd952e8 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:02.366548 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbda019-579a-4516-90cf-47894cd952e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:02.366825 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbda019-579a-4516-90cf-47894cd952e8 None admin] PATH_INFO: `/v3/projects/65208cd21fc9480e843b073170fa9fff` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:02.368744 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbda019-579a-4516-90cf-47894cd952e8 None admin] RBAC: Authorizing `identity:get_project(project_id=65208cd21fc9480e843b073170fa9fff)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:02.370181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbda019-579a-4516-90cf-47894cd952e8 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:02.372093 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 188/390] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:32:02 2022] GET /identity/v3/projects/65208cd21fc9480e843b073170fa9fff => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:32:02.380319 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e559ce9-af3b-4b62-994a-4cc94ff4af56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:02.381189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e559ce9-af3b-4b62-994a-4cc94ff4af56 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:02.381476 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e559ce9-af3b-4b62-994a-4cc94ff4af56 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:02.381748 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e559ce9-af3b-4b62-994a-4cc94ff4af56 None admin] PATH_INFO: `/v3/groups/83422cba961044af87596a3eb738af4b` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:02.383186 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbda019-579a-4516-90cf-47894cd952e8 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:02.388458 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e559ce9-af3b-4b62-994a-4cc94ff4af56 None admin] RBAC: Authorizing `identity:get_group(group_id=83422cba961044af87596a3eb738af4b)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:02.389953 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e559ce9-af3b-4b62-994a-4cc94ff4af56 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:02.392303 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 203/391] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jul 25 08:32:02 2022] GET /identity/v3/groups/83422cba961044af87596a3eb738af4b => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:02.398519 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e559ce9-af3b-4b62-994a-4cc94ff4af56 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:02.567634 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbda019-579a-4516-90cf-47894cd952e8 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:02.590840 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e559ce9-af3b-4b62-994a-4cc94ff4af56 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:02.630850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3916e1-a7ff-4e55-b63b-c8fe84ab27a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:02.632141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3916e1-a7ff-4e55-b63b-c8fe84ab27a7 None admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:02.632425 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3916e1-a7ff-4e55-b63b-c8fe84ab27a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:02.632698 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3916e1-a7ff-4e55-b63b-c8fe84ab27a7 None admin] PATH_INFO: `/v3/projects/65208cd21fc9480e843b073170fa9fff/groups/83422cba961044af87596a3eb738af4b/roles/be32d79ae2964b4b93a1efff3a9aa70b` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:02.636956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3916e1-a7ff-4e55-b63b-c8fe84ab27a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=65208cd21fc9480e843b073170fa9fff, group_id=83422cba961044af87596a3eb738af4b, role_id=be32d79ae2964b4b93a1efff3a9aa70b)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:02.638397 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3916e1-a7ff-4e55-b63b-c8fe84ab27a7 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:02.646598 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:02.652142 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79c3f2-04a8-49b3-b7c3-af71901c2aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:02.653061 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79c3f2-04a8-49b3-b7c3-af71901c2aea None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:02.653344 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79c3f2-04a8-49b3-b7c3-af71901c2aea None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:02.653615 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79c3f2-04a8-49b3-b7c3-af71901c2aea None admin] PATH_INFO: `/v3/projects/65208cd21fc9480e843b073170fa9fff` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:02.654892 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79c3f2-04a8-49b3-b7c3-af71901c2aea None admin] RBAC: Authorizing `identity:get_project(project_id=65208cd21fc9480e843b073170fa9fff)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:02.656364 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79c3f2-04a8-49b3-b7c3-af71901c2aea None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:02.658965 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 204/392] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:32:02 2022] GET /identity/v3/projects/65208cd21fc9480e843b073170fa9fff => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:32:02.665154 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79c3f2-04a8-49b3-b7c3-af71901c2aea None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:02.763521 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 189/393] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Jul 25 08:32:02 2022] PUT /identity/v3/projects/65208cd21fc9480e843b073170fa9fff/groups/83422cba961044af87596a3eb738af4b/roles/be32d79ae2964b4b93a1efff3a9aa70b => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:32:02.794172 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79c3f2-04a8-49b3-b7c3-af71901c2aea None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:02.844314 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71b551-8cef-49bc-b521-1f70f9b203a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:02.846127 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71b551-8cef-49bc-b521-1f70f9b203a4 None admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:02.846633 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71b551-8cef-49bc-b521-1f70f9b203a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:02.847128 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71b551-8cef-49bc-b521-1f70f9b203a4 None admin] PATH_INFO: `/v3/projects/65208cd21fc9480e843b073170fa9fff/groups/83422cba961044af87596a3eb738af4b/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:02.853136 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71b551-8cef-49bc-b521-1f70f9b203a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=65208cd21fc9480e843b073170fa9fff, group_id=83422cba961044af87596a3eb738af4b, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:02.854955 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71b551-8cef-49bc-b521-1f70f9b203a4 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:02.936261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 205/394] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Jul 25 08:32:02 2022] PUT /identity/v3/projects/65208cd21fc9480e843b073170fa9fff/groups/83422cba961044af87596a3eb738af4b/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:32:03.406693 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d088352-0301-439d-af47-dde04ad5f679 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:03.407802 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d088352-0301-439d-af47-dde04ad5f679 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:03.408091 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d088352-0301-439d-af47-dde04ad5f679 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:03.410025 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 190/395] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:03.414967 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18287194-93d1-4879-93f7-6c2d051ba474 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:03.415257 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18287194-93d1-4879-93f7-6c2d051ba474 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:03.415537 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18287194-93d1-4879-93f7-6c2d051ba474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:03.440673 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-18287194-93d1-4879-93f7-6c2d051ba474 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:03.441880 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-18287194-93d1-4879-93f7-6c2d051ba474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:03.510867 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:03.522914 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 206/396] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:32:03.551844 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d088352-0301-439d-af47-dde04ad5f679 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:03.610777 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:03.649930 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0b3bc-54de-4f6c-a28c-6616012d59f7 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:03.650254 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0b3bc-54de-4f6c-a28c-6616012d59f7 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:03.650499 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0b3bc-54de-4f6c-a28c-6616012d59f7 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:03.656242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 207/397] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:03.669366 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6788d9-f874-4833-908d-b688246da123 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:03.669943 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6788d9-f874-4833-908d-b688246da123 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:03.670428 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6788d9-f874-4833-908d-b688246da123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:03.689405 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d088352-0301-439d-af47-dde04ad5f679 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:03.700186 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-1b6788d9-f874-4833-908d-b688246da123 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:03.705617 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-1b6788d9-f874-4833-908d-b688246da123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:03.756286 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b13d6-7a63-4c5b-b2e7-9f2bd57ec447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:03.757087 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b13d6-7a63-4c5b-b2e7-9f2bd57ec447 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:03.757375 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b13d6-7a63-4c5b-b2e7-9f2bd57ec447 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:03.757651 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b13d6-7a63-4c5b-b2e7-9f2bd57ec447 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:03.784164 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b13d6-7a63-4c5b-b2e7-9f2bd57ec447 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:03.796862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-510b13d6-7a63-4c5b-b2e7-9f2bd57ec447 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:32:03.796862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:03.796862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:03.796862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:03.796862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:03.796862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:03.796862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:03.796862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:03.796862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:03.796862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:03.796862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:03.796862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:03.796862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:03.796862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:03.796862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:03.796862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:03.797935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:03.797935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:03.797935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:03.797935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:03.797935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:03.797935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:03.797935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:03.797935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:03.797935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:03.797935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:03.797935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:03.797935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:03.797935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:03.797935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:03.797935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:03.797935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:03.799005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:03.799005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:03.799005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:03.799005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:03.799005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:03.799005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:03.799005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:03.799005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:03.799005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:03.799005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:03.799005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:32:03.799005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:03.804802 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 191/398] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:32:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:32:03.810429 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b13d6-7a63-4c5b-b2e7-9f2bd57ec447 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:03.836882 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 208/399] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:32:03.883748 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6788d9-f874-4833-908d-b688246da123 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:03.974186 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b13d6-7a63-4c5b-b2e7-9f2bd57ec447 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:03.987360 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:04.039514 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e0f61-a08f-4def-aff3-2adad9dff3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:04.040312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e0f61-a08f-4def-aff3-2adad9dff3c4 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:04.040605 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e0f61-a08f-4def-aff3-2adad9dff3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:04.040910 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e0f61-a08f-4def-aff3-2adad9dff3c4 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:04.041731 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e0f61-a08f-4def-aff3-2adad9dff3c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:04.042046 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e0f61-a08f-4def-aff3-2adad9dff3c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:04.043487 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e0f61-a08f-4def-aff3-2adad9dff3c4 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:04.054511 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 192/400] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 08:32:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:32:04.055873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27b99b-2994-4c6a-87cb-52a6b3feec1a None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:04.056168 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27b99b-2994-4c6a-87cb-52a6b3feec1a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:04.056450 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27b99b-2994-4c6a-87cb-52a6b3feec1a None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:04.056964 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6788d9-f874-4833-908d-b688246da123 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:04.061875 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 193/401] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:04.062651 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27b99b-2994-4c6a-87cb-52a6b3feec1a None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:04.078467 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:04.092814 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf3471-5087-40ec-8712-a760a17e5bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:04.093702 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf3471-5087-40ec-8712-a760a17e5bd7 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:04.094059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf3471-5087-40ec-8712-a760a17e5bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:04.094979 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf3471-5087-40ec-8712-a760a17e5bd7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:04.105717 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf3471-5087-40ec-8712-a760a17e5bd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:04.115508 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-e5bf3471-5087-40ec-8712-a760a17e5bd7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:32:04.115508 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:04.115508 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:04.115508 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:04.115508 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:04.115508 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:04.115508 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:04.115508 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:04.115508 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:04.115508 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:04.115508 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:04.115508 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:04.115508 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:04.115508 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:04.115508 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:04.115508 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:04.116592 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:04.116592 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:04.116592 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:04.116592 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:04.116592 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:04.116592 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:04.116592 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:04.116592 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:04.116592 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:04.116592 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:04.116592 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:04.116592 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:04.116592 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:04.116592 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:04.116592 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:04.116592 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:04.117563 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:04.117563 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:04.117563 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:04.117563 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:04.117563 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:04.117563 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:04.117563 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:04.117563 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:04.117563 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:04.117563 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:04.117563 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:32:04.117563 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:04.120205 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 209/402] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 08:32:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:32:04.121475 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a26dd8-6464-4957-97ad-238bd0064fdb None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:04.121877 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a26dd8-6464-4957-97ad-238bd0064fdb None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:04.122230 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a26dd8-6464-4957-97ad-238bd0064fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:04.140658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-33a26dd8-6464-4957-97ad-238bd0064fdb None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:04.142413 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-33a26dd8-6464-4957-97ad-238bd0064fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:04.178069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27b99b-2994-4c6a-87cb-52a6b3feec1a None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:04.216912 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 210/403] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:32:04.217914 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a26dd8-6464-4957-97ad-238bd0064fdb None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:04.223325 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec3c63-2df7-40e0-98e1-d1cf5ecbb4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:04.224349 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec3c63-2df7-40e0-98e1-d1cf5ecbb4d9 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:04.224643 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec3c63-2df7-40e0-98e1-d1cf5ecbb4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:04.224991 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec3c63-2df7-40e0-98e1-d1cf5ecbb4d9 None admin] PATH_INFO: `/v3/groups/83422cba961044af87596a3eb738af4b` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:04.226233 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec3c63-2df7-40e0-98e1-d1cf5ecbb4d9 None admin] RBAC: Authorizing `identity:get_group(group_id=83422cba961044af87596a3eb738af4b)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:04.228382 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec3c63-2df7-40e0-98e1-d1cf5ecbb4d9 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:04.230951 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 194/404] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jul 25 08:32:04 2022] GET /identity/v3/groups/83422cba961044af87596a3eb738af4b => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:04.236754 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec3c63-2df7-40e0-98e1-d1cf5ecbb4d9 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:04.274586 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:04.330359 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a26dd8-6464-4957-97ad-238bd0064fdb None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:04.342284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:04.350754 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec3c63-2df7-40e0-98e1-d1cf5ecbb4d9 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:04.367866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977097ff-1b19-4ce9-9815-0e14583c3837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:04.368762 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977097ff-1b19-4ce9-9815-0e14583c3837 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:04.369210 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977097ff-1b19-4ce9-9815-0e14583c3837 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:04.369558 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977097ff-1b19-4ce9-9815-0e14583c3837 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:04.370384 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977097ff-1b19-4ce9-9815-0e14583c3837 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:04.370763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977097ff-1b19-4ce9-9815-0e14583c3837 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:04.372367 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977097ff-1b19-4ce9-9815-0e14583c3837 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:04.382126 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 211/405] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:32:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:04.383000 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977097ff-1b19-4ce9-9815-0e14583c3837 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:04.393147 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2207a2-01e4-404b-875c-0bea12e4076d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:04.394018 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2207a2-01e4-404b-875c-0bea12e4076d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:04.394302 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2207a2-01e4-404b-875c-0bea12e4076d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:04.394576 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2207a2-01e4-404b-875c-0bea12e4076d None admin] PATH_INFO: `/v3/projects/a941dd7311514444b64e1778320ae963` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:04.395901 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2207a2-01e4-404b-875c-0bea12e4076d None admin] RBAC: Authorizing `identity:get_project(project_id=a941dd7311514444b64e1778320ae963)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:04.397432 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2207a2-01e4-404b-875c-0bea12e4076d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:04.404054 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 195/406] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:32:04 2022] GET /identity/v3/projects/a941dd7311514444b64e1778320ae963 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:32:04.405760 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2207a2-01e4-404b-875c-0bea12e4076d None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:04.496508 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977097ff-1b19-4ce9-9815-0e14583c3837 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:04.516787 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2207a2-01e4-404b-875c-0bea12e4076d None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:04.519598 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:04.535534 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0448576-a3c3-402c-8a08-5d1c7419e6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:04.536367 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0448576-a3c3-402c-8a08-5d1c7419e6ba None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:04.536652 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0448576-a3c3-402c-8a08-5d1c7419e6ba None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:04.536931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0448576-a3c3-402c-8a08-5d1c7419e6ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:04.548171 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0448576-a3c3-402c-8a08-5d1c7419e6ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:04.553972 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9782c-3e94-43b8-afe9-edb99646b3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:04.554990 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9782c-3e94-43b8-afe9-edb99646b3d6 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:04.555433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9782c-3e94-43b8-afe9-edb99646b3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:04.555889 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9782c-3e94-43b8-afe9-edb99646b3d6 None admin] PATH_INFO: `/v3/groups/83422cba961044af87596a3eb738af4b` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:04.556137 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-a0448576-a3c3-402c-8a08-5d1c7419e6ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:32:04.556137 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:04.556137 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:04.556137 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:04.556137 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:04.556137 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:04.556137 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:04.556137 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:04.556137 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:04.556137 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:04.556137 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:04.556137 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:04.556137 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:04.556137 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:04.556137 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:04.556137 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:04.557176 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:04.557176 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:04.557176 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:04.557176 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:04.557176 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:04.557176 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:04.557176 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:04.557176 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:04.557176 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:04.557176 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:04.557176 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:04.557176 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:04.557176 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:04.557176 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:04.557176 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:04.557176 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:04.558012 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:04.558012 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:04.558012 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:04.558012 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:04.558012 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:04.558012 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:04.558012 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:04.558012 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:04.558012 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:04.558012 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:04.558012 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:32:04.558012 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:04.558012 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 212/407] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:32:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:04.558658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0448576-a3c3-402c-8a08-5d1c7419e6ba None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:04.560120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f9782c-3e94-43b8-afe9-edb99646b3d6 None admin] RBAC: Authorizing `identity:get_group(group_id=83422cba961044af87596a3eb738af4b)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:04.561791 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f9782c-3e94-43b8-afe9-edb99646b3d6 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:04.569647 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 196/408] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jul 25 08:32:04 2022] GET /identity/v3/groups/83422cba961044af87596a3eb738af4b => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:04.570973 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9782c-3e94-43b8-afe9-edb99646b3d6 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:04.594526 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:04.670604 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0448576-a3c3-402c-8a08-5d1c7419e6ba None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:04.679706 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9782c-3e94-43b8-afe9-edb99646b3d6 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:04.714291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11934a7-5067-4f57-9d83-1346dfbd6c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:04.715507 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11934a7-5067-4f57-9d83-1346dfbd6c2c None admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:04.715942 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11934a7-5067-4f57-9d83-1346dfbd6c2c None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:04.716358 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11934a7-5067-4f57-9d83-1346dfbd6c2c None admin] PATH_INFO: `/v3/projects/a941dd7311514444b64e1778320ae963/groups/83422cba961044af87596a3eb738af4b/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:04.717099 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4c22b-5030-4845-b8f8-977b22683c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:04.717936 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4c22b-5030-4845-b8f8-977b22683c9e None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:04.718401 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4c22b-5030-4845-b8f8-977b22683c9e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:04.718852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4c22b-5030-4845-b8f8-977b22683c9e None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:04.718960 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11934a7-5067-4f57-9d83-1346dfbd6c2c None admin] RBAC: Authorizing `identity:create_grant(project_id=a941dd7311514444b64e1778320ae963, group_id=83422cba961044af87596a3eb738af4b, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:04.719944 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4c22b-5030-4845-b8f8-977b22683c9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:04.720428 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4c22b-5030-4845-b8f8-977b22683c9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:04.720809 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11934a7-5067-4f57-9d83-1346dfbd6c2c None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:04.722145 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4c22b-5030-4845-b8f8-977b22683c9e None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:04.731555 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 197/409] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:32:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:04.732682 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4c22b-5030-4845-b8f8-977b22683c9e None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:04.773527 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:04.828010 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 213/410] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Jul 25 08:32:04 2022] PUT /identity/v3/projects/a941dd7311514444b64e1778320ae963/groups/83422cba961044af87596a3eb738af4b/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:32:04.830068 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11934a7-5067-4f57-9d83-1346dfbd6c2c None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:04.863641 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4c22b-5030-4845-b8f8-977b22683c9e None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:04.944492 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cab874-2074-45c4-a993-ad7eae627d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:04.945798 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cab874-2074-45c4-a993-ad7eae627d34 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:04.946310 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cab874-2074-45c4-a993-ad7eae627d34 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:04.946803 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cab874-2074-45c4-a993-ad7eae627d34 None admin] PATH_INFO: `/v3/projects/a941dd7311514444b64e1778320ae963` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:04.948512 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cab874-2074-45c4-a993-ad7eae627d34 None admin] RBAC: Authorizing `identity:get_project(project_id=a941dd7311514444b64e1778320ae963)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:04.950254 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cab874-2074-45c4-a993-ad7eae627d34 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:04.953136 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 198/411] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:32:04 2022] GET /identity/v3/projects/a941dd7311514444b64e1778320ae963 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:04.960163 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cab874-2074-45c4-a993-ad7eae627d34 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:05.039446 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:05.052280 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11934a7-5067-4f57-9d83-1346dfbd6c2c None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:05.093537 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15946a-dd28-4b56-a948-5c541b291600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:05.094918 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15946a-dd28-4b56-a948-5c541b291600 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:05.095419 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15946a-dd28-4b56-a948-5c541b291600 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:05.097742 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15946a-dd28-4b56-a948-5c541b291600 None admin] PATH_INFO: `/v3/groups/3e749e9c937e4cb5a2e8560336dfcf1b` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:05.099330 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15946a-dd28-4b56-a948-5c541b291600 None admin] RBAC: Authorizing `identity:get_group(group_id=3e749e9c937e4cb5a2e8560336dfcf1b)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:05.101123 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15946a-dd28-4b56-a948-5c541b291600 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:05.103293 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 214/412] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jul 25 08:32:04 2022] GET /identity/v3/groups/3e749e9c937e4cb5a2e8560336dfcf1b => generated 229 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:05.108943 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15946a-dd28-4b56-a948-5c541b291600 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:05.120896 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cab874-2074-45c4-a993-ad7eae627d34 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:05.122942 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:05.180845 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea21e8-3dcd-4320-bb93-0556da82c701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:05.181979 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea21e8-3dcd-4320-bb93-0556da82c701 None admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:05.182266 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea21e8-3dcd-4320-bb93-0556da82c701 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:05.182542 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea21e8-3dcd-4320-bb93-0556da82c701 None admin] PATH_INFO: `/v3/projects/a941dd7311514444b64e1778320ae963/groups/83422cba961044af87596a3eb738af4b/roles/be32d79ae2964b4b93a1efff3a9aa70b` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:05.185432 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea21e8-3dcd-4320-bb93-0556da82c701 None admin] RBAC: Authorizing `identity:create_grant(project_id=a941dd7311514444b64e1778320ae963, group_id=83422cba961044af87596a3eb738af4b, role_id=be32d79ae2964b4b93a1efff3a9aa70b)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:05.187149 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea21e8-3dcd-4320-bb93-0556da82c701 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:05.235789 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15946a-dd28-4b56-a948-5c541b291600 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:05.259927 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 199/413] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Jul 25 08:32:04 2022] PUT /identity/v3/projects/a941dd7311514444b64e1778320ae963/groups/83422cba961044af87596a3eb738af4b/roles/be32d79ae2964b4b93a1efff3a9aa70b => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:32:05.262336 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46347caf-de5e-48d6-a452-e8f26d1acedf None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:05.263126 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46347caf-de5e-48d6-a452-e8f26d1acedf None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:05.263643 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46347caf-de5e-48d6-a452-e8f26d1acedf None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:05.266474 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 200/414] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:05.275824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ac37a-f1f4-4637-815d-d68e1cb8a0f5 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:05.275824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ac37a-f1f4-4637-815d-d68e1cb8a0f5 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:05.275824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ac37a-f1f4-4637-815d-d68e1cb8a0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:05.282455 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08e8f3-8bb7-42d8-91cc-778acd7e281b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:05.283717 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08e8f3-8bb7-42d8-91cc-778acd7e281b None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:05.284502 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08e8f3-8bb7-42d8-91cc-778acd7e281b None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:05.284926 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08e8f3-8bb7-42d8-91cc-778acd7e281b None admin] PATH_INFO: `/v3/projects/dc9626b4086645e5810dd68fb6d20d03` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:05.286582 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc08e8f3-8bb7-42d8-91cc-778acd7e281b None admin] RBAC: Authorizing `identity:get_project(project_id=dc9626b4086645e5810dd68fb6d20d03)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:05.288377 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc08e8f3-8bb7-42d8-91cc-778acd7e281b None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:05.290906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 215/415] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:32:05 2022] GET /identity/v3/projects/dc9626b4086645e5810dd68fb6d20d03 => generated 344 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:05.304718 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08e8f3-8bb7-42d8-91cc-778acd7e281b None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:05.309771 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-8d8ac37a-f1f4-4637-815d-d68e1cb8a0f5 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:05.311123 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-8d8ac37a-f1f4-4637-815d-d68e1cb8a0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:05.369283 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:05.429837 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 201/416] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:32:05.460239 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ac37a-f1f4-4637-815d-d68e1cb8a0f5 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:05.475419 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08e8f3-8bb7-42d8-91cc-778acd7e281b None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:05.516948 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040e08c-95fb-4f3f-8070-c498603663de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:05.518193 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040e08c-95fb-4f3f-8070-c498603663de None admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:05.518478 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040e08c-95fb-4f3f-8070-c498603663de None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:05.518754 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040e08c-95fb-4f3f-8070-c498603663de None admin] PATH_INFO: `/v3/projects/dc9626b4086645e5810dd68fb6d20d03/groups/3e749e9c937e4cb5a2e8560336dfcf1b/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:05.520761 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040e08c-95fb-4f3f-8070-c498603663de None admin] RBAC: Authorizing `identity:create_grant(project_id=dc9626b4086645e5810dd68fb6d20d03, group_id=3e749e9c937e4cb5a2e8560336dfcf1b, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:05.522198 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040e08c-95fb-4f3f-8070-c498603663de None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:05.565176 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:05.574919 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ac37a-f1f4-4637-815d-d68e1cb8a0f5 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:05.584138 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 216/417] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Jul 25 08:32:05 2022] PUT /identity/v3/projects/dc9626b4086645e5810dd68fb6d20d03/groups/3e749e9c937e4cb5a2e8560336dfcf1b/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:32:05.592772 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a0ec7-07ea-4ee7-8672-5488a128fba4 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:05.593172 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a0ec7-07ea-4ee7-8672-5488a128fba4 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:05.593438 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a0ec7-07ea-4ee7-8672-5488a128fba4 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:05.599373 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 217/418] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:05 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:05.605162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85b739-29cb-4533-a5f2-6ab3d21fd3a1 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:05.608794 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85b739-29cb-4533-a5f2-6ab3d21fd3a1 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:05.608794 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85b739-29cb-4533-a5f2-6ab3d21fd3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:05.619599 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa1547-18f0-4577-9c32-ac77b6c2b582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:05.620918 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa1547-18f0-4577-9c32-ac77b6c2b582 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:05.621810 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa1547-18f0-4577-9c32-ac77b6c2b582 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:05.622336 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa1547-18f0-4577-9c32-ac77b6c2b582 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:05.636653 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa1547-18f0-4577-9c32-ac77b6c2b582 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:05.648495 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-eb85b739-29cb-4533-a5f2-6ab3d21fd3a1 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:05.650178 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-eb85b739-29cb-4533-a5f2-6ab3d21fd3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:05.651298 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-3baa1547-18f0-4577-9c32-ac77b6c2b582 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:32:05.651298 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:05.651298 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:05.651298 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:05.651298 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:05.651298 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:05.651298 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:05.651298 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:05.651298 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:05.651298 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:05.651298 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:05.651298 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:05.651298 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:05.651298 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:05.651298 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:05.651298 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:05.652215 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:05.652215 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:05.652215 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:05.652215 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:05.652215 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:05.652215 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:05.652215 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:05.652215 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:05.652215 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:05.652215 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:05.652215 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:05.652215 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:05.652215 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:05.652215 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:05.652215 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:05.652215 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:05.653010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:05.653010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:05.653010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:05.653010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:05.653010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:05.653010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:05.653010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:05.653010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:05.653010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:05.653010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:05.653010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:32:05.653010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:05.656332 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 202/419] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 08:32:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:32:05.664743 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa1547-18f0-4577-9c32-ac77b6c2b582 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:05.818961 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa1547-18f0-4577-9c32-ac77b6c2b582 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:05.819540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 218/420] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:32:05.845229 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85b739-29cb-4533-a5f2-6ab3d21fd3a1 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:05.856192 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bba40a-4d85-45ec-ac91-efa6a71ba826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:05.857173 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bba40a-4d85-45ec-ac91-efa6a71ba826 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:05.857680 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bba40a-4d85-45ec-ac91-efa6a71ba826 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:05.858265 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bba40a-4d85-45ec-ac91-efa6a71ba826 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:05.859265 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bba40a-4d85-45ec-ac91-efa6a71ba826 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:05.859858 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bba40a-4d85-45ec-ac91-efa6a71ba826 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:05.861661 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bba40a-4d85-45ec-ac91-efa6a71ba826 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:05.864271 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:05.871042 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 203/421] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:32:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:05.876616 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bba40a-4d85-45ec-ac91-efa6a71ba826 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:05.897302 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:05.983513 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85b739-29cb-4533-a5f2-6ab3d21fd3a1 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:06.042628 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bba40a-4d85-45ec-ac91-efa6a71ba826 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:06.052166 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3add8c0-2d8d-42ae-aa33-4303fc1f5ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:06.053552 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3add8c0-2d8d-42ae-aa33-4303fc1f5ab8 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:06.053977 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3add8c0-2d8d-42ae-aa33-4303fc1f5ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:06.054391 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3add8c0-2d8d-42ae-aa33-4303fc1f5ab8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:06.070801 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3add8c0-2d8d-42ae-aa33-4303fc1f5ab8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:06.079269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-e3add8c0-2d8d-42ae-aa33-4303fc1f5ab8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:32:06.079269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:06.079269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:06.079269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:06.079269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:06.079269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:06.079269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:06.079269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:06.079269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:06.079269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:06.079269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:06.079269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:06.079269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:06.079269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:06.079269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:06.079269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:06.080391 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:06.080391 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:06.080391 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:06.080391 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:06.080391 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:06.080391 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:06.080391 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:06.080391 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:06.080391 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:06.080391 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:06.080391 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:06.080391 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:06.080391 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:06.080391 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:06.080391 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:06.080391 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:06.081370 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:06.081370 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:06.081370 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:06.081370 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:06.081370 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:06.081370 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:06.081370 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:06.081370 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:06.081370 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:06.081370 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:06.081370 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:32:06.081370 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:06.090680 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 219/422] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:32:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:32:06.097966 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3add8c0-2d8d-42ae-aa33-4303fc1f5ab8 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:06.122524 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc0e13-a329-4254-8d7a-e256ee47f5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:06.123417 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc0e13-a329-4254-8d7a-e256ee47f5e9 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:06.123899 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc0e13-a329-4254-8d7a-e256ee47f5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:06.124334 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc0e13-a329-4254-8d7a-e256ee47f5e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:06.233134 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:06.246075 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc0e13-a329-4254-8d7a-e256ee47f5e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:06.247560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc0e13-a329-4254-8d7a-e256ee47f5e9 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:06.274419 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:06.278681 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3add8c0-2d8d-42ae-aa33-4303fc1f5ab8 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:06.346218 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56430bd-7d4c-4956-8ba3-1aec92c4ab40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:06.346808 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56430bd-7d4c-4956-8ba3-1aec92c4ab40 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:06.347093 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56430bd-7d4c-4956-8ba3-1aec92c4ab40 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:06.347375 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56430bd-7d4c-4956-8ba3-1aec92c4ab40 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:06.348163 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56430bd-7d4c-4956-8ba3-1aec92c4ab40 None admin] RBAC: Adding query filter params (name=member) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:06.348475 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56430bd-7d4c-4956-8ba3-1aec92c4ab40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:06.349949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56430bd-7d4c-4956-8ba3-1aec92c4ab40 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:06.368644 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 220/423] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 08:32:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:06.374217 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56430bd-7d4c-4956-8ba3-1aec92c4ab40 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:06.440180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 204/424] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:32:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 08:32:06.446444 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc0e13-a329-4254-8d7a-e256ee47f5e9 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:06.563764 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56430bd-7d4c-4956-8ba3-1aec92c4ab40 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:06.619511 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc0e13-a329-4254-8d7a-e256ee47f5e9 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:06.630386 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb030b9-b66e-4812-83c9-18f6b37afe5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:06.631046 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb030b9-b66e-4812-83c9-18f6b37afe5a None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:06.631328 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb030b9-b66e-4812-83c9-18f6b37afe5a None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:06.631602 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb030b9-b66e-4812-83c9-18f6b37afe5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:06.646372 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:06.654283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:06.686085 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db43f2d-f942-40e8-acb2-c5a60152e6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:06.686952 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db43f2d-f942-40e8-acb2-c5a60152e6df None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:06.687238 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db43f2d-f942-40e8-acb2-c5a60152e6df None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:06.687521 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db43f2d-f942-40e8-acb2-c5a60152e6df None admin] PATH_INFO: `/v3/projects/65208cd21fc9480e843b073170fa9fff` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:06.692396 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db43f2d-f942-40e8-acb2-c5a60152e6df None admin] RBAC: Authorizing `identity:get_project(project_id=65208cd21fc9480e843b073170fa9fff)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:06.693855 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db43f2d-f942-40e8-acb2-c5a60152e6df None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:06.700400 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 205/425] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:32:06 2022] GET /identity/v3/projects/65208cd21fc9480e843b073170fa9fff => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:06.701687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db43f2d-f942-40e8-acb2-c5a60152e6df None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:06.758107 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb030b9-b66e-4812-83c9-18f6b37afe5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:06.759566 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb030b9-b66e-4812-83c9-18f6b37afe5a None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:06.866895 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db43f2d-f942-40e8-acb2-c5a60152e6df None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:06.904808 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32201932-93df-4fbe-99ee-ceccb6fee7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:06.905639 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32201932-93df-4fbe-99ee-ceccb6fee7d8 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:06.905926 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32201932-93df-4fbe-99ee-ceccb6fee7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:06.906199 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32201932-93df-4fbe-99ee-ceccb6fee7d8 None admin] PATH_INFO: `/v3/groups/83422cba961044af87596a3eb738af4b` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:06.908003 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32201932-93df-4fbe-99ee-ceccb6fee7d8 None admin] RBAC: Authorizing `identity:get_group(group_id=83422cba961044af87596a3eb738af4b)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:06.909745 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32201932-93df-4fbe-99ee-ceccb6fee7d8 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:06.911759 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 206/426] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jul 25 08:32:06 2022] GET /identity/v3/groups/83422cba961044af87596a3eb738af4b => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:32:06.918361 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32201932-93df-4fbe-99ee-ceccb6fee7d8 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:06.939808 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 221/427] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:32:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 08:32:06.948616 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb030b9-b66e-4812-83c9-18f6b37afe5a None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:06.988088 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:06.995260 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:07.029679 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32201932-93df-4fbe-99ee-ceccb6fee7d8 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:07.073865 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a6a18-056d-46ac-95a8-eae35710bd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:07.074529 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a6a18-056d-46ac-95a8-eae35710bd35 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:07.076673 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a6a18-056d-46ac-95a8-eae35710bd35 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:07.076673 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a6a18-056d-46ac-95a8-eae35710bd35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:07.076673 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a6a18-056d-46ac-95a8-eae35710bd35 None admin] RBAC: Adding query filter params (group.id=83422cba961044af87596a3eb738af4b, role.id=be32d79ae2964b4b93a1efff3a9aa70b, scope.project.id=65208cd21fc9480e843b073170fa9fff) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:07.076673 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a6a18-056d-46ac-95a8-eae35710bd35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:07.078829 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a6a18-056d-46ac-95a8-eae35710bd35 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:07.085982 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 207/428] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Jul 25 08:32:06 2022] GET /identity/v3/role_assignments?group.id=83422cba961044af87596a3eb738af4b&scope.project.id=65208cd21fc9480e843b073170fa9fff&role.id=be32d79ae2964b4b93a1efff3a9aa70b => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:32:07.106611 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb030b9-b66e-4812-83c9-18f6b37afe5a None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:07.146390 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fff45-34e3-4e0e-a49d-10920ddd7b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:07.147277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fff45-34e3-4e0e-a49d-10920ddd7b50 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:07.147562 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fff45-34e3-4e0e-a49d-10920ddd7b50 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:07.147875 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fff45-34e3-4e0e-a49d-10920ddd7b50 None admin] PATH_INFO: `/v3/projects/65208cd21fc9480e843b073170fa9fff` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:07.149193 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4fff45-34e3-4e0e-a49d-10920ddd7b50 None admin] RBAC: Authorizing `identity:get_project(project_id=65208cd21fc9480e843b073170fa9fff)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:07.150860 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4fff45-34e3-4e0e-a49d-10920ddd7b50 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:07.152903 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 222/429] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:32:06 2022] GET /identity/v3/projects/65208cd21fc9480e843b073170fa9fff => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:07.160794 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a6a18-056d-46ac-95a8-eae35710bd35 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:07.292481 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a6a18-056d-46ac-95a8-eae35710bd35 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:07.308444 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:07.331121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1fb33-e840-4fe5-aae6-fc6ff65b6589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:07.332023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1fb33-e840-4fe5-aae6-fc6ff65b6589 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:07.332308 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1fb33-e840-4fe5-aae6-fc6ff65b6589 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:07.332588 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1fb33-e840-4fe5-aae6-fc6ff65b6589 None admin] PATH_INFO: `/v3/groups/83422cba961044af87596a3eb738af4b` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:07.333831 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1fb33-e840-4fe5-aae6-fc6ff65b6589 None admin] RBAC: Authorizing `identity:get_group(group_id=83422cba961044af87596a3eb738af4b)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:07.335341 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1fb33-e840-4fe5-aae6-fc6ff65b6589 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:07.337303 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 208/430] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jul 25 08:32:07 2022] GET /identity/v3/groups/83422cba961044af87596a3eb738af4b => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:07.343217 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fff45-34e3-4e0e-a49d-10920ddd7b50 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:07.441199 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cb60f-47d8-49fe-bd89-a286a5be6b95 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:07.441763 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cb60f-47d8-49fe-bd89-a286a5be6b95 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:07.442216 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cb60f-47d8-49fe-bd89-a286a5be6b95 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:07.444023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 209/431] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:07.454527 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f1b8f-478f-4f2d-bc68-c7a1fefbe935 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:07.455238 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f1b8f-478f-4f2d-bc68-c7a1fefbe935 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:07.455749 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f1b8f-478f-4f2d-bc68-c7a1fefbe935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:07.465275 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fff45-34e3-4e0e-a49d-10920ddd7b50 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:07.483257 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-8f7f1b8f-478f-4f2d-bc68-c7a1fefbe935 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:07.484806 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-8f7f1b8f-478f-4f2d-bc68-c7a1fefbe935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:07.488856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:07.501353 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7817f-baf5-4093-9412-6df92575ada8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:07.502011 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7817f-baf5-4093-9412-6df92575ada8 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:07.502293 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7817f-baf5-4093-9412-6df92575ada8 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:07.502564 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7817f-baf5-4093-9412-6df92575ada8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:07.503392 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7817f-baf5-4093-9412-6df92575ada8 None admin] RBAC: Adding query filter params (group.id=83422cba961044af87596a3eb738af4b, role.id=2cb5ed3eb0484858a5f7cbdce69092ed, scope.project.id=65208cd21fc9480e843b073170fa9fff) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:07.503727 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7817f-baf5-4093-9412-6df92575ada8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:07.505170 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7817f-baf5-4093-9412-6df92575ada8 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:07.511353 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 223/432] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Jul 25 08:32:07 2022] GET /identity/v3/role_assignments?group.id=83422cba961044af87596a3eb738af4b&scope.project.id=65208cd21fc9480e843b073170fa9fff&role.id=2cb5ed3eb0484858a5f7cbdce69092ed => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:07.546115 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0885e2-4bd0-4620-9442-2f94547cefe9 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:07.546437 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0885e2-4bd0-4620-9442-2f94547cefe9 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:07.546723 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0885e2-4bd0-4620-9442-2f94547cefe9 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:07.549212 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 224/433] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:32:07.554987 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a5410-f4a6-4b27-9fcd-42ba7f471942 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:07.555278 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a5410-f4a6-4b27-9fcd-42ba7f471942 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:07.555558 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a5410-f4a6-4b27-9fcd-42ba7f471942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:07.572851 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 210/434] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:32:07.578331 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-970a5410-f4a6-4b27-9fcd-42ba7f471942 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:07.580720 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-970a5410-f4a6-4b27-9fcd-42ba7f471942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:07.596772 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f1b8f-478f-4f2d-bc68-c7a1fefbe935 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:07.676015 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 225/435] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:32:07.694236 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a5410-f4a6-4b27-9fcd-42ba7f471942 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:07.739525 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f1b8f-478f-4f2d-bc68-c7a1fefbe935 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:07.755907 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:07.792522 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8f03c-b1b4-4880-9dbc-6c4be508853e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:07.793343 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8f03c-b1b4-4880-9dbc-6c4be508853e None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:07.793682 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8f03c-b1b4-4880-9dbc-6c4be508853e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:07.793965 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8f03c-b1b4-4880-9dbc-6c4be508853e None admin] PATH_INFO: `/v3/roles/member` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:07.810967 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8f03c-b1b4-4880-9dbc-6c4be508853e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:07.822181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-d3a8f03c-b1b4-4880-9dbc-6c4be508853e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:32:07.822181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:07.822181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:07.822181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:07.822181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:07.822181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:07.822181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:07.822181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:07.822181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:07.822181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:07.822181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:07.822181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:07.822181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:07.822181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:07.822181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:07.822181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:07.823101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:07.823101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:07.823101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:07.823101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:07.823101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:07.823101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:07.823101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:07.823101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:07.823101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:07.823101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:07.823101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:07.823101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:07.823101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:07.823101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:07.823101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:07.823101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:07.823953 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:07.823953 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:07.823953 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:07.823953 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:07.823953 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:07.823953 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:07.823953 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:07.823953 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:07.823953 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:07.823953 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:07.823953 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 08:32:07.823953 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:07.826666 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 211/436] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:32:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:32:07.830795 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8f03c-b1b4-4880-9dbc-6c4be508853e None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:07.832015 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a5410-f4a6-4b27-9fcd-42ba7f471942 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:07.833734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:07.878614 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6556cbd-af71-4510-aedb-850c2ed47e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:07.879794 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6556cbd-af71-4510-aedb-850c2ed47e24 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:07.880234 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6556cbd-af71-4510-aedb-850c2ed47e24 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:07.880678 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6556cbd-af71-4510-aedb-850c2ed47e24 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:07.893799 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6556cbd-af71-4510-aedb-850c2ed47e24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:07.902291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-e6556cbd-af71-4510-aedb-850c2ed47e24 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:32:07.902291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:07.902291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:07.902291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:07.902291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:07.902291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:07.902291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:07.902291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:07.902291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:07.902291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:07.902291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:07.902291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:07.902291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:07.902291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:07.902291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:07.902291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:07.903201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:07.903201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:07.903201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:07.903201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:07.903201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:07.903201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:07.903201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:07.903201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:07.903201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:07.903201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:07.903201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:07.903201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:07.903201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:07.903201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:07.903201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:07.903201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:07.904041 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:07.904041 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:07.904041 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:07.904041 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:07.904041 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:07.904041 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:07.904041 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:07.904041 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:07.904041 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:07.904041 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:07.904041 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:32:07.904041 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:07.904649 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 226/437] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 08:32:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:32:07.910012 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6556cbd-af71-4510-aedb-850c2ed47e24 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:07.973023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8f03c-b1b4-4880-9dbc-6c4be508853e None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:08.016867 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e777db-17f6-4f1f-a797-1e55352bbe12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:08.017545 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e777db-17f6-4f1f-a797-1e55352bbe12 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:08.017830 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e777db-17f6-4f1f-a797-1e55352bbe12 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:08.018106 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e777db-17f6-4f1f-a797-1e55352bbe12 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:08.018864 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e777db-17f6-4f1f-a797-1e55352bbe12 None admin] RBAC: Adding query filter params (name=member) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:08.019172 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e777db-17f6-4f1f-a797-1e55352bbe12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:08.020659 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e777db-17f6-4f1f-a797-1e55352bbe12 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:08.034033 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 212/438] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 08:32:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:08.040041 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e777db-17f6-4f1f-a797-1e55352bbe12 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:08.043802 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6556cbd-af71-4510-aedb-850c2ed47e24 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:08.081992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:08.084924 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ab58d-8613-45ab-b3d0-e233ed6bf873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:08.085630 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ab58d-8613-45ab-b3d0-e233ed6bf873 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:08.085919 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ab58d-8613-45ab-b3d0-e233ed6bf873 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:08.086196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ab58d-8613-45ab-b3d0-e233ed6bf873 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:08.086955 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ab58d-8613-45ab-b3d0-e233ed6bf873 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:08.087295 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ab58d-8613-45ab-b3d0-e233ed6bf873 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:08.088787 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ab58d-8613-45ab-b3d0-e233ed6bf873 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:08.098187 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 227/439] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:32:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:08.099870 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691b8cb-011b-45c6-b655-4017030ffe05 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:08.100329 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691b8cb-011b-45c6-b655-4017030ffe05 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:08.101720 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691b8cb-011b-45c6-b655-4017030ffe05 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:08.102006 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 228/440] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:08.104572 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691b8cb-011b-45c6-b655-4017030ffe05 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:08.138901 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:08.173705 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e777db-17f6-4f1f-a797-1e55352bbe12 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:08.210255 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac05a8c-c180-4b60-bd46-af48ee8750da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:08.210902 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac05a8c-c180-4b60-bd46-af48ee8750da None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:08.211183 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac05a8c-c180-4b60-bd46-af48ee8750da None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:08.211455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac05a8c-c180-4b60-bd46-af48ee8750da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:08.227945 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691b8cb-011b-45c6-b655-4017030ffe05 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:08.260457 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053515c-c2d5-4e0f-8236-4beda7ea35c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:08.261097 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053515c-c2d5-4e0f-8236-4beda7ea35c4 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:08.261385 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053515c-c2d5-4e0f-8236-4beda7ea35c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:08.261666 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053515c-c2d5-4e0f-8236-4beda7ea35c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:08.278044 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac05a8c-c180-4b60-bd46-af48ee8750da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:08.279486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac05a8c-c180-4b60-bd46-af48ee8750da None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:08.311794 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:08.329187 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053515c-c2d5-4e0f-8236-4beda7ea35c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:08.330634 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053515c-c2d5-4e0f-8236-4beda7ea35c4 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:08.355112 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:08.377648 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 213/441] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:32:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 08:32:08.379055 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564afb0-1a6f-441a-b5d7-426a05bc4756 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:08.379352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564afb0-1a6f-441a-b5d7-426a05bc4756 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:08.379651 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564afb0-1a6f-441a-b5d7-426a05bc4756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:08.397423 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-8564afb0-1a6f-441a-b5d7-426a05bc4756 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:08.398608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-8564afb0-1a6f-441a-b5d7-426a05bc4756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:08.430620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 229/442] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:32:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 08:32:08.430620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053515c-c2d5-4e0f-8236-4beda7ea35c4 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:08.470728 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 214/443] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:32:08.471563 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564afb0-1a6f-441a-b5d7-426a05bc4756 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:08.531602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:08.532732 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053515c-c2d5-4e0f-8236-4beda7ea35c4 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:08.555581 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:08.566783 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d422e-fc95-4067-9762-4ef0af9ab491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:08.567663 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d422e-fc95-4067-9762-4ef0af9ab491 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:08.567943 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d422e-fc95-4067-9762-4ef0af9ab491 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:08.568283 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d422e-fc95-4067-9762-4ef0af9ab491 None admin] PATH_INFO: `/v3/projects/a941dd7311514444b64e1778320ae963` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:08.569541 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d422e-fc95-4067-9762-4ef0af9ab491 None admin] RBAC: Authorizing `identity:get_project(project_id=a941dd7311514444b64e1778320ae963)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:08.570974 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d422e-fc95-4067-9762-4ef0af9ab491 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:08.571207 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564afb0-1a6f-441a-b5d7-426a05bc4756 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:08.572706 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 230/444] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:32:08 2022] GET /identity/v3/projects/a941dd7311514444b64e1778320ae963 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:08.574016 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d422e-fc95-4067-9762-4ef0af9ab491 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:08.605560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc372e-0329-4977-bee3-9fd9929a17c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:08.606429 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc372e-0329-4977-bee3-9fd9929a17c1 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:08.606712 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc372e-0329-4977-bee3-9fd9929a17c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:08.606981 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc372e-0329-4977-bee3-9fd9929a17c1 None admin] PATH_INFO: `/v3/projects/a941dd7311514444b64e1778320ae963` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:08.608178 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc372e-0329-4977-bee3-9fd9929a17c1 None admin] RBAC: Authorizing `identity:get_project(project_id=a941dd7311514444b64e1778320ae963)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:08.609596 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc372e-0329-4977-bee3-9fd9929a17c1 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:08.611953 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 215/445] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:32:08 2022] GET /identity/v3/projects/a941dd7311514444b64e1778320ae963 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:08.612702 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc372e-0329-4977-bee3-9fd9929a17c1 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:08.676437 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d422e-fc95-4067-9762-4ef0af9ab491 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:08.713034 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc372e-0329-4977-bee3-9fd9929a17c1 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:08.716257 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6daed40-9489-4b0b-97b1-a457cd4757ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:08.717050 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6daed40-9489-4b0b-97b1-a457cd4757ab None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:08.717330 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6daed40-9489-4b0b-97b1-a457cd4757ab None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:08.717602 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6daed40-9489-4b0b-97b1-a457cd4757ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:08.728055 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6daed40-9489-4b0b-97b1-a457cd4757ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:08.736277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-e6daed40-9489-4b0b-97b1-a457cd4757ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:32:08.736277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:08.736277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:08.736277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:08.736277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:08.736277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:08.736277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:08.736277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:08.736277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:08.736277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:08.736277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:08.736277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:08.736277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:08.736277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:08.736277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:08.736277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:08.737167 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:08.737167 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:08.737167 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:08.737167 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:08.737167 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:08.737167 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:08.737167 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:08.737167 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:08.737167 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:08.737167 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:08.737167 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:08.737167 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:08.737167 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:08.737167 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:08.737167 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:08.737167 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:08.737951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:08.737951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:08.737951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:08.737951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:08.737951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:08.737951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:08.737951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:08.737951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:08.737951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:08.737951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:08.737951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:32:08.737951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:08.737951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 231/446] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:32:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:08.738598 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6daed40-9489-4b0b-97b1-a457cd4757ab None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:08.747424 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:08.753203 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090c3e3-3389-4ddd-8946-4a71661a245d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:08.754062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090c3e3-3389-4ddd-8946-4a71661a245d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:08.754430 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090c3e3-3389-4ddd-8946-4a71661a245d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:08.754616 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090c3e3-3389-4ddd-8946-4a71661a245d None admin] PATH_INFO: `/v3/groups/83422cba961044af87596a3eb738af4b` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:08.757696 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090c3e3-3389-4ddd-8946-4a71661a245d None admin] RBAC: Authorizing `identity:get_group(group_id=83422cba961044af87596a3eb738af4b)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:08.757696 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090c3e3-3389-4ddd-8946-4a71661a245d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:08.759086 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 216/447] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jul 25 08:32:08 2022] GET /identity/v3/groups/83422cba961044af87596a3eb738af4b => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:08.759862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090c3e3-3389-4ddd-8946-4a71661a245d None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:08.790666 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:08.838325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6daed40-9489-4b0b-97b1-a457cd4757ab None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:08.860689 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090c3e3-3389-4ddd-8946-4a71661a245d None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:08.871631 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5f289-6ac3-4b37-84f3-edfb5686e41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:08.872492 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5f289-6ac3-4b37-84f3-edfb5686e41a None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:08.872773 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5f289-6ac3-4b37-84f3-edfb5686e41a None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:08.873050 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5f289-6ac3-4b37-84f3-edfb5686e41a None admin] PATH_INFO: `/v3/groups/83422cba961044af87596a3eb738af4b` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:08.874209 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc5f289-6ac3-4b37-84f3-edfb5686e41a None admin] RBAC: Authorizing `identity:get_group(group_id=83422cba961044af87596a3eb738af4b)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:08.876328 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc5f289-6ac3-4b37-84f3-edfb5686e41a None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:08.877930 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 232/448] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jul 25 08:32:08 2022] GET /identity/v3/groups/83422cba961044af87596a3eb738af4b => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:08.878677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5f289-6ac3-4b37-84f3-edfb5686e41a None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:08.899318 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c27b2-3de0-48cb-8c61-c8caa16f3cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:08.900042 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c27b2-3de0-48cb-8c61-c8caa16f3cf8 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:08.900333 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c27b2-3de0-48cb-8c61-c8caa16f3cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:08.900615 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c27b2-3de0-48cb-8c61-c8caa16f3cf8 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:08.901374 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c27b2-3de0-48cb-8c61-c8caa16f3cf8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:08.901685 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c27b2-3de0-48cb-8c61-c8caa16f3cf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:08.903053 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c27b2-3de0-48cb-8c61-c8caa16f3cf8 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:08.911543 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 217/449] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:32:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:08.912495 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c27b2-3de0-48cb-8c61-c8caa16f3cf8 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:08.974364 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:08.975419 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5f289-6ac3-4b37-84f3-edfb5686e41a None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:08.995383 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:09.009424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8589834-e6e5-4451-97e8-d35945da88a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:09.010077 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8589834-e6e5-4451-97e8-d35945da88a6 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:09.010367 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8589834-e6e5-4451-97e8-d35945da88a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:09.010645 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8589834-e6e5-4451-97e8-d35945da88a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:09.011479 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8589834-e6e5-4451-97e8-d35945da88a6 None admin] RBAC: Adding query filter params (group.id=83422cba961044af87596a3eb738af4b, role.id=2cb5ed3eb0484858a5f7cbdce69092ed, scope.project.id=a941dd7311514444b64e1778320ae963) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:09.011826 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8589834-e6e5-4451-97e8-d35945da88a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:09.013264 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8589834-e6e5-4451-97e8-d35945da88a6 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:09.014053 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c27b2-3de0-48cb-8c61-c8caa16f3cf8 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:09.019065 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 233/450] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Jul 25 08:32:08 2022] GET /identity/v3/role_assignments?group.id=83422cba961044af87596a3eb738af4b&scope.project.id=a941dd7311514444b64e1778320ae963&role.id=2cb5ed3eb0484858a5f7cbdce69092ed => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:09.019872 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8589834-e6e5-4451-97e8-d35945da88a6 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:09.053593 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a4df3-2182-4432-b6fb-7155ec528a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:09.054183 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a4df3-2182-4432-b6fb-7155ec528a0a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:09.054471 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a4df3-2182-4432-b6fb-7155ec528a0a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:09.055044 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a4df3-2182-4432-b6fb-7155ec528a0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:09.055631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a4df3-2182-4432-b6fb-7155ec528a0a None admin] RBAC: Adding query filter params (group.id=83422cba961044af87596a3eb738af4b, role.id=be32d79ae2964b4b93a1efff3a9aa70b, scope.project.id=a941dd7311514444b64e1778320ae963) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:09.055958 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a4df3-2182-4432-b6fb-7155ec528a0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:09.057433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a4df3-2182-4432-b6fb-7155ec528a0a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:09.065061 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 218/451] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Jul 25 08:32:08 2022] GET /identity/v3/role_assignments?group.id=83422cba961044af87596a3eb738af4b&scope.project.id=a941dd7311514444b64e1778320ae963&role.id=be32d79ae2964b4b93a1efff3a9aa70b => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:09.138886 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8589834-e6e5-4451-97e8-d35945da88a6 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:09.179474 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd4cff-eadd-484b-8877-e65da5130ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:09.181012 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd4cff-eadd-484b-8877-e65da5130ee4 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:09.181504 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd4cff-eadd-484b-8877-e65da5130ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:09.181985 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd4cff-eadd-484b-8877-e65da5130ee4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:09.241343 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:09.259054 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd4cff-eadd-484b-8877-e65da5130ee4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:09.260679 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd4cff-eadd-484b-8877-e65da5130ee4 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:09.364408 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 234/452] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:32:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:32:09.370220 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a4df3-2182-4432-b6fb-7155ec528a0a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:09.473031 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a4df3-2182-4432-b6fb-7155ec528a0a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:09.499350 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:09.509088 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d23663-5e70-4036-8091-f48c8e33b43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:09.511600 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d23663-5e70-4036-8091-f48c8e33b43e None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:09.511600 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d23663-5e70-4036-8091-f48c8e33b43e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:09.511600 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d23663-5e70-4036-8091-f48c8e33b43e None admin] PATH_INFO: `/v3/projects/dc9626b4086645e5810dd68fb6d20d03` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:09.511866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d23663-5e70-4036-8091-f48c8e33b43e None admin] RBAC: Authorizing `identity:get_project(project_id=dc9626b4086645e5810dd68fb6d20d03)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:09.513272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d23663-5e70-4036-8091-f48c8e33b43e None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:09.515149 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 219/453] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:32:09 2022] GET /identity/v3/projects/dc9626b4086645e5810dd68fb6d20d03 => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:32:09.521153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd4cff-eadd-484b-8877-e65da5130ee4 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:09.603420 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:09.618883 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd4cff-eadd-484b-8877-e65da5130ee4 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:09.652029 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9af3a-9e71-4079-9b83-b3eb5916570d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:09.652872 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9af3a-9e71-4079-9b83-b3eb5916570d None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:09.653154 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9af3a-9e71-4079-9b83-b3eb5916570d None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:09.653427 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9af3a-9e71-4079-9b83-b3eb5916570d None admin] PATH_INFO: `/v3/groups/3e749e9c937e4cb5a2e8560336dfcf1b` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:09.654582 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9af3a-9e71-4079-9b83-b3eb5916570d None admin] RBAC: Authorizing `identity:get_group(group_id=3e749e9c937e4cb5a2e8560336dfcf1b)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:09.656155 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9af3a-9e71-4079-9b83-b3eb5916570d None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:09.657775 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 235/454] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jul 25 08:32:09 2022] GET /identity/v3/groups/3e749e9c937e4cb5a2e8560336dfcf1b => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:09.664029 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d23663-5e70-4036-8091-f48c8e33b43e None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:09.760261 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d23663-5e70-4036-8091-f48c8e33b43e None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:09.791958 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de112e2d-818e-4217-8657-258b01f10616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:09.792594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de112e2d-818e-4217-8657-258b01f10616 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:09.792879 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de112e2d-818e-4217-8657-258b01f10616 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:09.793156 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de112e2d-818e-4217-8657-258b01f10616 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:09.794006 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de112e2d-818e-4217-8657-258b01f10616 None admin] RBAC: Adding query filter params (group.id=3e749e9c937e4cb5a2e8560336dfcf1b, role.id=25b0f48c10474bf6b98aad8f093868ee, scope.project.id=dc9626b4086645e5810dd68fb6d20d03) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:09.794319 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de112e2d-818e-4217-8657-258b01f10616 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:09.795763 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de112e2d-818e-4217-8657-258b01f10616 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:09.802171 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 220/455] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Jul 25 08:32:09 2022] GET /identity/v3/role_assignments?group.id=3e749e9c937e4cb5a2e8560336dfcf1b&scope.project.id=dc9626b4086645e5810dd68fb6d20d03&role.id=25b0f48c10474bf6b98aad8f093868ee => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:12.261853 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba8c09-becb-4ce4-8f01-6154838cb126 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:12.261853 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba8c09-becb-4ce4-8f01-6154838cb126 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:12.261853 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba8c09-becb-4ce4-8f01-6154838cb126 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:12.262962 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 236/456] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:12.267236 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f39ac6-a22a-4597-af62-36652da50a41 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:12.267689 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f39ac6-a22a-4597-af62-36652da50a41 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:12.267864 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f39ac6-a22a-4597-af62-36652da50a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:12.291226 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-d5f39ac6-a22a-4597-af62-36652da50a41 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:12.292471 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d5f39ac6-a22a-4597-af62-36652da50a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:12.381936 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:12.401019 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 221/457] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:32:12.441387 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba8c09-becb-4ce4-8f01-6154838cb126 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:12.582592 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba8c09-becb-4ce4-8f01-6154838cb126 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:12.589479 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a06ad-7cd6-46f8-9a73-0b5b3e99ce92 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:12.590535 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a06ad-7cd6-46f8-9a73-0b5b3e99ce92 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:12.591044 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a06ad-7cd6-46f8-9a73-0b5b3e99ce92 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:12.593321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 222/458] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:12.598494 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55324c2a-6466-4372-a27f-01799098d655 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:12.599010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55324c2a-6466-4372-a27f-01799098d655 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:12.599502 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55324c2a-6466-4372-a27f-01799098d655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:12.620652 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-55324c2a-6466-4372-a27f-01799098d655 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:12.625235 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-55324c2a-6466-4372-a27f-01799098d655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:12.631957 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3330ea-de76-4e9c-8273-0c682e6ede3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:12.632753 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3330ea-de76-4e9c-8273-0c682e6ede3f None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:12.633073 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3330ea-de76-4e9c-8273-0c682e6ede3f None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:12.633305 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3330ea-de76-4e9c-8273-0c682e6ede3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:12.644187 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3330ea-de76-4e9c-8273-0c682e6ede3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:12.645641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3330ea-de76-4e9c-8273-0c682e6ede3f None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:12.663547 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-5e3330ea-de76-4e9c-8273-0c682e6ede3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:12.663547 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:12.663547 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:12.663547 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:12.663547 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:12.663547 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:12.663547 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:12.663547 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:12.663547 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:12.663547 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:12.663547 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:12.663547 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:12.663547 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:12.663547 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:12.663547 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:12.664476 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:12.664476 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:12.664476 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:12.664476 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:12.664476 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:12.664476 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:12.664476 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:12.664476 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:12.664476 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:12.664476 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:12.664476 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:12.664476 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:12.664476 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:12.664476 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:12.664476 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:12.664476 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:12.664476 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:12.665312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:12.665312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:12.665312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:12.665312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:12.669540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 237/459] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:12.670864 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cee51-2760-4bfa-93f7-8cb535c08305 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:12.671151 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cee51-2760-4bfa-93f7-8cb535c08305 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:12.671429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cee51-2760-4bfa-93f7-8cb535c08305 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:12.673586 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 238/460] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:12.678130 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572cee51-2760-4bfa-93f7-8cb535c08305 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:12.682218 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:12.715523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 223/461] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:32:12.717541 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8138ab-1d4a-4a42-a986-881088d2408a None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:12.718144 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8138ab-1d4a-4a42-a986-881088d2408a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:12.718496 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8138ab-1d4a-4a42-a986-881088d2408a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:12.740756 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-da8138ab-1d4a-4a42-a986-881088d2408a None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:12.742613 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-da8138ab-1d4a-4a42-a986-881088d2408a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:12.796143 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572cee51-2760-4bfa-93f7-8cb535c08305 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:12.835738 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaaad20-aa70-4fc7-adf4-723c9e22688b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:12.837768 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaad20-aa70-4fc7-adf4-723c9e22688b None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:12.838301 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaad20-aa70-4fc7-adf4-723c9e22688b None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:12.838774 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaad20-aa70-4fc7-adf4-723c9e22688b None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:12.839715 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 224/462] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:32:12.839972 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaaad20-aa70-4fc7-adf4-723c9e22688b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:12.840498 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaaad20-aa70-4fc7-adf4-723c9e22688b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:12.840599 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8138ab-1d4a-4a42-a986-881088d2408a None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:12.842338 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaaad20-aa70-4fc7-adf4-723c9e22688b None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:12.863331 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 239/463] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:12.868807 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaaad20-aa70-4fc7-adf4-723c9e22688b None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:12.918440 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:12.953953 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:12.980024 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8138ab-1d4a-4a42-a986-881088d2408a None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:13.006456 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaaad20-aa70-4fc7-adf4-723c9e22688b None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:13.017472 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741a4e4-a60e-4651-99d1-b0efc18fdcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:13.019668 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741a4e4-a60e-4651-99d1-b0efc18fdcd4 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:13.020208 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741a4e4-a60e-4651-99d1-b0efc18fdcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:13.020688 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741a4e4-a60e-4651-99d1-b0efc18fdcd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:13.038293 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3741a4e4-a60e-4651-99d1-b0efc18fdcd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:13.040338 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3741a4e4-a60e-4651-99d1-b0efc18fdcd4 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:13.054056 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f62a6a-ea9e-4abe-a093-850e4e338c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:13.054731 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f62a6a-ea9e-4abe-a093-850e4e338c16 None admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:13.055211 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f62a6a-ea9e-4abe-a093-850e4e338c16 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:13.055767 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f62a6a-ea9e-4abe-a093-850e4e338c16 None admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:13.056916 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f62a6a-ea9e-4abe-a093-850e4e338c16 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:13.059397 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f62a6a-ea9e-4abe-a093-850e4e338c16 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:13.063197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-3741a4e4-a60e-4651-99d1-b0efc18fdcd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:13.063197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:13.063197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:13.063197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:13.063197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:13.063197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:13.063197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:13.063197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:13.063197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:13.063197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:13.063197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:13.063197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:13.063197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:13.063197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:13.063197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:13.064618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:13.064618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:13.064618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:13.064618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:13.064618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:13.064618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:13.064618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:13.064618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:13.064618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:13.064618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:13.064618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:13.064618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:13.064618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:13.064618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:13.064618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:13.064618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:13.064618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:13.065474 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:13.065474 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:13.065474 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:13.065474 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:13.067379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 225/464] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:13.068435 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741a4e4-a60e-4651-99d1-b0efc18fdcd4 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:13.184949 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:13.188284 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741a4e4-a60e-4651-99d1-b0efc18fdcd4 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:13.216239 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 240/465] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jul 25 08:32:12 2022] POST /identity/v3/users => generated 246 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:32:13.217636 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f62a6a-ea9e-4abe-a093-850e4e338c16 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:13.257798 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439038f7-119d-4231-91d2-fe35d31b5ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:13.260527 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439038f7-119d-4231-91d2-fe35d31b5ac3 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:13.261067 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439038f7-119d-4231-91d2-fe35d31b5ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:13.261543 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439038f7-119d-4231-91d2-fe35d31b5ac3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:13.287371 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439038f7-119d-4231-91d2-fe35d31b5ac3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:13.289829 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439038f7-119d-4231-91d2-fe35d31b5ac3 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:13.310874 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-439038f7-119d-4231-91d2-fe35d31b5ac3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:13.310874 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:13.310874 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:13.310874 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:13.310874 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:13.310874 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:13.310874 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:13.310874 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:13.310874 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:13.310874 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:13.310874 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:13.310874 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:13.310874 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:13.310874 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:13.310874 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:13.311823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:13.311823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:13.311823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:13.311823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:13.311823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:13.311823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:13.311823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:13.311823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:13.311823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:13.311823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:13.311823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:13.311823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:13.311823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:13.311823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:13.311823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:13.311823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:13.311823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:13.312663 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:13.312663 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:13.312663 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:13.312663 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:13.319797 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 226/466] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:13.321698 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f58d0-f3e1-4cdb-a8a7-fbc3cd52de89 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:13.322204 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f58d0-f3e1-4cdb-a8a7-fbc3cd52de89 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:13.322687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f58d0-f3e1-4cdb-a8a7-fbc3cd52de89 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:13.324900 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 227/467] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:13.326062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f58d0-f3e1-4cdb-a8a7-fbc3cd52de89 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:13.383101 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f62a6a-ea9e-4abe-a093-850e4e338c16 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:13.412411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:13.436014 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc907e8-f61e-4fe3-b217-5f05165329b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:13.437038 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc907e8-f61e-4fe3-b217-5f05165329b1 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:13.438616 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc907e8-f61e-4fe3-b217-5f05165329b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:13.438616 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc907e8-f61e-4fe3-b217-5f05165329b1 None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:13.439100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc907e8-f61e-4fe3-b217-5f05165329b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:13.439512 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc907e8-f61e-4fe3-b217-5f05165329b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:13.442132 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc907e8-f61e-4fe3-b217-5f05165329b1 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:13.464631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f58d0-f3e1-4cdb-a8a7-fbc3cd52de89 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:13.466050 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 241/468] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:13.466731 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc5140-b459-4497-b4a6-96858359281d None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:13.467116 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc5140-b459-4497-b4a6-96858359281d None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:13.467421 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc5140-b459-4497-b4a6-96858359281d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:13.487535 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-4ecc5140-b459-4497-b4a6-96858359281d None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:13.489216 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-4ecc5140-b459-4497-b4a6-96858359281d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:13.511313 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9a48b-1f8b-47ad-803b-046c25689619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:13.512299 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9a48b-1f8b-47ad-803b-046c25689619 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:13.512583 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9a48b-1f8b-47ad-803b-046c25689619 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:13.513007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9a48b-1f8b-47ad-803b-046c25689619 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:13.513900 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9a48b-1f8b-47ad-803b-046c25689619 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:13.514204 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9a48b-1f8b-47ad-803b-046c25689619 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:13.515788 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9a48b-1f8b-47ad-803b-046c25689619 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:13.531020 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 228/469] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:13.532902 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9a48b-1f8b-47ad-803b-046c25689619 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:13.554177 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:13.578340 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 242/470] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:32:13.579874 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc5140-b459-4497-b4a6-96858359281d None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:13.702305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9a48b-1f8b-47ad-803b-046c25689619 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:13.752323 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc5140-b459-4497-b4a6-96858359281d None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:13.754486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad126d7-5268-4a59-91ac-05c7155810ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:13.756153 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad126d7-5268-4a59-91ac-05c7155810ae None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:13.756532 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad126d7-5268-4a59-91ac-05c7155810ae None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:13.757006 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad126d7-5268-4a59-91ac-05c7155810ae None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:13.757940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad126d7-5268-4a59-91ac-05c7155810ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:13.759589 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad126d7-5268-4a59-91ac-05c7155810ae None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:13.764928 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:13.793961 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3dc8f-c499-4587-9100-bc22068b2ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:13.794663 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3dc8f-c499-4587-9100-bc22068b2ca1 None admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:13.794943 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3dc8f-c499-4587-9100-bc22068b2ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:13.795213 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3dc8f-c499-4587-9100-bc22068b2ca1 None admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:13.795958 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf3dc8f-c499-4587-9100-bc22068b2ca1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:13.798875 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf3dc8f-c499-4587-9100-bc22068b2ca1 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:13.864859 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 229/471] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jul 25 08:32:13 2022] POST /identity/v3/users => generated 248 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:32:13.866708 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad126d7-5268-4a59-91ac-05c7155810ae None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:13.892608 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 243/472] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jul 25 08:32:13 2022] POST /identity/v3/users => generated 248 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:32:13.970146 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce6eb1-e350-4d75-afd8-3c919f04407d None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:13.970799 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce6eb1-e350-4d75-afd8-3c919f04407d None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:13.971271 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce6eb1-e350-4d75-afd8-3c919f04407d None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:13.973211 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 244/473] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:32:13.977893 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:14.006824 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0abcb1-00a3-474d-9eab-ca5c7ff3009d None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:14.007463 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0abcb1-00a3-474d-9eab-ca5c7ff3009d None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:14.007971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0abcb1-00a3-474d-9eab-ca5c7ff3009d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:14.023248 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad126d7-5268-4a59-91ac-05c7155810ae None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:14.042139 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-1d0abcb1-00a3-474d-9eab-ca5c7ff3009d None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:14.048246 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-1d0abcb1-00a3-474d-9eab-ca5c7ff3009d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:14.064304 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9596f6-ed1d-4338-aabf-0b63387793a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:14.065545 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9596f6-ed1d-4338-aabf-0b63387793a1 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:14.066043 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9596f6-ed1d-4338-aabf-0b63387793a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:14.066557 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9596f6-ed1d-4338-aabf-0b63387793a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:14.080068 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9596f6-ed1d-4338-aabf-0b63387793a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:14.081919 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9596f6-ed1d-4338-aabf-0b63387793a1 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:14.101658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-ac9596f6-ed1d-4338-aabf-0b63387793a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:14.101658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:14.101658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:14.101658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:14.101658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:14.101658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:14.101658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:14.101658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:14.101658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:14.101658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:14.101658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:14.101658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:14.101658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:14.101658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:14.101658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:14.102625 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:14.102625 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:14.102625 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:14.102625 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:14.102625 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:14.102625 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:14.102625 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:14.102625 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:14.102625 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:14.102625 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:14.102625 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:14.102625 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:14.102625 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:14.102625 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:14.102625 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:14.102625 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:14.102625 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:14.103511 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:14.103511 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:14.103511 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:14.103511 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:14.105615 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 230/474] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:14.112941 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9596f6-ed1d-4338-aabf-0b63387793a1 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:14.171911 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 245/475] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:32:14.198355 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0abcb1-00a3-474d-9eab-ca5c7ff3009d None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:14.237939 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9596f6-ed1d-4338-aabf-0b63387793a1 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:14.260747 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:14.277553 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615c406-9784-49f3-a3ea-f740bf341293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:14.278548 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615c406-9784-49f3-a3ea-f740bf341293 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:14.279050 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615c406-9784-49f3-a3ea-f740bf341293 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:14.279651 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615c406-9784-49f3-a3ea-f740bf341293 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:14.280590 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615c406-9784-49f3-a3ea-f740bf341293 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:14.281199 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615c406-9784-49f3-a3ea-f740bf341293 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:14.282844 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615c406-9784-49f3-a3ea-f740bf341293 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:14.297800 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 231/476] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:14.303339 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:14.304790 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615c406-9784-49f3-a3ea-f740bf341293 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:14.309919 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0abcb1-00a3-474d-9eab-ca5c7ff3009d None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:14.348086 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7216b72-f6d8-4133-b5d4-9194108130d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:14.348816 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7216b72-f6d8-4133-b5d4-9194108130d0 None admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:14.349104 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7216b72-f6d8-4133-b5d4-9194108130d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:14.349380 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7216b72-f6d8-4133-b5d4-9194108130d0 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:14.350497 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7216b72-f6d8-4133-b5d4-9194108130d0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:14.351526 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7216b72-f6d8-4133-b5d4-9194108130d0 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:14.383089 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.sql.core [None req-b7216b72-f6d8-4133-b5d4-9194108130d0 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 08:32:14.383089 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 25 08:32:14.383089 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [parameters: {'id': '0c19cc55e3e945df965a4674b66f69f0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 25 08:32:14.383089 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86941) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 08:32:14.407278 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-b7216b72-f6d8-4133-b5d4-9194108130d0 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 25 08:32:14.407278 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:14.407278 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 08:32:14.407278 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 08:32:14.407278 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 08:32:14.407278 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 08:32:14.407278 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 08:32:14.407278 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 08:32:14.407278 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 08:32:14.407278 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application conn.query(q) Jul 25 08:32:14.407278 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 08:32:14.407278 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 08:32:14.407278 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 08:32:14.407278 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application result.read() Jul 25 08:32:14.407278 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 08:32:14.408231 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 08:32:14.408231 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 08:32:14.408231 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 08:32:14.408231 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 08:32:14.408231 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 08:32:14.408231 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 08:32:14.408231 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 08:32:14.408231 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 08:32:14.408231 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:14.408231 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 08:32:14.408231 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:14.408231 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:14.408231 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 08:32:14.408231 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 08:32:14.408231 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 25 08:32:14.408231 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return ref.to_dict() Jul 25 08:32:14.408231 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 08:32:14.408231 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application next(self.gen) Jul 25 08:32:14.409429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 08:32:14.409429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application yield resource Jul 25 08:32:14.409429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 08:32:14.409429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application next(self.gen) Jul 25 08:32:14.409429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 08:32:14.409429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 08:32:14.409429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 08:32:14.409429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 08:32:14.409429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 08:32:14.409429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise self.value Jul 25 08:32:14.409429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 08:32:14.409429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 08:32:14.409429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 08:32:14.409429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application session.commit() Jul 25 08:32:14.409429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 08:32:14.409429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 08:32:14.409429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 08:32:14.410258 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 08:32:14.410258 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 08:32:14.410258 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self.session.flush() Jul 25 08:32:14.410258 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 08:32:14.410258 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 08:32:14.410258 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 08:32:14.410258 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 08:32:14.410258 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 08:32:14.410258 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application compat.raise_( Jul 25 08:32:14.410258 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 08:32:14.410258 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception Jul 25 08:32:14.410258 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 08:32:14.410258 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 08:32:14.410258 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 08:32:14.410258 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 08:32:14.410258 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 08:32:14.410258 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 08:32:14.411133 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 08:32:14.411133 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 08:32:14.411133 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 25 08:32:14.411133 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 25 08:32:14.411133 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 08:32:14.411133 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 08:32:14.411133 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 08:32:14.411133 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 08:32:14.411133 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 08:32:14.411133 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 08:32:14.411133 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 08:32:14.411133 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 08:32:14.411133 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 08:32:14.411133 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 08:32:14.411133 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 08:32:14.411133 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception Jul 25 08:32:14.416774 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 08:32:14.416774 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 08:32:14.416774 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 08:32:14.416774 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 08:32:14.416774 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 08:32:14.416774 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 08:32:14.416774 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 08:32:14.416774 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application conn.query(q) Jul 25 08:32:14.416774 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 08:32:14.416774 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 08:32:14.416774 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 08:32:14.416774 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application result.read() Jul 25 08:32:14.416774 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 08:32:14.416774 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 08:32:14.416774 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 08:32:14.416774 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 08:32:14.418692 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 08:32:14.418692 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 08:32:14.418692 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 08:32:14.418692 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 08:32:14.418692 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 08:32:14.418692 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 25 08:32:14.418692 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [parameters: {'id': '0c19cc55e3e945df965a4674b66f69f0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 25 08:32:14.418692 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 08:32:14.418692 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:14.418692 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:32:14.418692 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:14.418692 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:14.418692 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:14.418692 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:14.418692 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:14.418692 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:14.420709 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:14.420709 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:14.420709 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:14.420709 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:14.420709 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:14.420709 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:14.420709 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 25 08:32:14.420709 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 25 08:32:14.420709 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:14.420709 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:14.420709 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 25 08:32:14.420709 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 25 08:32:14.420709 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 08:32:14.420709 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 08:32:14.420709 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 25 08:32:14.420709 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:14.430402 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 246/477] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Jul 25 08:32:14 2022] POST /identity/v3/roles => generated 144 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:32:14.430563 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615c406-9784-49f3-a3ea-f740bf341293 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:14.431158 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7216b72-f6d8-4133-b5d4-9194108130d0 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:14.525829 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2e5b1-cffa-453a-8a12-4e70f8db13cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:14.526432 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2e5b1-cffa-453a-8a12-4e70f8db13cc None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:14.526720 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2e5b1-cffa-453a-8a12-4e70f8db13cc None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:14.526997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2e5b1-cffa-453a-8a12-4e70f8db13cc None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:14.527748 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2e5b1-cffa-453a-8a12-4e70f8db13cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:14.529191 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2e5b1-cffa-453a-8a12-4e70f8db13cc None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:14.553487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7216b72-f6d8-4133-b5d4-9194108130d0 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:14.590497 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f256b0a-062f-41d9-b261-c23df3f76610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:14.591505 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f256b0a-062f-41d9-b261-c23df3f76610 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:14.591831 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f256b0a-062f-41d9-b261-c23df3f76610 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:14.592111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f256b0a-062f-41d9-b261-c23df3f76610 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:14.603822 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f256b0a-062f-41d9-b261-c23df3f76610 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:14.612388 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-9f256b0a-062f-41d9-b261-c23df3f76610 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:32:14.612388 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:14.612388 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:14.612388 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:14.612388 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:14.612388 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:14.612388 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:14.612388 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:14.612388 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:14.612388 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:14.612388 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:14.612388 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:14.612388 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:14.612388 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:14.612388 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:14.612388 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:14.614800 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:14.614800 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:14.614800 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:14.614800 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:14.614800 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:14.614800 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:14.614800 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:14.614800 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:14.614800 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:14.614800 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:14.614800 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:14.614800 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:14.614800 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:14.614800 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:14.614800 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:14.614800 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:14.616791 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:14.616791 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:14.616791 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:14.616791 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:14.616791 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:14.616791 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:14.616791 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:14.616791 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:14.616791 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:14.616791 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:14.616791 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 08:32:14.616791 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:14.616791 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 247/478] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 08:32:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:32:14.620778 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f256b0a-062f-41d9-b261-c23df3f76610 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:14.642660 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 232/479] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jul 25 08:32:14 2022] POST /identity/v3/users => generated 249 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:32:14.650215 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:14.804029 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f256b0a-062f-41d9-b261-c23df3f76610 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:14.847782 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca0a62-a3ee-4faf-a3a7-42f75a5a372c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:14.848454 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca0a62-a3ee-4faf-a3a7-42f75a5a372c None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:14.848738 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca0a62-a3ee-4faf-a3a7-42f75a5a372c None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:14.849014 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca0a62-a3ee-4faf-a3a7-42f75a5a372c None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:14.849763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca0a62-a3ee-4faf-a3a7-42f75a5a372c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:14.850070 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca0a62-a3ee-4faf-a3a7-42f75a5a372c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:14.851437 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca0a62-a3ee-4faf-a3a7-42f75a5a372c None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:14.861140 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 248/480] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:32:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:15.741157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba015d43-a86a-4455-bf5d-f5dca270d869 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:15.742120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba015d43-a86a-4455-bf5d-f5dca270d869 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:15.742600 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba015d43-a86a-4455-bf5d-f5dca270d869 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:15.744474 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 233/481] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:15.749418 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156a58a-022b-4800-9eca-2437038d56d4 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:15.750229 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156a58a-022b-4800-9eca-2437038d56d4 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:15.751139 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156a58a-022b-4800-9eca-2437038d56d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:15.774358 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-f156a58a-022b-4800-9eca-2437038d56d4 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:15.775881 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-f156a58a-022b-4800-9eca-2437038d56d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:15.868161 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 249/482] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:32:15.919779 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba015d43-a86a-4455-bf5d-f5dca270d869 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:15.968628 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:16.058702 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba015d43-a86a-4455-bf5d-f5dca270d869 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:16.100681 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e24641-adf4-442d-a07e-a59a0c7c7f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:16.101541 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e24641-adf4-442d-a07e-a59a0c7c7f93 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:16.101830 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e24641-adf4-442d-a07e-a59a0c7c7f93 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:16.102110 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e24641-adf4-442d-a07e-a59a0c7c7f93 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:16.117008 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e24641-adf4-442d-a07e-a59a0c7c7f93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:16.124823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-95e24641-adf4-442d-a07e-a59a0c7c7f93 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:16.124823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:16.124823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:16.124823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:16.124823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:16.124823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:16.124823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:16.124823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:16.124823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:16.124823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:16.124823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:16.124823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:16.124823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:16.124823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:16.124823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:16.124823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:16.126497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:16.126497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:16.126497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:16.126497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:16.126497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:16.126497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:16.126497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:16.126497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:16.126497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:16.126497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:16.126497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:16.126497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:16.126497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:16.126497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:16.126497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:16.126497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:16.127752 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:16.127752 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:16.127752 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:16.127752 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:16.127752 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:16.127752 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:16.127752 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:16.127752 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:16.127752 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:16.127752 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:16.127752 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:16.127752 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:16.127752 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 234/483] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 08:32:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:16.132699 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156a58a-022b-4800-9eca-2437038d56d4 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:16.151405 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:16.274535 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156a58a-022b-4800-9eca-2437038d56d4 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:16.310921 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099266a0-4acc-48e4-be54-56c7ec39b3ce None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:16.311250 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099266a0-4acc-48e4-be54-56c7ec39b3ce None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:16.311519 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099266a0-4acc-48e4-be54-56c7ec39b3ce None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:16.313258 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 235/484] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:32:16.318412 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d8e4d-04a5-4a3e-b41d-82d3802702ae None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:16.318707 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d8e4d-04a5-4a3e-b41d-82d3802702ae None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:16.318989 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d8e4d-04a5-4a3e-b41d-82d3802702ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:16.324478 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5823906-afd9-4d6b-a915-611e57d854d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:16.325169 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5823906-afd9-4d6b-a915-611e57d854d8 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:16.325459 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5823906-afd9-4d6b-a915-611e57d854d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:16.325741 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5823906-afd9-4d6b-a915-611e57d854d8 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:16.326506 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5823906-afd9-4d6b-a915-611e57d854d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:16.326815 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5823906-afd9-4d6b-a915-611e57d854d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:16.328308 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5823906-afd9-4d6b-a915-611e57d854d8 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:16.339650 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-792d8e4d-04a5-4a3e-b41d-82d3802702ae None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:16.341045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-792d8e4d-04a5-4a3e-b41d-82d3802702ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:16.341945 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 250/485] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 08:32:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:16.347583 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5823906-afd9-4d6b-a915-611e57d854d8 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:16.414797 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 236/486] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:32:16.438406 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d8e4d-04a5-4a3e-b41d-82d3802702ae None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:16.468336 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:16.538924 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:16.545207 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d8e4d-04a5-4a3e-b41d-82d3802702ae None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:16.583422 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6b7fb-e8ba-494a-b113-7197c158870d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:16.584628 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6b7fb-e8ba-494a-b113-7197c158870d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:16.585120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6b7fb-e8ba-494a-b113-7197c158870d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:16.585619 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6b7fb-e8ba-494a-b113-7197c158870d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:16.597390 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec6b7fb-e8ba-494a-b113-7197c158870d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:16.605692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-fec6b7fb-e8ba-494a-b113-7197c158870d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:16.605692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:16.605692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:16.605692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:16.605692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:16.605692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:16.605692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:16.605692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:16.605692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:16.605692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:16.605692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:16.605692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:16.605692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:16.605692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:16.605692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:16.605692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:16.606601 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:16.606601 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:16.606601 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:16.606601 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:16.606601 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:16.606601 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:16.606601 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:16.606601 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:16.606601 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:16.606601 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:16.606601 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:16.606601 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:16.606601 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:16.606601 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:16.606601 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:16.606601 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:16.607408 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:16.607408 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:16.607408 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:16.607408 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:16.607408 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:16.607408 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:16.607408 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:16.607408 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:16.607408 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:16.607408 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:16.607408 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:16.607408 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:16.610197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 237/487] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 08:32:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:32:16.616268 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6b7fb-e8ba-494a-b113-7197c158870d None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:16.633844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5823906-afd9-4d6b-a915-611e57d854d8 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:16.707991 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:16.724487 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6b7fb-e8ba-494a-b113-7197c158870d None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:16.730319 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee78f6-ea30-4828-b3b9-f05d4a8260b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:16.731133 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee78f6-ea30-4828-b3b9-f05d4a8260b3 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:16.731414 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee78f6-ea30-4828-b3b9-f05d4a8260b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:16.731706 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee78f6-ea30-4828-b3b9-f05d4a8260b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:16.744477 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee78f6-ea30-4828-b3b9-f05d4a8260b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:16.745925 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee78f6-ea30-4828-b3b9-f05d4a8260b3 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:16.762561 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b8d2a7-5269-49ec-ba7a-9dd3246aafa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:16.763903 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8d2a7-5269-49ec-ba7a-9dd3246aafa2 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:16.764396 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8d2a7-5269-49ec-ba7a-9dd3246aafa2 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:16.764912 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8d2a7-5269-49ec-ba7a-9dd3246aafa2 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:16.765891 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b8d2a7-5269-49ec-ba7a-9dd3246aafa2 None admin] RBAC: Adding query filter params (name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:16.767046 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b8d2a7-5269-49ec-ba7a-9dd3246aafa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:16.767540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-8aee78f6-ea30-4828-b3b9-f05d4a8260b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:16.767540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:16.767540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:16.767540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:16.767540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:16.767540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:16.767540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:16.767540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:16.767540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:16.767540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:16.767540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:16.767540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:16.767540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:16.767540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:16.767540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:16.768632 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:16.768632 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:16.768632 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:16.768632 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:16.768632 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:16.768632 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:16.768632 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:16.768632 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:16.768632 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:16.768632 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:16.768632 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:16.768632 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:16.768632 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:16.768632 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:16.768632 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:16.768632 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:16.768632 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:16.769495 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:16.769495 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:16.769495 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:16.769495 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:16.769495 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 251/488] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 422 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:32:16.770262 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6566e7-7cc5-4b36-9635-1a5cb4db669d None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:16.770544 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6566e7-7cc5-4b36-9635-1a5cb4db669d None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:16.770821 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6566e7-7cc5-4b36-9635-1a5cb4db669d None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:16.771958 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b8d2a7-5269-49ec-ba7a-9dd3246aafa2 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:16.776423 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 252/489] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:16.778204 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6566e7-7cc5-4b36-9635-1a5cb4db669d None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:16.786617 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 238/490] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 08:32:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:32:16.792632 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38294188-b570-458f-a5e9-6030f6e0a7bc None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:16.792878 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38294188-b570-458f-a5e9-6030f6e0a7bc None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:16.793169 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38294188-b570-458f-a5e9-6030f6e0a7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:16.812109 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-38294188-b570-458f-a5e9-6030f6e0a7bc None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:16.813464 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-38294188-b570-458f-a5e9-6030f6e0a7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:16.882513 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 239/491] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:32:16.883342 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38294188-b570-458f-a5e9-6030f6e0a7bc None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:16.914318 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6566e7-7cc5-4b36-9635-1a5cb4db669d None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:16.941704 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:16.950952 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7d993-f166-473e-8168-fce6fe90580e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:16.951885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7d993-f166-473e-8168-fce6fe90580e None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:16.952367 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7d993-f166-473e-8168-fce6fe90580e None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:16.952835 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7d993-f166-473e-8168-fce6fe90580e None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:16.954355 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7d993-f166-473e-8168-fce6fe90580e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:16.954961 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7d993-f166-473e-8168-fce6fe90580e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:16.956611 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7d993-f166-473e-8168-fce6fe90580e None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:16.973521 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 253/492] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:16.974759 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7d993-f166-473e-8168-fce6fe90580e None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:16.979252 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:17.005015 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38294188-b570-458f-a5e9-6030f6e0a7bc None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:17.043928 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c42ad-6dd2-49f6-87e9-940e7ba698cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:17.044648 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c42ad-6dd2-49f6-87e9-940e7ba698cf None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:17.044934 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c42ad-6dd2-49f6-87e9-940e7ba698cf None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:17.045213 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c42ad-6dd2-49f6-87e9-940e7ba698cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:17.057554 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c42ad-6dd2-49f6-87e9-940e7ba698cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:17.059124 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c42ad-6dd2-49f6-87e9-940e7ba698cf None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:17.080051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-4f8c42ad-6dd2-49f6-87e9-940e7ba698cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:17.080051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:17.080051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:17.080051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:17.080051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:17.080051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:17.080051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:17.080051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:17.080051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:17.080051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:17.080051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:17.080051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:17.080051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:17.080051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:17.080051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:17.081015 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:17.081015 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:17.081015 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:17.081015 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:17.081015 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:17.081015 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:17.081015 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:17.081015 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:17.081015 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:17.081015 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:17.081015 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:17.081015 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:17.081015 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:17.081015 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:17.081015 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:17.081015 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:17.081015 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:17.081849 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:17.081849 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:17.081849 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:17.081849 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:17.084033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7d993-f166-473e-8168-fce6fe90580e None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:17.086019 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 240/493] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:17.087655 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c42ad-6dd2-49f6-87e9-940e7ba698cf None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:17.120933 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb171e7-421d-4c16-b3d1-c0a39ae43c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:17.121964 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb171e7-421d-4c16-b3d1-c0a39ae43c98 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:17.122429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb171e7-421d-4c16-b3d1-c0a39ae43c98 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:17.122835 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb171e7-421d-4c16-b3d1-c0a39ae43c98 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:17.133435 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb171e7-421d-4c16-b3d1-c0a39ae43c98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:17.142032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-feb171e7-421d-4c16-b3d1-c0a39ae43c98 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:17.142032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:17.142032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:17.142032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:17.142032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:17.142032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:17.142032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:17.142032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:17.142032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:17.142032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:17.142032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:17.142032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:17.142032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:17.142032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:17.142032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:17.142032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:17.142940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:17.142940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:17.142940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:17.142940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:17.142940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:17.142940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:17.142940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:17.142940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:17.142940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:17.142940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:17.142940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:17.142940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:17.142940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:17.142940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:17.142940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:17.142940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:17.143744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:17.143744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:17.143744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:17.143744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:17.143744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:17.143744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:17.143744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:17.143744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:17.143744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:17.143744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:17.143744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:17.143744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:17.146444 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 254/494] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 08:32:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:17.147494 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb171e7-421d-4c16-b3d1-c0a39ae43c98 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:17.195516 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:17.206985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c42ad-6dd2-49f6-87e9-940e7ba698cf None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:17.240522 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:17.247772 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15b213-21be-4510-bee7-adfc5123d621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:17.248567 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15b213-21be-4510-bee7-adfc5123d621 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:17.248852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15b213-21be-4510-bee7-adfc5123d621 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:17.249125 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15b213-21be-4510-bee7-adfc5123d621 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:17.252636 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb171e7-421d-4c16-b3d1-c0a39ae43c98 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:17.256567 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15b213-21be-4510-bee7-adfc5123d621 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:17.257999 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15b213-21be-4510-bee7-adfc5123d621 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:17.275932 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-8f15b213-21be-4510-bee7-adfc5123d621 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:32:17.275932 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:17.275932 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:17.275932 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:17.275932 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:17.275932 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:17.275932 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:17.275932 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:17.275932 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:17.275932 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:17.275932 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:17.275932 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:17.275932 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:32:17.275932 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:32:17.275932 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:32:17.275932 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:32:17.276862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:17.276862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:17.276862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:32:17.276862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:17.276862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:32:17.276862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:17.276862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:17.276862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:17.276862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:17.276862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:17.276862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:17.276862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:17.276862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:17.276862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:17.276862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:17.276862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:17.276862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:17.276862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:17.277727 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:17.277727 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:17.277727 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:32:17.277727 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:32:17.277727 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:32:17.277727 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:32:17.277727 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:32:17.277727 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:32:17.277727 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:32:17.277727 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:17.277727 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 241/495] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Jul 25 08:32:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:17.279116 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15b213-21be-4510-bee7-adfc5123d621 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:17.291012 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451e8c7-be2d-4643-9f10-ddb2d025e7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:17.291785 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451e8c7-be2d-4643-9f10-ddb2d025e7ea None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:17.292065 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451e8c7-be2d-4643-9f10-ddb2d025e7ea None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:17.292444 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451e8c7-be2d-4643-9f10-ddb2d025e7ea None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:17.293223 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451e8c7-be2d-4643-9f10-ddb2d025e7ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:17.293534 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451e8c7-be2d-4643-9f10-ddb2d025e7ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:17.295094 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451e8c7-be2d-4643-9f10-ddb2d025e7ea None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:17.316446 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 255/496] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:17.316446 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0260ed-c134-486e-8b71-ca7d6b29239b None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:17.316446 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0260ed-c134-486e-8b71-ca7d6b29239b None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:17.316446 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0260ed-c134-486e-8b71-ca7d6b29239b None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:17.316446 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 256/497] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:17.316446 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0260ed-c134-486e-8b71-ca7d6b29239b None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:17.390742 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15b213-21be-4510-bee7-adfc5123d621 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:17.423770 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0260ed-c134-486e-8b71-ca7d6b29239b None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:17.428096 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f5610-2649-4e3a-86de-7592866eebb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:17.428764 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f5610-2649-4e3a-86de-7592866eebb3 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:17.429050 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f5610-2649-4e3a-86de-7592866eebb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:17.429330 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f5610-2649-4e3a-86de-7592866eebb3 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:17.430084 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f5610-2649-4e3a-86de-7592866eebb3 None admin] RBAC: Adding query filter params (name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:17.430392 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f5610-2649-4e3a-86de-7592866eebb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:17.431757 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:17.431881 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f5610-2649-4e3a-86de-7592866eebb3 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:17.445118 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 242/498] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 08:32:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:17.445118 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad935e1-10b7-4305-bd77-21a332ecbfeb None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:17.445118 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad935e1-10b7-4305-bd77-21a332ecbfeb None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:17.445118 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad935e1-10b7-4305-bd77-21a332ecbfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:17.460234 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-bad935e1-10b7-4305-bd77-21a332ecbfeb None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:17.461421 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-bad935e1-10b7-4305-bd77-21a332ecbfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:17.465207 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b6782b-794c-4b0d-af73-f5fba869ee26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:17.465355 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6782b-794c-4b0d-af73-f5fba869ee26 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:17.465555 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6782b-794c-4b0d-af73-f5fba869ee26 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:17.465830 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6782b-794c-4b0d-af73-f5fba869ee26 None admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:17.466669 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b6782b-794c-4b0d-af73-f5fba869ee26 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:17.466983 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b6782b-794c-4b0d-af73-f5fba869ee26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:17.468459 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b6782b-794c-4b0d-af73-f5fba869ee26 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:17.509579 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 257/499] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Jul 25 08:32:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:17.510828 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b6782b-794c-4b0d-af73-f5fba869ee26 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:17.519076 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:17.544595 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 243/500] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:32:17.545873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad935e1-10b7-4305-bd77-21a332ecbfeb None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:17.621330 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b6782b-794c-4b0d-af73-f5fba869ee26 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:17.648536 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad935e1-10b7-4305-bd77-21a332ecbfeb None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:17.653628 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f83f60-ba1d-446a-b284-5374e0626f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:17.654419 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f83f60-ba1d-446a-b284-5374e0626f8a None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:17.654702 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f83f60-ba1d-446a-b284-5374e0626f8a None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:17.654978 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f83f60-ba1d-446a-b284-5374e0626f8a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:17.662649 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f83f60-ba1d-446a-b284-5374e0626f8a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:17.664143 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f83f60-ba1d-446a-b284-5374e0626f8a None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:17.680060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-f9f83f60-ba1d-446a-b284-5374e0626f8a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 08:32:17.680060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:17.680060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:17.680060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:17.680060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:17.680060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:17.680060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:17.680060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:17.680060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:17.680060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:17.680060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:17.680060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:17.680060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:32:17.680060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:32:17.680060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:32:17.680060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:32:17.681013 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:17.681013 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:17.681013 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:32:17.681013 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:17.681013 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:32:17.681013 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:17.681013 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:17.681013 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:17.681013 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:17.681013 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:17.681013 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:17.681013 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:17.681013 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:17.681013 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:17.681013 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:17.681013 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:17.681013 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:17.681013 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:17.681890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:17.681890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:17.681890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:32:17.681890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:32:17.681890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:32:17.681890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:32:17.681890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:32:17.681890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:32:17.681890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 08:32:17.681890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:17.681890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 258/501] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:32:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:17.682452 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f83f60-ba1d-446a-b284-5374e0626f8a None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:17.686924 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5185b-a996-4e67-9fbc-1ba7b4c65de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:17.687774 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5185b-a996-4e67-9fbc-1ba7b4c65de4 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:17.688066 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5185b-a996-4e67-9fbc-1ba7b4c65de4 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:17.688341 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5185b-a996-4e67-9fbc-1ba7b4c65de4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:17.698682 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5185b-a996-4e67-9fbc-1ba7b4c65de4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:17.700157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5185b-a996-4e67-9fbc-1ba7b4c65de4 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:17.711970 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:17.720203 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-40e5185b-a996-4e67-9fbc-1ba7b4c65de4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:17.720203 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:17.720203 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:17.720203 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:17.720203 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:17.720203 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:17.720203 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:17.720203 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:17.720203 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:17.720203 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:17.720203 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:17.720203 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:17.720203 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:17.720203 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:17.720203 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:17.726936 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:17.726936 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:17.726936 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:17.726936 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:17.726936 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:17.726936 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:17.726936 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:17.726936 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:17.726936 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:17.726936 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:17.726936 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:17.726936 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:17.726936 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:17.726936 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:17.726936 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:17.726936 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:17.726936 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:17.727815 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:17.727815 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:17.727815 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:17.727815 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:17.727815 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 244/502] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:17.727815 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503bd32-fc02-451d-a3b2-f2713f26c454 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:17.727815 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503bd32-fc02-451d-a3b2-f2713f26c454 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:17.727815 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503bd32-fc02-451d-a3b2-f2713f26c454 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:17.727815 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 245/503] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:17.728277 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503bd32-fc02-451d-a3b2-f2713f26c454 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:17.761526 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:17.789849 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f83f60-ba1d-446a-b284-5374e0626f8a None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:17.823889 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bdd6de-1b40-4893-bd4b-f88ae2fa2aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:17.824476 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdd6de-1b40-4893-bd4b-f88ae2fa2aa0 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:17.824759 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdd6de-1b40-4893-bd4b-f88ae2fa2aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:17.825034 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdd6de-1b40-4893-bd4b-f88ae2fa2aa0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:17.827744 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503bd32-fc02-451d-a3b2-f2713f26c454 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:17.861327 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85e4f7-c456-46b8-b9f1-3940e7ae4c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:17.862108 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85e4f7-c456-46b8-b9f1-3940e7ae4c65 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:17.862393 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85e4f7-c456-46b8-b9f1-3940e7ae4c65 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:17.862670 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85e4f7-c456-46b8-b9f1-3940e7ae4c65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:17.872528 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85e4f7-c456-46b8-b9f1-3940e7ae4c65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:17.880890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-ba85e4f7-c456-46b8-b9f1-3940e7ae4c65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:17.880890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:17.880890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:17.880890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:17.880890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:17.880890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:17.880890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:17.880890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:17.880890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:17.880890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:17.880890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:17.880890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:17.880890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:17.880890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:17.880890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:17.880890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:17.881951 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:17.881951 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:17.881951 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:17.881951 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:17.881951 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:17.881951 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:17.881951 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:17.881951 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:17.881951 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:17.881951 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:17.881951 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:17.881951 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:17.881951 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:17.881951 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:17.881951 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:17.881951 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:17.882864 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:17.882864 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:17.882864 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:17.882864 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:17.882864 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:17.882864 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:17.882864 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:17.882864 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:17.882864 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:17.882864 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:17.882864 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:17.882864 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:17.882864 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 246/504] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 08:32:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:17.882864 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85e4f7-c456-46b8-b9f1-3940e7ae4c65 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:17.897147 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bdd6de-1b40-4893-bd4b-f88ae2fa2aa0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:17.898733 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bdd6de-1b40-4893-bd4b-f88ae2fa2aa0 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:17.923264 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:17.982774 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:17.988911 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85e4f7-c456-46b8-b9f1-3940e7ae4c65 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:17.997954 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 259/505] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:32:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:32:17.998790 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bdd6de-1b40-4893-bd4b-f88ae2fa2aa0 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:18.024725 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251a90d-7b35-4d81-a66b-8463511637e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:18.025383 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251a90d-7b35-4d81-a66b-8463511637e1 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:18.025663 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251a90d-7b35-4d81-a66b-8463511637e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:18.025952 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251a90d-7b35-4d81-a66b-8463511637e1 None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:18.026787 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d251a90d-7b35-4d81-a66b-8463511637e1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:18.027093 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d251a90d-7b35-4d81-a66b-8463511637e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:18.028560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d251a90d-7b35-4d81-a66b-8463511637e1 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:18.066322 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 247/506] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Jul 25 08:32:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:18.067658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb0a95-17aa-47ed-91d4-dcfcd6ba102b None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:18.067944 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb0a95-17aa-47ed-91d4-dcfcd6ba102b None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:18.068217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb0a95-17aa-47ed-91d4-dcfcd6ba102b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:18.086655 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-95cb0a95-17aa-47ed-91d4-dcfcd6ba102b None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:18.087799 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-95cb0a95-17aa-47ed-91d4-dcfcd6ba102b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:18.096082 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bdd6de-1b40-4893-bd4b-f88ae2fa2aa0 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:18.119257 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:18.130145 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688a834-4f49-41e8-b365-59b1d0c908c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:18.130807 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688a834-4f49-41e8-b365-59b1d0c908c9 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:18.131088 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688a834-4f49-41e8-b365-59b1d0c908c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:18.131393 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688a834-4f49-41e8-b365-59b1d0c908c9 None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:18.132151 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688a834-4f49-41e8-b365-59b1d0c908c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:18.132457 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688a834-4f49-41e8-b365-59b1d0c908c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:18.133823 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688a834-4f49-41e8-b365-59b1d0c908c9 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:18.144874 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 260/507] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:18.145663 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688a834-4f49-41e8-b365-59b1d0c908c9 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:18.154728 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 248/508] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:32:18.155549 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb0a95-17aa-47ed-91d4-dcfcd6ba102b None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:18.237879 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:18.249386 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688a834-4f49-41e8-b365-59b1d0c908c9 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:18.256276 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb0a95-17aa-47ed-91d4-dcfcd6ba102b None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:18.283594 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63bf28-aff8-4ef3-a030-b201c5923762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:18.284551 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63bf28-aff8-4ef3-a030-b201c5923762 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:18.284836 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63bf28-aff8-4ef3-a030-b201c5923762 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:18.285112 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63bf28-aff8-4ef3-a030-b201c5923762 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:18.285858 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63bf28-aff8-4ef3-a030-b201c5923762 None admin] RBAC: Adding query filter params (name=service) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:18.286168 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63bf28-aff8-4ef3-a030-b201c5923762 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:18.287548 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63bf28-aff8-4ef3-a030-b201c5923762 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:18.290749 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306e2fa-f348-4bef-833c-2024496c7552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:18.291533 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306e2fa-f348-4bef-833c-2024496c7552 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:18.291849 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306e2fa-f348-4bef-833c-2024496c7552 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:18.292128 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306e2fa-f348-4bef-833c-2024496c7552 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:18.295435 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 261/509] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 08:32:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:18.296241 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63bf28-aff8-4ef3-a030-b201c5923762 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:18.302455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306e2fa-f348-4bef-833c-2024496c7552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:18.303941 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306e2fa-f348-4bef-833c-2024496c7552 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:18.321971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-9306e2fa-f348-4bef-833c-2024496c7552 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:18.321971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:18.321971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:18.321971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:18.321971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:18.321971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:18.321971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:18.321971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:18.321971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:18.321971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:18.321971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:18.321971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:18.321971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:18.321971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:18.321971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:18.323007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:18.323007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:18.323007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:18.323007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:18.323007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:18.323007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:18.323007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:18.323007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:18.323007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:18.323007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:18.323007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:18.323007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:18.323007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:18.323007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:18.323007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:18.323007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:18.323007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:18.323930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:18.323930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:18.323930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:18.323930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:18.323930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 249/510] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:18.323930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306e2fa-f348-4bef-833c-2024496c7552 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:18.348487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:18.401125 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63bf28-aff8-4ef3-a030-b201c5923762 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:18.422687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306e2fa-f348-4bef-833c-2024496c7552 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:18.436232 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b71080-b9ec-40ca-ade3-70b8250c93cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:18.436877 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b71080-b9ec-40ca-ade3-70b8250c93cc None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:18.437156 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b71080-b9ec-40ca-ade3-70b8250c93cc None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:18.437428 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b71080-b9ec-40ca-ade3-70b8250c93cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:18.457946 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c40e7a-95e5-4e06-99b5-26fca28d2027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:18.458726 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c40e7a-95e5-4e06-99b5-26fca28d2027 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:18.459012 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c40e7a-95e5-4e06-99b5-26fca28d2027 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:18.459285 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c40e7a-95e5-4e06-99b5-26fca28d2027 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:18.461250 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:18.467191 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c40e7a-95e5-4e06-99b5-26fca28d2027 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:18.468668 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c40e7a-95e5-4e06-99b5-26fca28d2027 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:18.483455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-23c40e7a-95e5-4e06-99b5-26fca28d2027 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 08:32:18.483455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:18.483455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:18.483455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:18.483455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:18.483455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:18.483455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:18.483455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:18.483455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:18.483455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:18.483455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:18.483455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:18.483455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:32:18.483455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:32:18.483455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:32:18.483455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:32:18.484543 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:18.484543 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:18.484543 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:32:18.484543 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:18.484543 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:32:18.484543 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:18.484543 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:18.484543 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:18.484543 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:18.484543 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:18.484543 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:18.484543 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:18.484543 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:18.484543 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:18.484543 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:18.484543 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:18.484543 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:18.484543 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:18.486365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:18.486365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:18.486365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:32:18.486365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:32:18.486365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:32:18.486365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:32:18.486365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:32:18.486365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:32:18.486365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 08:32:18.486365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:18.486365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 250/511] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:32:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:18.487063 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c40e7a-95e5-4e06-99b5-26fca28d2027 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:18.508342 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b71080-b9ec-40ca-ade3-70b8250c93cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:18.509795 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b71080-b9ec-40ca-ade3-70b8250c93cc None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:18.554826 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:18.590543 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c40e7a-95e5-4e06-99b5-26fca28d2027 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:18.608551 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 262/512] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:32:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:32:18.609309 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b71080-b9ec-40ca-ade3-70b8250c93cc None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:18.627444 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c382a50-77e9-4818-900b-1391af4eca43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:18.628260 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c382a50-77e9-4818-900b-1391af4eca43 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:18.628548 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c382a50-77e9-4818-900b-1391af4eca43 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:18.628824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c382a50-77e9-4818-900b-1391af4eca43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:18.639382 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c382a50-77e9-4818-900b-1391af4eca43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:18.641469 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c382a50-77e9-4818-900b-1391af4eca43 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:18.659478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-7c382a50-77e9-4818-900b-1391af4eca43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:18.659478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:18.659478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:18.659478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:18.659478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:18.659478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:18.659478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:18.659478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:18.659478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:18.659478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:18.659478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:18.659478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:18.659478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:18.659478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:18.659478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:18.660489 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:18.660489 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:18.660489 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:18.660489 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:18.660489 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:18.660489 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:18.660489 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:18.660489 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:18.660489 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:18.660489 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:18.660489 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:18.660489 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:18.660489 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:18.660489 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:18.660489 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:18.660489 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:18.660489 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:18.661458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:18.661458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:18.661458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:18.661458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:18.661458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 251/513] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:18.661458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c382a50-77e9-4818-900b-1391af4eca43 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:18.710251 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:18.725888 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b71080-b9ec-40ca-ade3-70b8250c93cc None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:18.759706 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9b014-7a2e-4326-96b1-2e78c3b64aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:18.760490 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9b014-7a2e-4326-96b1-2e78c3b64aa7 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:18.760773 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9b014-7a2e-4326-96b1-2e78c3b64aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:18.761045 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9b014-7a2e-4326-96b1-2e78c3b64aa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:18.761933 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c382a50-77e9-4818-900b-1391af4eca43 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:18.770842 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9b014-7a2e-4326-96b1-2e78c3b64aa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:18.772327 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9b014-7a2e-4326-96b1-2e78c3b64aa7 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:18.778897 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:18.790127 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-3ab9b014-7a2e-4326-96b1-2e78c3b64aa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:18.790127 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:18.790127 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:18.790127 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:18.790127 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:18.790127 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:18.790127 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:18.790127 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:18.790127 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:18.790127 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:18.790127 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:18.790127 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:18.790127 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:18.790127 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:18.790127 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:18.791636 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:18.791636 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:18.791636 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:18.791636 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:18.791636 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:18.791636 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:18.791636 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:18.791636 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:18.791636 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:18.791636 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:18.791636 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:18.791636 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:18.791636 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:18.791636 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:18.791636 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:18.791636 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:18.791636 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:18.792779 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:18.792779 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:18.792779 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:18.792779 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:18.792779 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 263/514] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:18.792779 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9b014-7a2e-4326-96b1-2e78c3b64aa7 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:18.795797 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3df16-6468-4d15-863f-722fe6c6db22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:18.796547 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3df16-6468-4d15-863f-722fe6c6db22 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:18.796878 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3df16-6468-4d15-863f-722fe6c6db22 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:18.797696 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3df16-6468-4d15-863f-722fe6c6db22 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:18.798684 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3df16-6468-4d15-863f-722fe6c6db22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:18.798993 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3df16-6468-4d15-863f-722fe6c6db22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:18.800384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3df16-6468-4d15-863f-722fe6c6db22 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:18.812106 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 252/515] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:18.812971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3df16-6468-4d15-863f-722fe6c6db22 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:18.893946 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9b014-7a2e-4326-96b1-2e78c3b64aa7 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:18.909832 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3df16-6468-4d15-863f-722fe6c6db22 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:18.916953 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:18.927225 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa02672-fbc8-4b12-8211-ee800f612f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:18.927930 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa02672-fbc8-4b12-8211-ee800f612f69 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:18.928259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa02672-fbc8-4b12-8211-ee800f612f69 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:18.928571 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa02672-fbc8-4b12-8211-ee800f612f69 None admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:18.929417 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa02672-fbc8-4b12-8211-ee800f612f69 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:18.929730 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa02672-fbc8-4b12-8211-ee800f612f69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:18.931198 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa02672-fbc8-4b12-8211-ee800f612f69 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:18.943444 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2cce12-d216-4222-8bd1-c1ead5158ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:18.944251 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cce12-d216-4222-8bd1-c1ead5158ef4 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:18.944534 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cce12-d216-4222-8bd1-c1ead5158ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:18.944807 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cce12-d216-4222-8bd1-c1ead5158ef4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:18.949009 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 264/516] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Jul 25 08:32:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:18.949803 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa02672-fbc8-4b12-8211-ee800f612f69 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:18.956240 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2cce12-d216-4222-8bd1-c1ead5158ef4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:18.957684 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2cce12-d216-4222-8bd1-c1ead5158ef4 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:18.975982 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-ec2cce12-d216-4222-8bd1-c1ead5158ef4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:18.975982 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:18.975982 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:18.975982 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:18.975982 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:18.975982 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:18.975982 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:18.975982 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:18.975982 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:18.975982 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:18.975982 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:18.975982 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:18.975982 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:18.975982 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:18.975982 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:18.976983 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:18.976983 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:18.976983 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:18.976983 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:18.976983 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:18.976983 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:18.976983 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:18.976983 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:18.976983 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:18.976983 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:18.976983 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:18.976983 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:18.976983 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:18.976983 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:18.976983 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:18.976983 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:18.976983 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:18.978009 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:18.978009 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:18.978009 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:18.978009 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:18.980021 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 253/517] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:18.981090 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2cce12-d216-4222-8bd1-c1ead5158ef4 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:19.005519 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:19.048927 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa02672-fbc8-4b12-8211-ee800f612f69 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:19.078978 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2cce12-d216-4222-8bd1-c1ead5158ef4 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:19.081312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82c162-aeaf-4335-9dcd-4551e71479d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:19.081969 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82c162-aeaf-4335-9dcd-4551e71479d4 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:19.082251 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82c162-aeaf-4335-9dcd-4551e71479d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:19.082526 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82c162-aeaf-4335-9dcd-4551e71479d4 None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:19.083247 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82c162-aeaf-4335-9dcd-4551e71479d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:19.083556 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82c162-aeaf-4335-9dcd-4551e71479d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:19.084955 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82c162-aeaf-4335-9dcd-4551e71479d4 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:19.097014 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 265/518] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:19.097807 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82c162-aeaf-4335-9dcd-4551e71479d4 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:19.115112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa2251-979f-4c54-b8e3-e9f614ae1a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:19.115882 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa2251-979f-4c54-b8e3-e9f614ae1a7d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:19.116168 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa2251-979f-4c54-b8e3-e9f614ae1a7d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:19.116449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa2251-979f-4c54-b8e3-e9f614ae1a7d None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:19.117173 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa2251-979f-4c54-b8e3-e9f614ae1a7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:19.117481 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa2251-979f-4c54-b8e3-e9f614ae1a7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:19.118854 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa2251-979f-4c54-b8e3-e9f614ae1a7d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:19.130628 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 254/519] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:19.131529 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa2251-979f-4c54-b8e3-e9f614ae1a7d None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:19.151096 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:19.195835 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82c162-aeaf-4335-9dcd-4551e71479d4 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:19.211887 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:19.229212 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf206362-d252-4172-ab82-8e288608edca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:19.229992 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf206362-d252-4172-ab82-8e288608edca None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:19.230269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf206362-d252-4172-ab82-8e288608edca None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:19.230540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf206362-d252-4172-ab82-8e288608edca None admin] PATH_INFO: `/v3/projects/service` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:19.232664 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa2251-979f-4c54-b8e3-e9f614ae1a7d None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:19.237169 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf206362-d252-4172-ab82-8e288608edca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:19.238616 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf206362-d252-4172-ab82-8e288608edca None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:19.254843 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-bf206362-d252-4172-ab82-8e288608edca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:19.254843 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:19.254843 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:19.254843 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:19.254843 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:19.254843 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:19.254843 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:19.254843 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:19.254843 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:19.254843 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:19.254843 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:19.254843 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:19.254843 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:32:19.254843 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:32:19.254843 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:32:19.255876 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:32:19.255876 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:19.255876 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:19.255876 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:19.255876 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:19.255876 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:19.255876 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:19.255876 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:19.255876 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:19.255876 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:19.255876 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:19.255876 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:19.255876 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:19.255876 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:19.255876 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:19.255876 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:19.255876 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:19.256998 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:32:19.256998 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:32:19.256998 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:32:19.256998 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:32:19.256998 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:32:19.256998 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:32:19.256998 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:19.256998 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:19.256998 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 266/520] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:32:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:19.257680 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf206362-d252-4172-ab82-8e288608edca None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:19.269484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a64b7-9e03-44db-b824-de2caadfea43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:19.270137 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a64b7-9e03-44db-b824-de2caadfea43 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:19.270424 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a64b7-9e03-44db-b824-de2caadfea43 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:19.270700 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a64b7-9e03-44db-b824-de2caadfea43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:19.339178 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a64b7-9e03-44db-b824-de2caadfea43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:19.340690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a64b7-9e03-44db-b824-de2caadfea43 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:19.355666 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf206362-d252-4172-ab82-8e288608edca None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:19.358763 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:19.388355 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86856c-925e-4836-8037-4bcc22abc448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:19.389011 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86856c-925e-4836-8037-4bcc22abc448 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:19.389294 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86856c-925e-4836-8037-4bcc22abc448 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:19.389572 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86856c-925e-4836-8037-4bcc22abc448 None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:19.390291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86856c-925e-4836-8037-4bcc22abc448 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:19.390597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86856c-925e-4836-8037-4bcc22abc448 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:19.392714 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86856c-925e-4836-8037-4bcc22abc448 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:19.403946 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 267/521] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:19.404647 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86856c-925e-4836-8037-4bcc22abc448 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:19.439233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:19.444465 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 255/522] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:32:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:32:19.445291 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a64b7-9e03-44db-b824-de2caadfea43 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:19.503796 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86856c-925e-4836-8037-4bcc22abc448 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:19.538095 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f4dbf-1016-41b6-9da7-8128404cb447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:19.538754 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f4dbf-1016-41b6-9da7-8128404cb447 None admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:19.539041 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f4dbf-1016-41b6-9da7-8128404cb447 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:19.539427 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f4dbf-1016-41b6-9da7-8128404cb447 None admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:19.540051 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f4dbf-1016-41b6-9da7-8128404cb447 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:19.541489 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f4dbf-1016-41b6-9da7-8128404cb447 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:19.545593 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a64b7-9e03-44db-b824-de2caadfea43 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:19.562604 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:19.579481 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c8e04-ce36-4150-ad0b-80b0f4d6d42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:19.580292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c8e04-ce36-4150-ad0b-80b0f4d6d42c None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:19.580581 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c8e04-ce36-4150-ad0b-80b0f4d6d42c None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:19.580860 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c8e04-ce36-4150-ad0b-80b0f4d6d42c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:19.587665 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c8e04-ce36-4150-ad0b-80b0f4d6d42c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:19.591504 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c8e04-ce36-4150-ad0b-80b0f4d6d42c None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:19.603948 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-710c8e04-ce36-4150-ad0b-80b0f4d6d42c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 08:32:19.603948 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:19.603948 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:19.603948 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:19.603948 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:19.603948 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:19.603948 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:19.603948 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:19.603948 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:19.603948 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:19.603948 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:19.603948 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:19.603948 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:32:19.603948 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:32:19.603948 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:32:19.603948 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:32:19.604985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:19.604985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:19.604985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:32:19.604985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:19.604985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:32:19.604985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:19.604985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:19.604985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:19.604985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:19.604985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:19.604985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:19.604985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:19.604985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:19.604985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:19.604985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:19.604985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:19.604985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:19.604985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:19.606094 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:19.606094 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:19.606094 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:32:19.606094 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:32:19.606094 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:32:19.606094 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:32:19.606094 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:32:19.606094 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:32:19.606094 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 08:32:19.606094 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:19.606094 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 256/523] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 08:32:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:19.606094 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c8e04-ce36-4150-ad0b-80b0f4d6d42c None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:19.631643 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 268/524] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jul 25 08:32:19 2022] POST /identity/v3/users => generated 247 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:32:19.631643 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f4dbf-1016-41b6-9da7-8128404cb447 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:19.727290 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c8e04-ce36-4150-ad0b-80b0f4d6d42c None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:19.727558 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:19.738186 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f4dbf-1016-41b6-9da7-8128404cb447 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:19.767551 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdfcfa7-ca52-428b-8669-fe569c2eb4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:19.767551 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfcfa7-ca52-428b-8669-fe569c2eb4c3 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:19.767551 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfcfa7-ca52-428b-8669-fe569c2eb4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:19.767551 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfcfa7-ca52-428b-8669-fe569c2eb4c3 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:19.768354 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdfcfa7-ca52-428b-8669-fe569c2eb4c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:19.768659 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdfcfa7-ca52-428b-8669-fe569c2eb4c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:19.770228 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdfcfa7-ca52-428b-8669-fe569c2eb4c3 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:19.778167 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c472d3-4987-45ba-a623-772fdbafbed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:19.779414 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c472d3-4987-45ba-a623-772fdbafbed2 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:19.779414 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c472d3-4987-45ba-a623-772fdbafbed2 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:19.779592 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c472d3-4987-45ba-a623-772fdbafbed2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:19.788772 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c472d3-4987-45ba-a623-772fdbafbed2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:19.790089 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 257/525] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:32:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:19.790663 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c472d3-4987-45ba-a623-772fdbafbed2 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:19.791809 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdfcfa7-ca52-428b-8669-fe569c2eb4c3 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:19.807501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-38c472d3-4987-45ba-a623-772fdbafbed2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:19.807501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:19.807501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:19.807501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:19.807501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:19.807501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:19.807501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:19.807501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:19.807501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:19.807501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:19.807501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:19.807501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:19.807501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:32:19.807501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:32:19.807501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:32:19.808621 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:32:19.808621 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:19.808621 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:19.808621 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:19.808621 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:19.808621 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:19.808621 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:19.808621 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:19.808621 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:19.808621 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:19.808621 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:19.808621 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:19.808621 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:19.808621 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:19.808621 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:19.808621 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:19.808621 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:19.809533 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:32:19.809533 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:32:19.809533 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:32:19.809533 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:32:19.809533 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:32:19.809533 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:32:19.809533 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:19.809533 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:19.809533 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 269/526] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:32:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:19.809982 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c472d3-4987-45ba-a623-772fdbafbed2 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:19.845059 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:19.912882 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdfcfa7-ca52-428b-8669-fe569c2eb4c3 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:19.916511 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c472d3-4987-45ba-a623-772fdbafbed2 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:19.948709 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd7b62-9feb-40a3-ba30-f1f6faf3ef12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:19.949492 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd7b62-9feb-40a3-ba30-f1f6faf3ef12 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:19.949784 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd7b62-9feb-40a3-ba30-f1f6faf3ef12 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:19.950066 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd7b62-9feb-40a3-ba30-f1f6faf3ef12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:19.951165 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4062f-ec19-4e5f-96cf-c16b12c742be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:19.951877 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4062f-ec19-4e5f-96cf-c16b12c742be None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:19.952157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4062f-ec19-4e5f-96cf-c16b12c742be None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:19.952430 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4062f-ec19-4e5f-96cf-c16b12c742be None admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:19.953309 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4062f-ec19-4e5f-96cf-c16b12c742be None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:19.954241 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4062f-ec19-4e5f-96cf-c16b12c742be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:19.955712 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4062f-ec19-4e5f-96cf-c16b12c742be None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:19.961022 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd7b62-9feb-40a3-ba30-f1f6faf3ef12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:19.962544 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd7b62-9feb-40a3-ba30-f1f6faf3ef12 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:19.978057 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 270/527] 10.222.0.18 () {56 vars in 1139 bytes} [Mon Jul 25 08:32:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:19.978057 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4062f-ec19-4e5f-96cf-c16b12c742be None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:19.980515 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-9bdd7b62-9feb-40a3-ba30-f1f6faf3ef12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:19.980515 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:19.980515 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:19.980515 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:19.980515 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:19.980515 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:19.980515 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:19.980515 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:19.980515 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:19.980515 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:19.980515 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:19.980515 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:19.980515 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:19.980515 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:19.980515 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:19.981399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:19.981399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:19.981399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:19.981399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:19.981399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:19.981399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:19.981399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:19.981399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:19.981399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:19.981399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:19.981399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:19.981399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:19.981399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:19.981399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:19.981399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:19.981399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:19.981399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:19.982232 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:19.982232 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:19.982232 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:19.982232 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:19.982232 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 258/528] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:19.982508 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd7b62-9feb-40a3-ba30-f1f6faf3ef12 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:19.995600 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:20.077619 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:20.088184 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd7b62-9feb-40a3-ba30-f1f6faf3ef12 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:20.088361 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4062f-ec19-4e5f-96cf-c16b12c742be None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:20.124982 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31ce77-7fde-43af-bb85-281f570b5c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:20.125891 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31ce77-7fde-43af-bb85-281f570b5c45 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:20.126259 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31ce77-7fde-43af-bb85-281f570b5c45 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:20.126541 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31ce77-7fde-43af-bb85-281f570b5c45 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:20.127079 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98d14b-966d-45b6-843e-3cde21f4c6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:20.127346 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed31ce77-7fde-43af-bb85-281f570b5c45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:20.127680 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed31ce77-7fde-43af-bb85-281f570b5c45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:20.127772 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98d14b-966d-45b6-843e-3cde21f4c6df None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:20.128047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98d14b-966d-45b6-843e-3cde21f4c6df None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:20.128328 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98d14b-966d-45b6-843e-3cde21f4c6df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:20.129126 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed31ce77-7fde-43af-bb85-281f570b5c45 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:20.129215 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98d14b-966d-45b6-843e-3cde21f4c6df None admin] RBAC: Adding query filter params (role.id=a0a4f5f9b3264740a55056fed8fd7a33, scope.project.id=be349194440449209f19f6b535ffd4f6, user.id=1c1a08d3a76643a9996dc0daa8714ac6) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:20.129474 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98d14b-966d-45b6-843e-3cde21f4c6df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:20.131115 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98d14b-966d-45b6-843e-3cde21f4c6df None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:20.147115 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 271/529] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:32:19 2022] GET /identity/v3/role_assignments?user.id=1c1a08d3a76643a9996dc0daa8714ac6&scope.project.id=be349194440449209f19f6b535ffd4f6&role.id=a0a4f5f9b3264740a55056fed8fd7a33 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:20.147115 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98d14b-966d-45b6-843e-3cde21f4c6df None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:20.147366 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 259/530] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:32:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:20.147366 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31ce77-7fde-43af-bb85-281f570b5c45 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:20.251781 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:20.281403 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98d14b-966d-45b6-843e-3cde21f4c6df None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:20.290307 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31ce77-7fde-43af-bb85-281f570b5c45 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:20.319739 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb109268-ce1d-4dfa-9912-ea3755fdefc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:20.320398 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb109268-ce1d-4dfa-9912-ea3755fdefc6 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:20.320682 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb109268-ce1d-4dfa-9912-ea3755fdefc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:20.320957 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb109268-ce1d-4dfa-9912-ea3755fdefc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:20.348006 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767ca3f-594d-4576-b1f1-86bea6c8f4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:20.349611 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767ca3f-594d-4576-b1f1-86bea6c8f4a9 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:20.350357 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767ca3f-594d-4576-b1f1-86bea6c8f4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:20.350831 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767ca3f-594d-4576-b1f1-86bea6c8f4a9 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:20.352053 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767ca3f-594d-4576-b1f1-86bea6c8f4a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:20.352898 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767ca3f-594d-4576-b1f1-86bea6c8f4a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:20.354961 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767ca3f-594d-4576-b1f1-86bea6c8f4a9 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:20.373263 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 260/531] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:20.374377 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767ca3f-594d-4576-b1f1-86bea6c8f4a9 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:20.391659 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:20.412884 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb109268-ce1d-4dfa-9912-ea3755fdefc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:20.415362 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb109268-ce1d-4dfa-9912-ea3755fdefc6 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:20.490545 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767ca3f-594d-4576-b1f1-86bea6c8f4a9 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:20.521854 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:20.527318 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37803dc2-7adb-4305-b586-9e52939462b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:20.528141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37803dc2-7adb-4305-b586-9e52939462b9 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:20.528495 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37803dc2-7adb-4305-b586-9e52939462b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:20.528840 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37803dc2-7adb-4305-b586-9e52939462b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:20.529726 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37803dc2-7adb-4305-b586-9e52939462b9 None admin] RBAC: Adding query filter params (role.id=a0a4f5f9b3264740a55056fed8fd7a33, scope.project.id=be349194440449209f19f6b535ffd4f6, user.id=c53b69c61d9a46bc9e8aa1b4a9fd5fec) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:20.529996 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37803dc2-7adb-4305-b586-9e52939462b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:20.531451 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37803dc2-7adb-4305-b586-9e52939462b9 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:20.543656 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 261/532] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:32:20 2022] GET /identity/v3/role_assignments?user.id=c53b69c61d9a46bc9e8aa1b4a9fd5fec&scope.project.id=be349194440449209f19f6b535ffd4f6&role.id=a0a4f5f9b3264740a55056fed8fd7a33 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:20.543656 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37803dc2-7adb-4305-b586-9e52939462b9 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:20.570370 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 272/533] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:32:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:32:20.576473 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb109268-ce1d-4dfa-9912-ea3755fdefc6 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:20.676065 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:20.700686 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37803dc2-7adb-4305-b586-9e52939462b9 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:20.739309 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe38cb-c6e1-45bc-a9f1-9786e6c0ab72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:20.740258 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe38cb-c6e1-45bc-a9f1-9786e6c0ab72 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:20.740604 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe38cb-c6e1-45bc-a9f1-9786e6c0ab72 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:20.740706 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb109268-ce1d-4dfa-9912-ea3755fdefc6 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:20.740894 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe38cb-c6e1-45bc-a9f1-9786e6c0ab72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:20.749061 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe38cb-c6e1-45bc-a9f1-9786e6c0ab72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:20.750555 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe38cb-c6e1-45bc-a9f1-9786e6c0ab72 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:20.768555 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-4ebe38cb-c6e1-45bc-a9f1-9786e6c0ab72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:20.768555 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:20.768555 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:20.768555 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:20.768555 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:20.768555 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:20.768555 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:20.768555 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:20.768555 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:20.768555 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:20.768555 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:20.768555 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:20.768555 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:32:20.768555 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:32:20.768555 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:32:20.769468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:32:20.769468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:20.769468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:20.769468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:20.769468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:20.769468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:20.769468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:20.769468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:20.769468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:20.769468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:20.769468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:20.769468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:20.769468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:20.769468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:20.769468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:20.769468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:20.769468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:20.770305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:32:20.770305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:32:20.770305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:32:20.770305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:32:20.770305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:32:20.770305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:32:20.770305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:20.770305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:20.770305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 262/534] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:32:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:20.775954 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe38cb-c6e1-45bc-a9f1-9786e6c0ab72 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:20.778716 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdcfd9-635a-4d90-89f1-fd700acdae13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:20.779658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdcfd9-635a-4d90-89f1-fd700acdae13 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:20.779953 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdcfd9-635a-4d90-89f1-fd700acdae13 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:20.780228 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdcfd9-635a-4d90-89f1-fd700acdae13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:20.797956 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cdcfd9-635a-4d90-89f1-fd700acdae13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:20.799646 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cdcfd9-635a-4d90-89f1-fd700acdae13 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:20.819412 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-d0cdcfd9-635a-4d90-89f1-fd700acdae13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:20.819412 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:20.819412 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:20.819412 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:20.819412 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:20.819412 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:20.819412 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:20.819412 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:20.819412 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:20.819412 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:20.819412 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:20.819412 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:20.819412 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:20.819412 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:20.819412 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:20.821496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:20.821496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:20.821496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:20.821496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:20.821496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:20.821496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:20.821496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:20.821496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:20.821496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:20.821496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:20.821496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:20.821496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:20.821496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:20.821496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:20.821496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:20.821496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:20.821496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:20.822945 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:20.822945 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:20.822945 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:20.822945 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:20.822945 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 273/535] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:20.830666 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdcfd9-635a-4d90-89f1-fd700acdae13 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:20.884050 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:20.887708 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe38cb-c6e1-45bc-a9f1-9786e6c0ab72 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:20.924147 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef92536-4ab3-44be-933e-9fdd8bd2aca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:20.924929 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef92536-4ab3-44be-933e-9fdd8bd2aca1 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:20.925090 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef92536-4ab3-44be-933e-9fdd8bd2aca1 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:20.925326 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef92536-4ab3-44be-933e-9fdd8bd2aca1 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:20.926118 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef92536-4ab3-44be-933e-9fdd8bd2aca1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:20.926425 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef92536-4ab3-44be-933e-9fdd8bd2aca1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:20.927886 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef92536-4ab3-44be-933e-9fdd8bd2aca1 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:20.935247 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:20.949110 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 263/536] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:32:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:20.955040 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef92536-4ab3-44be-933e-9fdd8bd2aca1 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:21.010143 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdcfd9-635a-4d90-89f1-fd700acdae13 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:21.058221 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef92536-4ab3-44be-933e-9fdd8bd2aca1 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:21.070916 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005fe7a-1add-4502-a488-0d265f4d4f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:21.071596 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005fe7a-1add-4502-a488-0d265f4d4f6c None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:21.071901 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005fe7a-1add-4502-a488-0d265f4d4f6c None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:21.072179 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005fe7a-1add-4502-a488-0d265f4d4f6c None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:21.073014 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005fe7a-1add-4502-a488-0d265f4d4f6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:21.073327 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005fe7a-1add-4502-a488-0d265f4d4f6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:21.074819 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005fe7a-1add-4502-a488-0d265f4d4f6c None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:21.094091 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac6d95-49fb-4a90-bb30-604c0966eccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:21.094815 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac6d95-49fb-4a90-bb30-604c0966eccc None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:21.095100 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac6d95-49fb-4a90-bb30-604c0966eccc None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:21.095371 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac6d95-49fb-4a90-bb30-604c0966eccc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:21.096240 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac6d95-49fb-4a90-bb30-604c0966eccc None admin] RBAC: Adding query filter params (role.id=a0a4f5f9b3264740a55056fed8fd7a33, scope.project.id=be349194440449209f19f6b535ffd4f6, user.id=dd75a24363c14e86b0fbbb782b372646) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:21.096544 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac6d95-49fb-4a90-bb30-604c0966eccc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:21.096710 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 274/537] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:21.097967 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac6d95-49fb-4a90-bb30-604c0966eccc None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:21.105197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005fe7a-1add-4502-a488-0d265f4d4f6c None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:21.109057 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 264/538] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:32:20 2022] GET /identity/v3/role_assignments?user.id=dd75a24363c14e86b0fbbb782b372646&scope.project.id=be349194440449209f19f6b535ffd4f6&role.id=a0a4f5f9b3264740a55056fed8fd7a33 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:21.211187 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:21.227174 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005fe7a-1add-4502-a488-0d265f4d4f6c None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:21.262467 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248269fe-76ec-417a-9519-12b21d14c62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:21.263281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248269fe-76ec-417a-9519-12b21d14c62c None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:21.263564 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248269fe-76ec-417a-9519-12b21d14c62c None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:21.263873 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248269fe-76ec-417a-9519-12b21d14c62c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:21.272194 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248269fe-76ec-417a-9519-12b21d14c62c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:21.273658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248269fe-76ec-417a-9519-12b21d14c62c None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:21.289750 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-248269fe-76ec-417a-9519-12b21d14c62c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:21.289750 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:21.289750 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:21.289750 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:21.289750 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:21.289750 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:21.289750 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:21.289750 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:21.289750 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:21.289750 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:21.289750 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:21.289750 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:21.289750 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:32:21.289750 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:32:21.289750 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:32:21.290654 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:32:21.290654 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:21.290654 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:21.290654 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:21.290654 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:21.290654 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:21.290654 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:21.290654 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:21.290654 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:21.290654 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:21.290654 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:21.290654 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:21.290654 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:21.290654 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:21.290654 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:21.290654 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:21.290654 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:21.291515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:32:21.291515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:32:21.291515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:32:21.291515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:32:21.291515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:32:21.291515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:32:21.291515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:21.291515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:21.291515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 275/539] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:32:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:32:21.296776 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac6d95-49fb-4a90-bb30-604c0966eccc None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:21.361864 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:21.404776 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac6d95-49fb-4a90-bb30-604c0966eccc None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:21.448297 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6fc3c-d22d-40f1-b378-4bc09b151633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:21.448965 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6fc3c-d22d-40f1-b378-4bc09b151633 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:21.449258 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6fc3c-d22d-40f1-b378-4bc09b151633 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:21.449537 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6fc3c-d22d-40f1-b378-4bc09b151633 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:21.450343 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6fc3c-d22d-40f1-b378-4bc09b151633 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:21.450657 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6fc3c-d22d-40f1-b378-4bc09b151633 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:21.452210 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6fc3c-d22d-40f1-b378-4bc09b151633 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:21.466859 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 265/540] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:32:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:32:21.473128 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248269fe-76ec-417a-9519-12b21d14c62c None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:21.586552 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248269fe-76ec-417a-9519-12b21d14c62c None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:21.621650 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a81db6-bdb8-4dfa-90de-d9c11541cbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:21.622230 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a81db6-bdb8-4dfa-90de-d9c11541cbb6 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:21.622553 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a81db6-bdb8-4dfa-90de-d9c11541cbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:21.622838 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a81db6-bdb8-4dfa-90de-d9c11541cbb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:21.623704 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a81db6-bdb8-4dfa-90de-d9c11541cbb6 None admin] RBAC: Adding query filter params (role.id=a0a4f5f9b3264740a55056fed8fd7a33, scope.project.id=be349194440449209f19f6b535ffd4f6, user.id=a08bd52110074f11ba56b2f02397062f) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:21.624020 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a81db6-bdb8-4dfa-90de-d9c11541cbb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:21.626245 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a81db6-bdb8-4dfa-90de-d9c11541cbb6 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:21.632272 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 276/541] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:32:21 2022] GET /identity/v3/role_assignments?user.id=a08bd52110074f11ba56b2f02397062f&scope.project.id=be349194440449209f19f6b535ffd4f6&role.id=a0a4f5f9b3264740a55056fed8fd7a33 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:21.862419 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efa324-acee-4160-ae95-45445361c94e None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:21.862790 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efa324-acee-4160-ae95-45445361c94e None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:21.862989 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efa324-acee-4160-ae95-45445361c94e None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:21.864674 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 266/542] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:21.869862 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254eac7c-9476-42de-b58c-8cd07c5537b9 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:21.870304 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254eac7c-9476-42de-b58c-8cd07c5537b9 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:21.870491 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254eac7c-9476-42de-b58c-8cd07c5537b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:21.889842 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-254eac7c-9476-42de-b58c-8cd07c5537b9 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:21.891637 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-254eac7c-9476-42de-b58c-8cd07c5537b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:21.894566 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:21.977530 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 277/543] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:32:22.022428 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efa324-acee-4160-ae95-45445361c94e None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:22.149325 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efa324-acee-4160-ae95-45445361c94e None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:22.169825 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:22.192878 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f0d35-2227-4272-8034-b92273547e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:22.193677 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f0d35-2227-4272-8034-b92273547e6d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:22.193964 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f0d35-2227-4272-8034-b92273547e6d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:22.194241 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f0d35-2227-4272-8034-b92273547e6d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:22.210878 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f0d35-2227-4272-8034-b92273547e6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:22.219478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-b01f0d35-2227-4272-8034-b92273547e6d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:22.219478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:22.219478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:22.219478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:22.219478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:22.219478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:22.219478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:22.219478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:22.219478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:22.219478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:22.219478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:22.219478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:22.219478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:22.219478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:22.219478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:22.219478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:22.220486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:22.220486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:22.220486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:22.220486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:22.220486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:22.220486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:22.220486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:22.220486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:22.220486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:22.220486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:22.220486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:22.220486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:22.220486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:22.220486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:22.220486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:22.220486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:22.221282 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:22.221282 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:22.221282 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:22.221282 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:22.221282 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:22.221282 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:22.221282 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:22.221282 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:22.221282 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:22.221282 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:22.221282 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:22.221282 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:22.223447 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 267/544] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 08:32:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:22.228325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254eac7c-9476-42de-b58c-8cd07c5537b9 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:22.363362 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254eac7c-9476-42de-b58c-8cd07c5537b9 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:22.417574 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00ff7f-d6a2-497b-bc3f-7711709b7ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:22.418587 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00ff7f-d6a2-497b-bc3f-7711709b7ffe None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:22.419075 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00ff7f-d6a2-497b-bc3f-7711709b7ffe None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:22.419567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00ff7f-d6a2-497b-bc3f-7711709b7ffe None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:22.420565 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00ff7f-d6a2-497b-bc3f-7711709b7ffe None admin] RBAC: Adding query filter params (name=service) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:22.421078 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00ff7f-d6a2-497b-bc3f-7711709b7ffe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:22.423257 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00ff7f-d6a2-497b-bc3f-7711709b7ffe None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:22.435996 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 278/545] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 08:32:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:22.443801 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f0d35-2227-4272-8034-b92273547e6d None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:22.615693 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f0d35-2227-4272-8034-b92273547e6d None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:22.655292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b269d21-25e5-42f2-a7fd-a3f74d0c144d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:22.656172 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b269d21-25e5-42f2-a7fd-a3f74d0c144d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:22.656548 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b269d21-25e5-42f2-a7fd-a3f74d0c144d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:22.656807 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b269d21-25e5-42f2-a7fd-a3f74d0c144d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:22.669117 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b269d21-25e5-42f2-a7fd-a3f74d0c144d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:22.670535 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b269d21-25e5-42f2-a7fd-a3f74d0c144d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:22.691047 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-8b269d21-25e5-42f2-a7fd-a3f74d0c144d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:22.691047 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:22.691047 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:22.691047 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:22.691047 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:22.691047 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:22.691047 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:22.691047 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:22.691047 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:22.691047 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:22.691047 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:22.691047 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:22.691047 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:22.691047 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:22.691047 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:22.692008 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:22.692008 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:22.692008 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:22.692008 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:22.692008 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:22.692008 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:22.692008 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:22.692008 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:22.692008 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:22.692008 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:22.692008 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:22.692008 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:22.692008 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:22.692008 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:22.692008 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:22.692008 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:22.692008 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:22.692833 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:22.692833 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:22.692833 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:22.692833 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:22.692833 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 268/546] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:22.701616 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00ff7f-d6a2-497b-bc3f-7711709b7ffe None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:22.715635 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:22.855334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00ff7f-d6a2-497b-bc3f-7711709b7ffe None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:22.901665 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2404c93-8011-4f1d-9f44-b5e9327297d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:22.903050 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2404c93-8011-4f1d-9f44-b5e9327297d0 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:22.903516 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2404c93-8011-4f1d-9f44-b5e9327297d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:22.903996 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2404c93-8011-4f1d-9f44-b5e9327297d0 None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:22.904924 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2404c93-8011-4f1d-9f44-b5e9327297d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:22.905436 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2404c93-8011-4f1d-9f44-b5e9327297d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:22.907697 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2404c93-8011-4f1d-9f44-b5e9327297d0 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:22.927997 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 279/547] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:22.933670 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b269d21-25e5-42f2-a7fd-a3f74d0c144d None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:22.942283 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2d256-0a1a-4cdc-80e1-c123bf6ec80c None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:22.942823 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2d256-0a1a-4cdc-80e1-c123bf6ec80c None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:22.943739 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2d256-0a1a-4cdc-80e1-c123bf6ec80c None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:22.945601 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 280/548] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:22.952191 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8f66a-1931-4966-a143-9fea3995d779 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:22.952713 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8f66a-1931-4966-a143-9fea3995d779 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:22.953959 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8f66a-1931-4966-a143-9fea3995d779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:22.987179 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-66b8f66a-1931-4966-a143-9fea3995d779 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:22.989987 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-66b8f66a-1931-4966-a143-9fea3995d779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:22.990510 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:23.108893 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:23.130732 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b269d21-25e5-42f2-a7fd-a3f74d0c144d None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:23.132337 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 281/549] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:32:23.146432 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee6c2e-4c60-4a0a-8737-4a70833daf60 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:23.147105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee6c2e-4c60-4a0a-8737-4a70833daf60 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:23.148019 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee6c2e-4c60-4a0a-8737-4a70833daf60 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:23.149554 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 282/550] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:32:23.155227 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf1022-4012-4576-889e-33cdbc4a49e5 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:23.155992 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf1022-4012-4576-889e-33cdbc4a49e5 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:23.156567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf1022-4012-4576-889e-33cdbc4a49e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:23.181031 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-3baf1022-4012-4576-889e-33cdbc4a49e5 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:23.182921 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-3baf1022-4012-4576-889e-33cdbc4a49e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:23.192459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd415e-1f48-4393-ac27-b00b1b7f58b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:23.193655 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd415e-1f48-4393-ac27-b00b1b7f58b0 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:23.193831 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd415e-1f48-4393-ac27-b00b1b7f58b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:23.194218 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd415e-1f48-4393-ac27-b00b1b7f58b0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:23.202960 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd415e-1f48-4393-ac27-b00b1b7f58b0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:23.204639 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd415e-1f48-4393-ac27-b00b1b7f58b0 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:23.220257 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-89cd415e-1f48-4393-ac27-b00b1b7f58b0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 08:32:23.220257 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:23.220257 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:23.220257 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:23.220257 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:23.220257 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:23.220257 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:23.220257 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:23.220257 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:23.220257 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:23.220257 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:23.220257 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:23.220257 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:32:23.220257 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:32:23.220257 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:32:23.220257 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:32:23.221379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:23.221379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:23.221379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:32:23.221379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:23.221379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:32:23.221379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:23.221379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:23.221379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:23.221379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:23.221379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:23.221379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:23.221379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:23.221379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:23.221379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:23.221379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:23.221379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:23.221379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:23.221379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:23.222276 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:23.222276 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:23.222276 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:32:23.222276 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:32:23.222276 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:32:23.222276 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:32:23.222276 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:32:23.222276 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:32:23.222276 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 08:32:23.222276 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:23.222792 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 269/551] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:32:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:23.227557 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd415e-1f48-4393-ac27-b00b1b7f58b0 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:23.280731 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 283/552] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:32:23.280731 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf1022-4012-4576-889e-33cdbc4a49e5 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:23.350924 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:23.362731 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd415e-1f48-4393-ac27-b00b1b7f58b0 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:23.404220 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201274d5-1626-4ce0-8d61-eb28f4622832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:23.405942 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201274d5-1626-4ce0-8d61-eb28f4622832 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:23.407200 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201274d5-1626-4ce0-8d61-eb28f4622832 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:23.407647 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201274d5-1626-4ce0-8d61-eb28f4622832 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:23.412796 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf1022-4012-4576-889e-33cdbc4a49e5 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:23.425027 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201274d5-1626-4ce0-8d61-eb28f4622832 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:23.435385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-201274d5-1626-4ce0-8d61-eb28f4622832 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:23.435385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:23.435385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:23.435385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:23.435385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:23.435385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:23.435385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:23.435385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:23.435385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:23.435385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:23.435385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:23.435385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:23.435385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:23.435385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:23.435385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:23.435385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:23.436384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:23.436384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:23.436384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:23.436384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:23.436384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:23.436384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:23.436384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:23.436384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:23.436384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:23.436384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:23.436384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:23.436384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:23.436384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:23.436384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:23.436384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:23.436384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:23.437191 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:23.437191 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:23.437191 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:23.437191 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:23.437191 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:23.437191 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:23.437191 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:23.437191 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:23.437191 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:23.437191 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:23.437191 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:23.437191 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:23.442117 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:23.443702 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 270/553] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 08:32:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:23.444769 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201274d5-1626-4ce0-8d61-eb28f4622832 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:23.459654 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2ca6c-1b19-4009-b63d-6852fe17d26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:23.461186 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2ca6c-1b19-4009-b63d-6852fe17d26c None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:23.462120 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2ca6c-1b19-4009-b63d-6852fe17d26c None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:23.462761 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2ca6c-1b19-4009-b63d-6852fe17d26c None admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:23.463941 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2ca6c-1b19-4009-b63d-6852fe17d26c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:23.464828 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2ca6c-1b19-4009-b63d-6852fe17d26c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:23.467250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2ca6c-1b19-4009-b63d-6852fe17d26c None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:23.498048 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 284/554] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Jul 25 08:32:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:23.499237 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2ca6c-1b19-4009-b63d-6852fe17d26c None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:23.573819 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201274d5-1626-4ce0-8d61-eb28f4622832 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:23.614901 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab141e-7a7c-4290-9281-b8910456f896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:23.615825 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab141e-7a7c-4290-9281-b8910456f896 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:23.616118 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab141e-7a7c-4290-9281-b8910456f896 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:23.616399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab141e-7a7c-4290-9281-b8910456f896 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:23.624469 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2ca6c-1b19-4009-b63d-6852fe17d26c None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:23.628605 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab141e-7a7c-4290-9281-b8910456f896 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:23.636449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-08ab141e-7a7c-4290-9281-b8910456f896 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:23.636449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:23.636449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:23.636449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:23.636449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:23.636449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:23.636449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:23.636449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:23.636449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:23.636449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:23.636449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:23.636449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:23.636449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:23.636449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:23.636449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:23.636449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:23.637503 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:23.637503 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:23.637503 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:23.637503 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:23.637503 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:23.637503 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:23.637503 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:23.637503 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:23.637503 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:23.637503 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:23.637503 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:23.637503 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:23.637503 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:23.637503 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:23.637503 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:23.637503 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:23.638335 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:23.638335 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:23.638335 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:23.638335 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:23.638335 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:23.638335 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:23.638335 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:23.638335 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:23.638335 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:23.638335 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:23.638335 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:23.638335 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:23.638335 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 271/555] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 08:32:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:23.638989 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab141e-7a7c-4290-9281-b8910456f896 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:23.652941 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:23.678153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79d023-ca85-443b-8460-b3107d72770b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:23.678825 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79d023-ca85-443b-8460-b3107d72770b None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:23.679109 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79d023-ca85-443b-8460-b3107d72770b None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:23.679389 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79d023-ca85-443b-8460-b3107d72770b None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:23.680233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79d023-ca85-443b-8460-b3107d72770b None admin] RBAC: Adding query filter params (name=service) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:23.680543 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79d023-ca85-443b-8460-b3107d72770b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:23.681916 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79d023-ca85-443b-8460-b3107d72770b None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:23.691187 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 285/556] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 08:32:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:23.692437 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3cff5-58c4-490f-863f-dfee979c1cce None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:23.692727 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3cff5-58c4-490f-863f-dfee979c1cce None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:23.693002 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3cff5-58c4-490f-863f-dfee979c1cce None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:23.695731 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 286/557] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:23.695731 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3cff5-58c4-490f-863f-dfee979c1cce None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:23.742642 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:23.763574 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab141e-7a7c-4290-9281-b8910456f896 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:23.800777 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a1458-8a92-485e-bc88-aa5b01965503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:23.801428 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a1458-8a92-485e-bc88-aa5b01965503 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:23.801914 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a1458-8a92-485e-bc88-aa5b01965503 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:23.802024 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a1458-8a92-485e-bc88-aa5b01965503 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:23.805430 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3cff5-58c4-490f-863f-dfee979c1cce None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:23.839945 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ebd0a-965f-4f0b-b211-ed9ec88bf744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:23.840704 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ebd0a-965f-4f0b-b211-ed9ec88bf744 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:23.840984 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ebd0a-965f-4f0b-b211-ed9ec88bf744 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:23.841257 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ebd0a-965f-4f0b-b211-ed9ec88bf744 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:23.842000 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ebd0a-965f-4f0b-b211-ed9ec88bf744 None admin] RBAC: Adding query filter params (name=service) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:23.842304 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ebd0a-965f-4f0b-b211-ed9ec88bf744 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:23.843829 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ebd0a-965f-4f0b-b211-ed9ec88bf744 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:23.852386 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 287/558] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 08:32:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:23.853574 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ecf42-fb9c-4c7b-a9f4-24d8822ef224 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:23.853860 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ecf42-fb9c-4c7b-a9f4-24d8822ef224 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:23.854137 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ecf42-fb9c-4c7b-a9f4-24d8822ef224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:23.872317 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-bd7ecf42-fb9c-4c7b-a9f4-24d8822ef224 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:23.873504 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-bd7ecf42-fb9c-4c7b-a9f4-24d8822ef224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:23.881385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a1458-8a92-485e-bc88-aa5b01965503 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:23.883115 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a1458-8a92-485e-bc88-aa5b01965503 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:23.896769 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:23.959723 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 288/559] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:32:23.959723 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ecf42-fb9c-4c7b-a9f4-24d8822ef224 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:23.994070 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:24.008295 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 272/560] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:32:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:32:24.008295 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a1458-8a92-485e-bc88-aa5b01965503 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:24.070086 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ecf42-fb9c-4c7b-a9f4-24d8822ef224 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:24.102640 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf48c90-e25a-4282-9d20-af6808bfbe70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:24.103432 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf48c90-e25a-4282-9d20-af6808bfbe70 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:24.103749 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf48c90-e25a-4282-9d20-af6808bfbe70 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:24.104027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf48c90-e25a-4282-9d20-af6808bfbe70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:24.104125 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a1458-8a92-485e-bc88-aa5b01965503 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:24.115095 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:24.115228 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf48c90-e25a-4282-9d20-af6808bfbe70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:24.116594 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf48c90-e25a-4282-9d20-af6808bfbe70 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:24.134555 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-0cf48c90-e25a-4282-9d20-af6808bfbe70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:24.134555 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:24.134555 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:24.134555 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:24.134555 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:24.134555 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:24.134555 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:24.134555 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:24.134555 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:24.134555 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:24.134555 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:24.134555 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:24.134555 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:24.134555 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:24.134555 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:24.135638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:24.135638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:24.135638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:24.135638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:24.135638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:24.135638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:24.135638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:24.135638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:24.135638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:24.135638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:24.135638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:24.135638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:24.135638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:24.135638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:24.135638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:24.135638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:24.135638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:24.136856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:24.136856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:24.136856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:24.136856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:24.136856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 289/561] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:24.136856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf48c90-e25a-4282-9d20-af6808bfbe70 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:24.141659 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fd167-6fd4-496a-a149-0ce3ad68d88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:24.142584 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fd167-6fd4-496a-a149-0ce3ad68d88b None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:24.142926 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fd167-6fd4-496a-a149-0ce3ad68d88b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:24.143519 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fd167-6fd4-496a-a149-0ce3ad68d88b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:24.153834 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303fd167-6fd4-496a-a149-0ce3ad68d88b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:24.155290 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303fd167-6fd4-496a-a149-0ce3ad68d88b None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:24.173674 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-303fd167-6fd4-496a-a149-0ce3ad68d88b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:24.173674 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:24.173674 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:24.173674 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:24.173674 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:24.173674 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:24.173674 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:24.173674 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:24.173674 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:24.173674 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:24.173674 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:24.173674 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:24.173674 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:24.173674 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:24.173674 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:24.174656 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:24.174656 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:24.174656 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:24.174656 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:24.174656 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:24.174656 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:24.174656 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:24.174656 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:24.174656 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:24.174656 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:24.174656 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:24.174656 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:24.174656 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:24.174656 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:24.174656 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:24.174656 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:24.174656 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:24.175793 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:24.175793 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:24.175793 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:24.175793 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:24.175793 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 273/562] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:24.175793 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fd167-6fd4-496a-a149-0ce3ad68d88b None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:24.222799 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:24.238586 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf48c90-e25a-4282-9d20-af6808bfbe70 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:24.271332 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d1731-b864-462f-b5cb-a0d59f99e2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:24.272155 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d1731-b864-462f-b5cb-a0d59f99e2a1 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:24.272436 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d1731-b864-462f-b5cb-a0d59f99e2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:24.272707 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d1731-b864-462f-b5cb-a0d59f99e2a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:24.274995 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fd167-6fd4-496a-a149-0ce3ad68d88b None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:24.283239 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d1731-b864-462f-b5cb-a0d59f99e2a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:24.291143 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-0c1d1731-b864-462f-b5cb-a0d59f99e2a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:24.291143 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:24.291143 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:24.291143 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:24.291143 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:24.291143 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:24.291143 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:24.291143 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:24.291143 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:24.291143 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:24.291143 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:24.291143 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:24.291143 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:24.291143 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:24.291143 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:24.291143 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:24.292260 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:24.292260 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:24.292260 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:24.292260 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:24.292260 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:24.292260 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:24.292260 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:24.292260 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:24.292260 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:24.292260 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:24.292260 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:24.292260 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:24.292260 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:24.292260 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:24.292260 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:24.292260 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:24.293111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:24.293111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:24.293111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:24.293111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:24.293111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:24.293111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:24.293111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:24.293111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:24.293111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:24.293111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:24.293111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:24.293111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:24.293111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 290/563] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 08:32:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:24.293836 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac51d9-2e33-49db-aa74-b91fa494c161 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:24.293836 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac51d9-2e33-49db-aa74-b91fa494c161 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:24.294165 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac51d9-2e33-49db-aa74-b91fa494c161 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:24.295355 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 291/564] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:24.296070 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac51d9-2e33-49db-aa74-b91fa494c161 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:24.314202 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f6f4b-7cc6-4df7-a43f-b16e3237fc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:24.314995 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f6f4b-7cc6-4df7-a43f-b16e3237fc8f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:24.315281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f6f4b-7cc6-4df7-a43f-b16e3237fc8f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:24.315559 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f6f4b-7cc6-4df7-a43f-b16e3237fc8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:24.325714 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f6f4b-7cc6-4df7-a43f-b16e3237fc8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:24.327182 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f6f4b-7cc6-4df7-a43f-b16e3237fc8f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:24.345060 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-927f6f4b-7cc6-4df7-a43f-b16e3237fc8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:24.345060 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:24.345060 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:24.345060 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:24.345060 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:24.345060 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:24.345060 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:24.345060 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:24.345060 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:24.345060 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:24.345060 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:24.345060 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:24.345060 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:24.345060 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:24.345060 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:24.345995 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:24.345995 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:24.345995 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:24.345995 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:24.345995 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:24.345995 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:24.345995 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:24.345995 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:24.345995 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:24.345995 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:24.345995 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:24.345995 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:24.345995 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:24.345995 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:24.345995 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:24.345995 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:24.345995 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:24.346864 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:24.346864 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:24.346864 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:24.346864 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:24.346864 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 274/565] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:24.347145 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f6f4b-7cc6-4df7-a43f-b16e3237fc8f None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:24.365343 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:24.399232 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac51d9-2e33-49db-aa74-b91fa494c161 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:24.432916 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14641be8-f291-41c4-83f3-a955707117d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:24.433567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14641be8-f291-41c4-83f3-a955707117d6 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:24.433847 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14641be8-f291-41c4-83f3-a955707117d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:24.434122 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14641be8-f291-41c4-83f3-a955707117d6 None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:24.434834 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14641be8-f291-41c4-83f3-a955707117d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:24.435140 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14641be8-f291-41c4-83f3-a955707117d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:24.436534 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14641be8-f291-41c4-83f3-a955707117d6 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:24.447811 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 292/566] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:24.448584 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14641be8-f291-41c4-83f3-a955707117d6 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:24.449960 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f6f4b-7cc6-4df7-a43f-b16e3237fc8f None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:24.457538 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:24.485327 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c951b-ce84-429b-91e0-32d6716e1f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:24.485909 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c951b-ce84-429b-91e0-32d6716e1f08 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:24.486195 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c951b-ce84-429b-91e0-32d6716e1f08 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:24.486471 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c951b-ce84-429b-91e0-32d6716e1f08 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:24.487198 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c951b-ce84-429b-91e0-32d6716e1f08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:24.487507 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c951b-ce84-429b-91e0-32d6716e1f08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:24.488904 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c951b-ce84-429b-91e0-32d6716e1f08 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:24.499996 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 275/567] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:24.502474 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27733540-318a-426f-8cda-7bda8cb4f964 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:24.502773 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27733540-318a-426f-8cda-7bda8cb4f964 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:24.503058 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27733540-318a-426f-8cda-7bda8cb4f964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:24.521433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-27733540-318a-426f-8cda-7bda8cb4f964 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:24.522630 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-27733540-318a-426f-8cda-7bda8cb4f964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:24.554520 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14641be8-f291-41c4-83f3-a955707117d6 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:24.588101 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e344931-f830-47fc-9872-e744f9f94310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:24.588761 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e344931-f830-47fc-9872-e744f9f94310 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:24.589044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e344931-f830-47fc-9872-e744f9f94310 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:24.589210 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 276/568] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:32:24.589328 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e344931-f830-47fc-9872-e744f9f94310 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:24.589984 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27733540-318a-426f-8cda-7bda8cb4f964 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:24.590100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e344931-f830-47fc-9872-e744f9f94310 None admin] RBAC: Adding query filter params (name=service) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:24.590457 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e344931-f830-47fc-9872-e744f9f94310 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:24.591850 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e344931-f830-47fc-9872-e744f9f94310 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:24.593109 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:24.606809 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 293/569] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 08:32:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:24.607851 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e344931-f830-47fc-9872-e744f9f94310 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:24.746229 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:24.751260 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27733540-318a-426f-8cda-7bda8cb4f964 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:24.779082 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e344931-f830-47fc-9872-e744f9f94310 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:24.787580 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b367a09-ef22-4747-9349-9a7887da8255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:24.788262 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b367a09-ef22-4747-9349-9a7887da8255 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:24.788544 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b367a09-ef22-4747-9349-9a7887da8255 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:24.788815 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b367a09-ef22-4747-9349-9a7887da8255 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:24.789539 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b367a09-ef22-4747-9349-9a7887da8255 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:24.789845 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b367a09-ef22-4747-9349-9a7887da8255 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:24.791207 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b367a09-ef22-4747-9349-9a7887da8255 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:24.803218 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 277/570] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:24.804107 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b367a09-ef22-4747-9349-9a7887da8255 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:24.814041 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4a276-c61b-4de5-b773-12cdbdc12d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:24.814878 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4a276-c61b-4de5-b773-12cdbdc12d58 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:24.815175 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4a276-c61b-4de5-b773-12cdbdc12d58 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:24.815428 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4a276-c61b-4de5-b773-12cdbdc12d58 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:24.823822 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4a276-c61b-4de5-b773-12cdbdc12d58 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:24.825281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4a276-c61b-4de5-b773-12cdbdc12d58 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:24.839197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-c4b4a276-c61b-4de5-b773-12cdbdc12d58 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:32:24.839197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:24.839197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:24.839197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:24.839197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:24.839197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:24.839197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:24.839197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:24.839197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:24.839197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:24.839197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:24.839197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:24.839197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:32:24.839197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:32:24.839197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:32:24.839197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:32:24.840348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:24.840348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:24.840348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:32:24.840348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:24.840348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:32:24.840348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:24.840348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:24.840348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:24.840348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:24.840348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:24.840348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:24.840348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:24.840348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:24.840348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:24.840348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:24.840348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:24.840348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:24.840348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:24.841474 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:24.841474 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:24.841474 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:32:24.841474 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:32:24.841474 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:32:24.841474 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:32:24.841474 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:32:24.841474 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:32:24.841474 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:32:24.841474 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:24.841474 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 294/571] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Jul 25 08:32:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:24.842183 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4a276-c61b-4de5-b773-12cdbdc12d58 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:24.869539 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:24.906938 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b367a09-ef22-4747-9349-9a7887da8255 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:24.941038 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee78e0-8842-45a1-8877-cb3e29c79aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:24.941830 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee78e0-8842-45a1-8877-cb3e29c79aee None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:24.942062 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4a276-c61b-4de5-b773-12cdbdc12d58 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:24.942159 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee78e0-8842-45a1-8877-cb3e29c79aee None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:24.942409 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee78e0-8842-45a1-8877-cb3e29c79aee None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:24.949760 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee78e0-8842-45a1-8877-cb3e29c79aee None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:24.951192 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee78e0-8842-45a1-8877-cb3e29c79aee None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:24.965022 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-8cee78e0-8842-45a1-8877-cb3e29c79aee None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 08:32:24.965022 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:24.965022 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:24.965022 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:24.965022 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:24.965022 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:24.965022 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:24.965022 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:24.965022 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:24.965022 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:24.965022 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:24.965022 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:24.965022 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:32:24.965022 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:32:24.965022 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:32:24.965022 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:32:24.965930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:24.965930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:24.965930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:32:24.965930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:24.965930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:32:24.965930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:24.965930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:24.965930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:24.965930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:24.965930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:24.965930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:24.965930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:24.965930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:24.965930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:24.965930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:24.965930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:24.965930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:24.965930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:24.966856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:24.966856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:24.966856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:32:24.966856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:32:24.966856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:32:24.966856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:32:24.966856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:32:24.966856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:32:24.966856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 08:32:24.966856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:24.966856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 278/572] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:32:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:24.967504 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee78e0-8842-45a1-8877-cb3e29c79aee None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:24.970846 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:24.978604 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9858e4a-c219-49f3-9f19-667ca5349561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:24.984378 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9858e4a-c219-49f3-9f19-667ca5349561 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:24.984378 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9858e4a-c219-49f3-9f19-667ca5349561 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:24.984378 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9858e4a-c219-49f3-9f19-667ca5349561 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:24.991825 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9858e4a-c219-49f3-9f19-667ca5349561 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:24.999452 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-f9858e4a-c219-49f3-9f19-667ca5349561 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:24.999452 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:24.999452 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:24.999452 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:24.999452 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:24.999452 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:24.999452 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:24.999452 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:24.999452 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:24.999452 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:24.999452 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:24.999452 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:24.999452 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:24.999452 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:24.999452 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:24.999452 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:25.000658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:25.000658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:25.000658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:25.000658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:25.000658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:25.000658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:25.000658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:25.000658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:25.000658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:25.000658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:25.000658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:25.000658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:25.000658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:25.000658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:25.000658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:25.000658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:25.001976 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:25.001976 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:25.001976 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:25.001976 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:25.001976 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:25.001976 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:25.001976 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:25.001976 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:25.001976 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:25.001976 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:25.001976 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:25.001976 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:25.001976 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 295/573] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 08:32:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:25.001976 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9858e4a-c219-49f3-9f19-667ca5349561 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:25.071261 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee78e0-8842-45a1-8877-cb3e29c79aee None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:25.094860 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:25.102767 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9858e4a-c219-49f3-9f19-667ca5349561 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:25.106122 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a15414-6516-46ea-966f-4faf84c59915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:25.110163 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a15414-6516-46ea-966f-4faf84c59915 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:25.110163 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a15414-6516-46ea-966f-4faf84c59915 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:25.110163 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a15414-6516-46ea-966f-4faf84c59915 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:25.119694 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a15414-6516-46ea-966f-4faf84c59915 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:25.121131 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a15414-6516-46ea-966f-4faf84c59915 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:25.136540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57331e7d-0585-4cad-b38f-b2348ddaa6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:25.137318 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57331e7d-0585-4cad-b38f-b2348ddaa6b0 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:25.137597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57331e7d-0585-4cad-b38f-b2348ddaa6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:25.137866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57331e7d-0585-4cad-b38f-b2348ddaa6b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:25.138691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-10a15414-6516-46ea-966f-4faf84c59915 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:25.138691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:25.138691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:25.138691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:25.138691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:25.138691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:25.138691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:25.138691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:25.138691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:25.138691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:25.138691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:25.138691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:25.138691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:25.138691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:25.138691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:25.139687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:25.139687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:25.139687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:25.139687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:25.139687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:25.139687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:25.139687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:25.139687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:25.139687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:25.139687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:25.139687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:25.139687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:25.139687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:25.139687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:25.139687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:25.139687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:25.139687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:25.141157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:25.141157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:25.141157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:25.141157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:25.141157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 279/574] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:25.141157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a15414-6516-46ea-966f-4faf84c59915 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:25.148915 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57331e7d-0585-4cad-b38f-b2348ddaa6b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:25.150361 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57331e7d-0585-4cad-b38f-b2348ddaa6b0 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:25.164885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-57331e7d-0585-4cad-b38f-b2348ddaa6b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:25.164885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:25.164885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:25.164885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:25.164885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:25.164885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:25.164885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:25.164885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:25.164885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:25.164885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:25.164885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:25.164885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:25.164885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:32:25.164885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:32:25.164885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:32:25.165910 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:32:25.165910 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:25.165910 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:25.165910 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:25.165910 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:25.165910 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:25.165910 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:25.165910 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:25.165910 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:25.165910 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:25.165910 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:25.165910 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:25.165910 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:25.165910 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:25.165910 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:25.165910 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:25.165910 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:25.166935 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:32:25.166935 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:32:25.166935 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:32:25.166935 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:32:25.166935 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:32:25.166935 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:32:25.166935 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:25.166935 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:25.166935 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 296/575] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:32:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:25.168419 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57331e7d-0585-4cad-b38f-b2348ddaa6b0 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:25.217996 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:25.239114 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a15414-6516-46ea-966f-4faf84c59915 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:25.267128 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57331e7d-0585-4cad-b38f-b2348ddaa6b0 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:25.272422 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2da74-aa95-4c2a-86ff-45f32a7a9e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:25.273076 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2da74-aa95-4c2a-86ff-45f32a7a9e6b None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:25.273360 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2da74-aa95-4c2a-86ff-45f32a7a9e6b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:25.273633 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2da74-aa95-4c2a-86ff-45f32a7a9e6b None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:25.274466 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2da74-aa95-4c2a-86ff-45f32a7a9e6b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:25.274773 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2da74-aa95-4c2a-86ff-45f32a7a9e6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:25.276226 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2da74-aa95-4c2a-86ff-45f32a7a9e6b None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:25.293042 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 280/576] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Jul 25 08:32:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:25.293829 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2da74-aa95-4c2a-86ff-45f32a7a9e6b None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:25.301527 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc16d3-cbdf-425b-b5b3-1c05dc20ad8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:25.302196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc16d3-cbdf-425b-b5b3-1c05dc20ad8c None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:25.302480 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc16d3-cbdf-425b-b5b3-1c05dc20ad8c None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:25.302753 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc16d3-cbdf-425b-b5b3-1c05dc20ad8c None admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:25.303593 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc16d3-cbdf-425b-b5b3-1c05dc20ad8c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:25.303933 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc16d3-cbdf-425b-b5b3-1c05dc20ad8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:25.305360 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc16d3-cbdf-425b-b5b3-1c05dc20ad8c None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:25.322558 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 297/577] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Jul 25 08:32:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:25.323207 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc16d3-cbdf-425b-b5b3-1c05dc20ad8c None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:25.334720 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:25.400338 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2da74-aa95-4c2a-86ff-45f32a7a9e6b None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:25.420066 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc16d3-cbdf-425b-b5b3-1c05dc20ad8c None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:25.427786 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:25.433784 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597dbde6-0beb-49d6-8134-8383b59100c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:25.434447 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597dbde6-0beb-49d6-8134-8383b59100c6 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:25.434732 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597dbde6-0beb-49d6-8134-8383b59100c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:25.435004 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597dbde6-0beb-49d6-8134-8383b59100c6 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:25.435785 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597dbde6-0beb-49d6-8134-8383b59100c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:25.436091 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597dbde6-0beb-49d6-8134-8383b59100c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:25.437428 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597dbde6-0beb-49d6-8134-8383b59100c6 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:25.446074 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 281/578] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 08:32:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:25.446781 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597dbde6-0beb-49d6-8134-8383b59100c6 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:25.457760 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e4744-7456-4055-a51d-7af3d398880d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:25.458734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e4744-7456-4055-a51d-7af3d398880d None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:25.459027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e4744-7456-4055-a51d-7af3d398880d None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:25.459307 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e4744-7456-4055-a51d-7af3d398880d None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:25.460151 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e4744-7456-4055-a51d-7af3d398880d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:25.460659 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e4744-7456-4055-a51d-7af3d398880d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:25.462367 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e4744-7456-4055-a51d-7af3d398880d None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:25.478472 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 298/579] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:25.478472 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e4744-7456-4055-a51d-7af3d398880d None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:25.540201 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:25.546043 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597dbde6-0beb-49d6-8134-8383b59100c6 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:25.575398 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e4744-7456-4055-a51d-7af3d398880d None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:25.580447 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff3af0-6f73-4778-b010-3042ad7de84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:25.581197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff3af0-6f73-4778-b010-3042ad7de84a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:25.581686 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff3af0-6f73-4778-b010-3042ad7de84a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:25.589452 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff3af0-6f73-4778-b010-3042ad7de84a None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:25.589452 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff3af0-6f73-4778-b010-3042ad7de84a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:25.589452 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff3af0-6f73-4778-b010-3042ad7de84a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:25.589452 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff3af0-6f73-4778-b010-3042ad7de84a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:25.597903 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 282/580] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:32:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:25.598700 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff3af0-6f73-4778-b010-3042ad7de84a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:25.613805 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5e466-d691-4555-a0f1-d8cfceac1380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:25.614539 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5e466-d691-4555-a0f1-d8cfceac1380 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:25.614818 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5e466-d691-4555-a0f1-d8cfceac1380 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:25.615090 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5e466-d691-4555-a0f1-d8cfceac1380 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:25.625480 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5e466-d691-4555-a0f1-d8cfceac1380 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:25.627008 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5e466-d691-4555-a0f1-d8cfceac1380 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:25.644409 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-c2b5e466-d691-4555-a0f1-d8cfceac1380 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:25.644409 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:25.644409 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:25.644409 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:25.644409 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:25.644409 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:25.644409 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:25.644409 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:25.644409 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:25.644409 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:25.644409 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:25.644409 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:25.644409 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:25.644409 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:25.644409 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:25.645463 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:25.645463 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:25.645463 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:25.645463 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:25.645463 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:25.645463 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:25.645463 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:25.645463 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:25.645463 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:25.645463 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:25.645463 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:25.645463 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:25.645463 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:25.645463 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:25.645463 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:25.645463 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:25.645463 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:25.646573 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:25.646573 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:25.646573 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:25.646573 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:25.646573 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 299/581] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:25.646573 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5e466-d691-4555-a0f1-d8cfceac1380 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:25.665188 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:25.702787 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff3af0-6f73-4778-b010-3042ad7de84a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:25.738821 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14be6ab-5701-44a6-952d-17b45f0ee853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:25.739606 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14be6ab-5701-44a6-952d-17b45f0ee853 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:25.739913 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14be6ab-5701-44a6-952d-17b45f0ee853 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:25.740187 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14be6ab-5701-44a6-952d-17b45f0ee853 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:25.747546 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5e466-d691-4555-a0f1-d8cfceac1380 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:25.750505 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14be6ab-5701-44a6-952d-17b45f0ee853 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:25.752156 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14be6ab-5701-44a6-952d-17b45f0ee853 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:25.770234 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-e14be6ab-5701-44a6-952d-17b45f0ee853 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:25.770234 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:25.770234 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:25.770234 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:25.770234 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:25.770234 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:25.770234 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:25.770234 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:25.770234 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:25.770234 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:25.770234 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:25.770234 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:25.770234 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:25.770234 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:25.770234 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:25.771281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:25.771281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:25.771281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:25.771281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:25.771281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:25.771281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:25.771281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:25.771281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:25.771281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:25.771281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:25.771281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:25.771281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:25.771281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:25.771281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:25.771281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:25.771281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:25.771281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:25.772320 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:25.772320 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:25.772320 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:25.772320 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:25.772320 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 283/582] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:25.772621 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14be6ab-5701-44a6-952d-17b45f0ee853 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:25.782647 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:25.786272 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90b03b-55aa-40e9-ba5c-daef2164a6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:25.787069 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90b03b-55aa-40e9-ba5c-daef2164a6cd None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:25.787353 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90b03b-55aa-40e9-ba5c-daef2164a6cd None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:25.787652 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90b03b-55aa-40e9-ba5c-daef2164a6cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:25.798813 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90b03b-55aa-40e9-ba5c-daef2164a6cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:25.800326 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90b03b-55aa-40e9-ba5c-daef2164a6cd None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:25.818334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-cc90b03b-55aa-40e9-ba5c-daef2164a6cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:25.818334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:25.818334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:25.818334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:25.818334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:25.818334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:25.818334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:25.818334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:25.818334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:25.818334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:25.818334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:25.818334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:25.818334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:25.818334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:25.818334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:25.819340 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:25.819340 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:25.819340 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:25.819340 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:25.819340 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:25.819340 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:25.819340 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:25.819340 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:25.819340 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:25.819340 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:25.819340 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:25.819340 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:25.819340 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:25.819340 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:25.819340 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:25.819340 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:25.819340 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:25.820427 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:25.820427 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:25.820427 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:25.820427 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:25.820427 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 300/583] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:25.820771 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90b03b-55aa-40e9-ba5c-daef2164a6cd None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:25.876291 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14be6ab-5701-44a6-952d-17b45f0ee853 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:25.887337 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:25.910492 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f198f-ae70-419b-b145-0d3c26aa99a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:25.911286 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f198f-ae70-419b-b145-0d3c26aa99a3 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:25.911572 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f198f-ae70-419b-b145-0d3c26aa99a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:25.911980 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f198f-ae70-419b-b145-0d3c26aa99a3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:25.917304 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90b03b-55aa-40e9-ba5c-daef2164a6cd None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:25.919006 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f198f-ae70-419b-b145-0d3c26aa99a3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:25.920470 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f198f-ae70-419b-b145-0d3c26aa99a3 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:25.935453 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-9e3f198f-ae70-419b-b145-0d3c26aa99a3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 08:32:25.935453 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:25.935453 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:25.935453 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:25.935453 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:25.935453 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:25.935453 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:25.935453 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:25.935453 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:25.935453 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:25.935453 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:25.935453 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:25.935453 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:32:25.935453 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:32:25.935453 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:32:25.935453 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:32:25.936584 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:25.936584 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:25.936584 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:32:25.936584 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:25.936584 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:32:25.936584 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:25.936584 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:25.936584 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:25.936584 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:25.936584 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:25.936584 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:25.936584 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:25.936584 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:25.936584 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:25.936584 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:25.936584 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:25.936584 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:25.936584 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:25.938080 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:25.938080 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:25.938080 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:32:25.938080 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:32:25.938080 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:32:25.938080 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:32:25.938080 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:32:25.938080 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:32:25.938080 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 08:32:25.938080 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:25.938080 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 284/584] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:32:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:25.938667 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f198f-ae70-419b-b145-0d3c26aa99a3 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:25.961641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb0166-e150-409e-a105-b42793a4f4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:25.962303 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb0166-e150-409e-a105-b42793a4f4fe None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:25.962587 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb0166-e150-409e-a105-b42793a4f4fe None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:25.962862 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb0166-e150-409e-a105-b42793a4f4fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:25.963757 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb0166-e150-409e-a105-b42793a4f4fe None admin] RBAC: Adding query filter params (role.id=a0a4f5f9b3264740a55056fed8fd7a33, scope.project.id=be349194440449209f19f6b535ffd4f6, user.id=2763e540681547d3a6677567b3be86ea) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:25.964071 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb0166-e150-409e-a105-b42793a4f4fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:25.965511 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb0166-e150-409e-a105-b42793a4f4fe None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:25.971507 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 301/585] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:32:25 2022] GET /identity/v3/role_assignments?user.id=2763e540681547d3a6677567b3be86ea&scope.project.id=be349194440449209f19f6b535ffd4f6&role.id=a0a4f5f9b3264740a55056fed8fd7a33 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:25.972341 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb0166-e150-409e-a105-b42793a4f4fe None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:26.019914 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:26.060647 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f198f-ae70-419b-b145-0d3c26aa99a3 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:26.093035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb0166-e150-409e-a105-b42793a4f4fe None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:26.097724 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f51b58-7bf4-4fb3-9d4e-e49940d8870e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:26.098403 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f51b58-7bf4-4fb3-9d4e-e49940d8870e None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:26.098690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f51b58-7bf4-4fb3-9d4e-e49940d8870e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:26.098969 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f51b58-7bf4-4fb3-9d4e-e49940d8870e None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:26.099746 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f51b58-7bf4-4fb3-9d4e-e49940d8870e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:26.100058 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f51b58-7bf4-4fb3-9d4e-e49940d8870e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:26.101453 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f51b58-7bf4-4fb3-9d4e-e49940d8870e None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:26.115660 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 285/586] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:26.115660 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f51b58-7bf4-4fb3-9d4e-e49940d8870e None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:26.138742 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829857fc-3cff-445d-b9cc-2935f1447dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:26.139411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829857fc-3cff-445d-b9cc-2935f1447dff None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:26.139720 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829857fc-3cff-445d-b9cc-2935f1447dff None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:26.140002 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829857fc-3cff-445d-b9cc-2935f1447dff None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:26.141291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829857fc-3cff-445d-b9cc-2935f1447dff None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:26.141600 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829857fc-3cff-445d-b9cc-2935f1447dff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:26.142982 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829857fc-3cff-445d-b9cc-2935f1447dff None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:26.144688 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:26.155479 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 302/587] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:26.158133 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829857fc-3cff-445d-b9cc-2935f1447dff None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:26.226288 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f51b58-7bf4-4fb3-9d4e-e49940d8870e None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:26.256631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:26.263601 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829857fc-3cff-445d-b9cc-2935f1447dff None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:26.265407 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e1301-319a-4115-8b48-64de2b40da70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:26.272121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e1301-319a-4115-8b48-64de2b40da70 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:26.272121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e1301-319a-4115-8b48-64de2b40da70 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:26.272121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e1301-319a-4115-8b48-64de2b40da70 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:26.272121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e1301-319a-4115-8b48-64de2b40da70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:26.272121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e1301-319a-4115-8b48-64de2b40da70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:26.272121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e1301-319a-4115-8b48-64de2b40da70 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:26.286674 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 286/588] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:26.286674 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e1301-319a-4115-8b48-64de2b40da70 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:26.310787 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ed010-197b-4afb-a092-94dc6e3e8ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:26.311385 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ed010-197b-4afb-a092-94dc6e3e8ad2 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:26.311697 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ed010-197b-4afb-a092-94dc6e3e8ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:26.311980 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ed010-197b-4afb-a092-94dc6e3e8ad2 None admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:26.312935 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ed010-197b-4afb-a092-94dc6e3e8ad2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:26.313247 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ed010-197b-4afb-a092-94dc6e3e8ad2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:26.314688 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ed010-197b-4afb-a092-94dc6e3e8ad2 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:26.337699 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 303/589] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Jul 25 08:32:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:26.337699 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ed010-197b-4afb-a092-94dc6e3e8ad2 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:26.389405 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:26.400830 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e1301-319a-4115-8b48-64de2b40da70 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:26.438472 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b65ecb-340a-483f-8b16-9c75e6af223d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:26.439260 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b65ecb-340a-483f-8b16-9c75e6af223d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:26.439545 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b65ecb-340a-483f-8b16-9c75e6af223d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:26.439852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b65ecb-340a-483f-8b16-9c75e6af223d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:26.440128 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ed010-197b-4afb-a092-94dc6e3e8ad2 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:26.447359 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b65ecb-340a-483f-8b16-9c75e6af223d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:26.448911 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b65ecb-340a-483f-8b16-9c75e6af223d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:26.463331 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-c5b65ecb-340a-483f-8b16-9c75e6af223d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:26.463331 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:26.463331 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:26.463331 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:26.463331 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:26.463331 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:26.463331 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:26.463331 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:26.463331 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:26.463331 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:26.463331 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:26.463331 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:26.463331 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:32:26.463331 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:32:26.463331 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:32:26.464850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:32:26.464850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:26.464850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:26.464850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:26.464850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:26.464850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:26.464850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:26.464850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:26.464850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:26.464850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:26.464850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:26.464850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:26.464850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:26.464850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:26.464850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:26.464850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:26.464850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:26.467919 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:32:26.467919 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:32:26.467919 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:32:26.467919 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:32:26.467919 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:32:26.467919 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:32:26.467919 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:26.467919 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:26.467919 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 287/590] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:32:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:26.467919 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b65ecb-340a-483f-8b16-9c75e6af223d None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:26.485934 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c09e8f-e40b-422d-b91b-79dbcab4a48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:26.486722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c09e8f-e40b-422d-b91b-79dbcab4a48d None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:26.487000 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c09e8f-e40b-422d-b91b-79dbcab4a48d None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:26.487270 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c09e8f-e40b-422d-b91b-79dbcab4a48d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:26.494126 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c09e8f-e40b-422d-b91b-79dbcab4a48d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:26.495574 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c09e8f-e40b-422d-b91b-79dbcab4a48d None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:26.509921 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-b3c09e8f-e40b-422d-b91b-79dbcab4a48d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:26.509921 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:26.509921 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:26.509921 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:26.509921 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:26.509921 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:26.509921 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:26.509921 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:26.509921 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:26.509921 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:26.509921 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:26.509921 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:26.509921 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:32:26.509921 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:32:26.509921 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:32:26.510824 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:32:26.510824 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:26.510824 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:26.510824 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:26.510824 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:26.510824 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:26.510824 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:26.510824 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:26.510824 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:26.510824 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:26.510824 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:26.510824 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:26.510824 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:26.510824 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:26.510824 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:26.510824 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:26.510824 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:26.517407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:32:26.517407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:32:26.517407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:32:26.517407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:32:26.517407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:32:26.517407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:32:26.517407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:26.517407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:26.517407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 304/591] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:32:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:26.517407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c09e8f-e40b-422d-b91b-79dbcab4a48d None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:26.528942 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:26.585608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b65ecb-340a-483f-8b16-9c75e6af223d None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:26.621265 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c09e8f-e40b-422d-b91b-79dbcab4a48d None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:26.629345 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58002a-cac9-48e1-9b2a-4c4e11671155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:26.630148 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58002a-cac9-48e1-9b2a-4c4e11671155 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:26.630428 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58002a-cac9-48e1-9b2a-4c4e11671155 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:26.630701 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58002a-cac9-48e1-9b2a-4c4e11671155 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:26.638153 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58002a-cac9-48e1-9b2a-4c4e11671155 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:26.639578 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58002a-cac9-48e1-9b2a-4c4e11671155 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:26.654594 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:26.654774 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-ff58002a-cac9-48e1-9b2a-4c4e11671155 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 08:32:26.654774 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:26.654774 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:26.654774 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:26.654774 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:26.654774 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:26.654774 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:26.654774 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:26.654774 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:26.654774 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:26.654774 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:26.654774 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:26.654774 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:32:26.654774 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:32:26.654774 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:32:26.654774 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:32:26.661924 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:26.661924 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:26.661924 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:32:26.661924 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:26.661924 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:32:26.661924 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:26.661924 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:26.661924 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:26.661924 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:26.661924 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:26.661924 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:26.661924 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:26.661924 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:26.661924 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:26.661924 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:26.661924 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:26.661924 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:26.661924 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:26.663085 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:26.663085 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:26.663085 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:32:26.663085 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:32:26.663085 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:32:26.663085 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:32:26.663085 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:32:26.663085 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:32:26.663085 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 08:32:26.663085 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:26.663085 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 288/592] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 08:32:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:26.663085 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58002a-cac9-48e1-9b2a-4c4e11671155 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:26.682371 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28858a7-7fe1-49c0-9d93-3de4f363a987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:26.683168 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28858a7-7fe1-49c0-9d93-3de4f363a987 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:26.683451 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28858a7-7fe1-49c0-9d93-3de4f363a987 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:26.683752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28858a7-7fe1-49c0-9d93-3de4f363a987 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:26.694073 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28858a7-7fe1-49c0-9d93-3de4f363a987 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:26.695522 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28858a7-7fe1-49c0-9d93-3de4f363a987 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:26.717704 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-f28858a7-7fe1-49c0-9d93-3de4f363a987 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:26.717704 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:26.717704 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:26.717704 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:26.717704 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:26.717704 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:26.717704 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:26.717704 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:26.717704 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:26.717704 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:26.717704 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:26.717704 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:26.717704 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:26.717704 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:26.717704 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:26.718560 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:26.718560 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:26.718560 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:26.718560 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:26.718560 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:26.718560 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:26.718560 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:26.718560 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:26.718560 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:26.718560 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:26.718560 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:26.718560 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:26.718560 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:26.718560 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:26.718560 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:26.718560 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:26.718560 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:26.725743 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:26.725743 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:26.725743 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:26.725743 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:26.725743 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 305/593] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:26.725743 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28858a7-7fe1-49c0-9d93-3de4f363a987 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:26.780612 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58002a-cac9-48e1-9b2a-4c4e11671155 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:26.792575 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:26.819443 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea792c-bddb-4c68-80f8-8c3718393e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:26.820126 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea792c-bddb-4c68-80f8-8c3718393e35 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:26.820408 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea792c-bddb-4c68-80f8-8c3718393e35 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:26.820684 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea792c-bddb-4c68-80f8-8c3718393e35 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:26.821741 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea792c-bddb-4c68-80f8-8c3718393e35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:26.822238 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea792c-bddb-4c68-80f8-8c3718393e35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:26.824227 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea792c-bddb-4c68-80f8-8c3718393e35 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:26.828466 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28858a7-7fe1-49c0-9d93-3de4f363a987 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:26.837258 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 289/594] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:32:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:26.838089 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea792c-bddb-4c68-80f8-8c3718393e35 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:26.867876 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571ba3b-cebe-48f2-8f31-6c1821b8c85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:26.868785 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571ba3b-cebe-48f2-8f31-6c1821b8c85e None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:26.869071 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571ba3b-cebe-48f2-8f31-6c1821b8c85e None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:26.869352 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571ba3b-cebe-48f2-8f31-6c1821b8c85e None admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:26.870152 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571ba3b-cebe-48f2-8f31-6c1821b8c85e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:26.870454 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571ba3b-cebe-48f2-8f31-6c1821b8c85e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:26.871988 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571ba3b-cebe-48f2-8f31-6c1821b8c85e None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:26.889965 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 306/595] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:32:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:26.891314 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571ba3b-cebe-48f2-8f31-6c1821b8c85e None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:26.915235 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:26.954329 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea792c-bddb-4c68-80f8-8c3718393e35 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:26.990431 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd36096a-2eca-480a-8607-1ecf33783ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:26.991100 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36096a-2eca-480a-8607-1ecf33783ce0 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:26.991384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36096a-2eca-480a-8607-1ecf33783ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:26.991685 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36096a-2eca-480a-8607-1ecf33783ce0 None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:26.992552 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd36096a-2eca-480a-8607-1ecf33783ce0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:26.992837 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd36096a-2eca-480a-8607-1ecf33783ce0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:26.994259 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd36096a-2eca-480a-8607-1ecf33783ce0 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:26.995898 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571ba3b-cebe-48f2-8f31-6c1821b8c85e None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:27.011957 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 290/596] 10.222.0.18 () {56 vars in 1139 bytes} [Mon Jul 25 08:32:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:27.012737 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd36096a-2eca-480a-8607-1ecf33783ce0 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:27.038009 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241890e-275f-431b-a098-162a217c9598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:27.039152 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241890e-275f-431b-a098-162a217c9598 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:27.039532 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241890e-275f-431b-a098-162a217c9598 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:27.039935 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241890e-275f-431b-a098-162a217c9598 None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:27.040854 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241890e-275f-431b-a098-162a217c9598 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:27.041175 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241890e-275f-431b-a098-162a217c9598 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:27.041686 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:27.042618 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241890e-275f-431b-a098-162a217c9598 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:27.055474 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 307/597] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:27.056559 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241890e-275f-431b-a098-162a217c9598 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:27.125618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd36096a-2eca-480a-8607-1ecf33783ce0 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:27.152475 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:27.164791 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93c7ed-1885-44b4-857b-4ffc560574d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:27.165875 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93c7ed-1885-44b4-857b-4ffc560574d0 None admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:27.166299 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93c7ed-1885-44b4-857b-4ffc560574d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:27.166635 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93c7ed-1885-44b4-857b-4ffc560574d0 None admin] PATH_INFO: `/v3/projects/be349194440449209f19f6b535ffd4f6/users/1c1a08d3a76643a9996dc0daa8714ac6/roles/a0a4f5f9b3264740a55056fed8fd7a33` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:27.169797 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241890e-275f-431b-a098-162a217c9598 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:27.185140 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93c7ed-1885-44b4-857b-4ffc560574d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=be349194440449209f19f6b535ffd4f6, user_id=1c1a08d3a76643a9996dc0daa8714ac6, role_id=a0a4f5f9b3264740a55056fed8fd7a33)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:27.186861 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93c7ed-1885-44b4-857b-4ffc560574d0 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:27.204573 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8209f3-78f3-4948-b195-9b4bfbc4a272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:27.205458 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8209f3-78f3-4948-b195-9b4bfbc4a272 None admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:27.205737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8209f3-78f3-4948-b195-9b4bfbc4a272 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:27.206005 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8209f3-78f3-4948-b195-9b4bfbc4a272 None admin] PATH_INFO: `/v3/projects/be349194440449209f19f6b535ffd4f6/users/c53b69c61d9a46bc9e8aa1b4a9fd5fec/roles/a0a4f5f9b3264740a55056fed8fd7a33` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:27.220600 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8209f3-78f3-4948-b195-9b4bfbc4a272 None admin] RBAC: Authorizing `identity:create_grant(project_id=be349194440449209f19f6b535ffd4f6, user_id=c53b69c61d9a46bc9e8aa1b4a9fd5fec, role_id=a0a4f5f9b3264740a55056fed8fd7a33)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:27.222050 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8209f3-78f3-4948-b195-9b4bfbc4a272 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:27.250376 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 291/598] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 08:32:27 2022] PUT /identity/v3/projects/be349194440449209f19f6b535ffd4f6/users/1c1a08d3a76643a9996dc0daa8714ac6/roles/a0a4f5f9b3264740a55056fed8fd7a33 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:32:27.251352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93c7ed-1885-44b4-857b-4ffc560574d0 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:27.326625 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 308/599] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 08:32:27 2022] PUT /identity/v3/projects/be349194440449209f19f6b535ffd4f6/users/c53b69c61d9a46bc9e8aa1b4a9fd5fec/roles/a0a4f5f9b3264740a55056fed8fd7a33 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:32:27.328132 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8209f3-78f3-4948-b195-9b4bfbc4a272 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:27.349147 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:27.388230 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93c7ed-1885-44b4-857b-4ffc560574d0 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:27.460931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adddfa8-2588-42ec-bf74-3e8ec9418dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:27.461959 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adddfa8-2588-42ec-bf74-3e8ec9418dd9 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:27.462366 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adddfa8-2588-42ec-bf74-3e8ec9418dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:27.462741 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adddfa8-2588-42ec-bf74-3e8ec9418dd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:27.464669 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8209f3-78f3-4948-b195-9b4bfbc4a272 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:27.475646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adddfa8-2588-42ec-bf74-3e8ec9418dd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:27.478175 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adddfa8-2588-42ec-bf74-3e8ec9418dd9 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:27.499602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-8adddfa8-2588-42ec-bf74-3e8ec9418dd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:27.499602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:27.499602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:27.499602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:27.499602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:27.499602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:27.499602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:27.499602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:27.499602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:27.499602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:27.499602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:27.499602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:27.499602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:27.499602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:27.499602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:27.501451 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:27.501451 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:27.501451 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:27.501451 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:27.501451 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:27.501451 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:27.501451 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:27.501451 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:27.501451 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:27.501451 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:27.501451 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:27.501451 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:27.501451 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:27.501451 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:27.501451 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:27.501451 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:27.501451 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:27.502492 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:27.502492 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:27.502492 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:27.502492 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:27.507716 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 292/600] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:27.510685 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adddfa8-2588-42ec-bf74-3e8ec9418dd9 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:27.513125 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972f028-fa34-437f-ac11-8ac5a585148b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:27.514357 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972f028-fa34-437f-ac11-8ac5a585148b None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:27.514791 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972f028-fa34-437f-ac11-8ac5a585148b None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:27.516303 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972f028-fa34-437f-ac11-8ac5a585148b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:27.519946 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:27.529242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972f028-fa34-437f-ac11-8ac5a585148b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:27.532057 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972f028-fa34-437f-ac11-8ac5a585148b None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:27.553436 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-9972f028-fa34-437f-ac11-8ac5a585148b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:27.553436 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:27.553436 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:27.553436 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:27.553436 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:27.553436 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:27.553436 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:27.553436 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:27.553436 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:27.553436 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:27.553436 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:27.553436 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:27.553436 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:32:27.553436 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:32:27.553436 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:32:27.554566 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:32:27.554566 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:27.554566 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:27.554566 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:27.554566 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:27.554566 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:27.554566 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:27.554566 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:27.554566 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:27.554566 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:27.554566 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:27.554566 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:27.554566 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:27.554566 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:27.554566 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:27.554566 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:27.554566 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:27.555664 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:32:27.555664 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:32:27.555664 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:32:27.555664 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:32:27.555664 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:32:27.555664 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:32:27.555664 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:27.555664 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:27.557918 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 309/601] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:32:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:27.566824 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972f028-fa34-437f-ac11-8ac5a585148b None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:27.662515 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adddfa8-2588-42ec-bf74-3e8ec9418dd9 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:27.681059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972f028-fa34-437f-ac11-8ac5a585148b None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:27.697798 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:27.713882 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c1805-e8d6-47f8-844f-5330c25fdd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:27.722082 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c1805-e8d6-47f8-844f-5330c25fdd18 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:27.722082 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c1805-e8d6-47f8-844f-5330c25fdd18 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:27.722082 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c1805-e8d6-47f8-844f-5330c25fdd18 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:27.722082 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c1805-e8d6-47f8-844f-5330c25fdd18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:27.722082 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c1805-e8d6-47f8-844f-5330c25fdd18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:27.722082 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c1805-e8d6-47f8-844f-5330c25fdd18 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:27.736953 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9981689-6a6c-4636-af8c-d7bc3ced82f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:27.737767 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9981689-6a6c-4636-af8c-d7bc3ced82f8 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:27.738148 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9981689-6a6c-4636-af8c-d7bc3ced82f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:27.738520 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9981689-6a6c-4636-af8c-d7bc3ced82f8 None admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:27.739420 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9981689-6a6c-4636-af8c-d7bc3ced82f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:27.741485 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9981689-6a6c-4636-af8c-d7bc3ced82f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:27.743029 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9981689-6a6c-4636-af8c-d7bc3ced82f8 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:27.753970 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 293/602] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:27.760152 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c1805-e8d6-47f8-844f-5330c25fdd18 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:27.779736 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 310/603] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:32:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:27.786960 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9981689-6a6c-4636-af8c-d7bc3ced82f8 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:27.883983 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:27.954831 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c1805-e8d6-47f8-844f-5330c25fdd18 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:27.972780 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9981689-6a6c-4636-af8c-d7bc3ced82f8 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:28.014576 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22c711-ecc6-4bf8-8fc6-a7f516ad2137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:28.015377 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22c711-ecc6-4bf8-8fc6-a7f516ad2137 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:28.015851 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22c711-ecc6-4bf8-8fc6-a7f516ad2137 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:28.016126 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22c711-ecc6-4bf8-8fc6-a7f516ad2137 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:28.031961 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c22c711-ecc6-4bf8-8fc6-a7f516ad2137 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:28.033562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c22c711-ecc6-4bf8-8fc6-a7f516ad2137 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:28.038327 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa39aee-3a40-441e-bddf-12242f9e0542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:28.039277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa39aee-3a40-441e-bddf-12242f9e0542 None admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:28.039565 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa39aee-3a40-441e-bddf-12242f9e0542 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:28.039915 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa39aee-3a40-441e-bddf-12242f9e0542 None admin] PATH_INFO: `/v3/projects/be349194440449209f19f6b535ffd4f6/users/dd75a24363c14e86b0fbbb782b372646/roles/a0a4f5f9b3264740a55056fed8fd7a33` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:28.057960 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa39aee-3a40-441e-bddf-12242f9e0542 None admin] RBAC: Authorizing `identity:create_grant(project_id=be349194440449209f19f6b535ffd4f6, user_id=dd75a24363c14e86b0fbbb782b372646, role_id=a0a4f5f9b3264740a55056fed8fd7a33)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:28.059422 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa39aee-3a40-441e-bddf-12242f9e0542 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:28.072081 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-0c22c711-ecc6-4bf8-8fc6-a7f516ad2137 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:28.072081 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:28.072081 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:28.072081 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:28.072081 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:28.072081 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:28.072081 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:28.072081 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:28.072081 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:28.072081 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:28.072081 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:28.072081 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:28.072081 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:32:28.072081 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:32:28.072081 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:32:28.072985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:32:28.072985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:28.072985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:28.072985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:28.072985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:28.072985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:28.072985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:28.072985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:28.072985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:28.072985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:28.072985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:28.072985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:28.072985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:28.072985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:28.072985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:28.072985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:28.072985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:28.074145 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:32:28.074145 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:32:28.074145 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:32:28.074145 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:32:28.074145 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:32:28.074145 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:32:28.074145 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:28.074145 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:28.076580 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 294/604] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:32:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:32:28.082722 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcd916-315b-49c1-befb-b54ddb7a8e1f None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:28.083017 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcd916-315b-49c1-befb-b54ddb7a8e1f None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:28.083296 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcd916-315b-49c1-befb-b54ddb7a8e1f None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:28.084772 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 295/605] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:32:28.085332 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcd916-315b-49c1-befb-b54ddb7a8e1f None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:28.143100 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:28.163123 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 311/606] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 08:32:27 2022] PUT /identity/v3/projects/be349194440449209f19f6b535ffd4f6/users/dd75a24363c14e86b0fbbb782b372646/roles/a0a4f5f9b3264740a55056fed8fd7a33 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:32:28.165073 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bebbe-bf3e-4ac0-877f-facaf7ab6a32 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:28.165611 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bebbe-bf3e-4ac0-877f-facaf7ab6a32 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:28.166106 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bebbe-bf3e-4ac0-877f-facaf7ab6a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:28.196947 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-272bebbe-bf3e-4ac0-877f-facaf7ab6a32 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:28.198728 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-272bebbe-bf3e-4ac0-877f-facaf7ab6a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:28.284560 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 312/607] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:32:28.299352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcd916-315b-49c1-befb-b54ddb7a8e1f None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:28.306807 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bebbe-bf3e-4ac0-877f-facaf7ab6a32 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:28.343812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64a0d4-9c90-4eb1-9dce-0520d1edbdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:28.345470 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64a0d4-9c90-4eb1-9dce-0520d1edbdf3 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:28.345807 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64a0d4-9c90-4eb1-9dce-0520d1edbdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:28.346209 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64a0d4-9c90-4eb1-9dce-0520d1edbdf3 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:28.347129 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64a0d4-9c90-4eb1-9dce-0520d1edbdf3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:28.347445 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64a0d4-9c90-4eb1-9dce-0520d1edbdf3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:28.349896 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64a0d4-9c90-4eb1-9dce-0520d1edbdf3 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:28.357917 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:28.365004 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 296/608] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:32:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:28.371833 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64a0d4-9c90-4eb1-9dce-0520d1edbdf3 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:28.474496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bebbe-bf3e-4ac0-877f-facaf7ab6a32 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:28.510632 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64a0d4-9c90-4eb1-9dce-0520d1edbdf3 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:28.536127 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:28.549070 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8921c6b-075d-42f6-b13b-65780bcdc999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:28.551895 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8921c6b-075d-42f6-b13b-65780bcdc999 None admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:28.551895 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8921c6b-075d-42f6-b13b-65780bcdc999 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:28.551895 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8921c6b-075d-42f6-b13b-65780bcdc999 None admin] PATH_INFO: `/v3/projects/be349194440449209f19f6b535ffd4f6/users/a08bd52110074f11ba56b2f02397062f/roles/a0a4f5f9b3264740a55056fed8fd7a33` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:28.568845 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37c4c5-45b7-4ac3-9a0f-8085561bd897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:28.569649 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37c4c5-45b7-4ac3-9a0f-8085561bd897 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:28.569932 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37c4c5-45b7-4ac3-9a0f-8085561bd897 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:28.570208 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37c4c5-45b7-4ac3-9a0f-8085561bd897 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:28.580003 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8921c6b-075d-42f6-b13b-65780bcdc999 None admin] RBAC: Authorizing `identity:create_grant(project_id=be349194440449209f19f6b535ffd4f6, user_id=a08bd52110074f11ba56b2f02397062f, role_id=a0a4f5f9b3264740a55056fed8fd7a33)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:28.581456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8921c6b-075d-42f6-b13b-65780bcdc999 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:28.590571 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37c4c5-45b7-4ac3-9a0f-8085561bd897 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:28.598462 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-0c37c4c5-45b7-4ac3-9a0f-8085561bd897 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:28.598462 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:28.598462 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:28.598462 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:28.598462 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:28.598462 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:28.598462 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:28.598462 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:28.598462 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:28.598462 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:28.598462 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:28.598462 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:28.598462 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:28.598462 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:28.598462 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:28.598462 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:28.603633 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:28.603633 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:28.603633 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:28.603633 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:28.603633 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:28.603633 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:28.603633 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:28.603633 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:28.603633 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:28.603633 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:28.603633 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:28.603633 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:28.603633 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:28.603633 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:28.603633 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:28.603633 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:28.604763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:28.604763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:28.604763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:28.604763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:28.604763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:28.604763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:28.604763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:28.604763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:28.604763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:28.604763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:28.604763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:28.604763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:28.604763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 313/609] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 08:32:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:28.605568 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37c4c5-45b7-4ac3-9a0f-8085561bd897 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:28.684924 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 297/610] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 08:32:28 2022] PUT /identity/v3/projects/be349194440449209f19f6b535ffd4f6/users/a08bd52110074f11ba56b2f02397062f/roles/a0a4f5f9b3264740a55056fed8fd7a33 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:32:28.729919 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:28.737387 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37c4c5-45b7-4ac3-9a0f-8085561bd897 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:28.775146 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6469ff-00dc-45d1-b9d3-0ba23a2a6bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:28.775863 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6469ff-00dc-45d1-b9d3-0ba23a2a6bf5 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:28.776150 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6469ff-00dc-45d1-b9d3-0ba23a2a6bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:28.776432 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6469ff-00dc-45d1-b9d3-0ba23a2a6bf5 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:28.777194 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6469ff-00dc-45d1-b9d3-0ba23a2a6bf5 None admin] RBAC: Adding query filter params (name=service) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:28.777505 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6469ff-00dc-45d1-b9d3-0ba23a2a6bf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:28.778903 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6469ff-00dc-45d1-b9d3-0ba23a2a6bf5 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:28.789560 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 314/611] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 08:32:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:28.795202 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8921c6b-075d-42f6-b13b-65780bcdc999 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:28.908080 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8921c6b-075d-42f6-b13b-65780bcdc999 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:28.954244 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92609e8-fd6d-4ebb-ab89-42927879c0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:28.954973 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92609e8-fd6d-4ebb-ab89-42927879c0ce None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:28.955256 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92609e8-fd6d-4ebb-ab89-42927879c0ce None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:28.955537 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92609e8-fd6d-4ebb-ab89-42927879c0ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:28.967463 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92609e8-fd6d-4ebb-ab89-42927879c0ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:28.969017 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92609e8-fd6d-4ebb-ab89-42927879c0ce None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:28.988587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-b92609e8-fd6d-4ebb-ab89-42927879c0ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:28.988587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:28.988587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:28.988587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:28.988587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:28.988587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:28.988587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:28.988587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:28.988587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:28.988587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:28.988587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:28.988587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:28.988587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:28.988587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:28.988587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:28.989488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:28.989488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:28.989488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:28.989488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:28.989488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:28.989488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:28.989488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:28.989488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:28.989488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:28.989488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:28.989488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:28.989488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:28.989488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:28.989488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:28.989488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:28.989488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:28.989488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:28.991446 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:28.991446 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:28.991446 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:28.991446 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:28.991446 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 298/612] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:28.995675 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6469ff-00dc-45d1-b9d3-0ba23a2a6bf5 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:29.102456 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6469ff-00dc-45d1-b9d3-0ba23a2a6bf5 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:29.137201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50326e-92e4-46c4-9de3-df8ea0f64198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:29.137867 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50326e-92e4-46c4-9de3-df8ea0f64198 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:29.138152 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50326e-92e4-46c4-9de3-df8ea0f64198 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:29.138431 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50326e-92e4-46c4-9de3-df8ea0f64198 None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:29.139158 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50326e-92e4-46c4-9de3-df8ea0f64198 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:29.139465 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50326e-92e4-46c4-9de3-df8ea0f64198 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:29.141430 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50326e-92e4-46c4-9de3-df8ea0f64198 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:29.153870 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 315/613] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:29.160100 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92609e8-fd6d-4ebb-ab89-42927879c0ce None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:29.172875 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:29.285830 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92609e8-fd6d-4ebb-ab89-42927879c0ce None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:29.327589 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f621d5-000c-4484-b290-5b898916c3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:29.329277 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f621d5-000c-4484-b290-5b898916c3a1 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:29.329277 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f621d5-000c-4484-b290-5b898916c3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:29.329509 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f621d5-000c-4484-b290-5b898916c3a1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:29.341384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f621d5-000c-4484-b290-5b898916c3a1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:29.342827 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f621d5-000c-4484-b290-5b898916c3a1 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:29.361643 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-96f621d5-000c-4484-b290-5b898916c3a1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 08:32:29.361643 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:29.361643 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:29.361643 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:29.361643 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:29.361643 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:29.361643 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:29.361643 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:29.361643 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:29.361643 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:29.361643 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:29.361643 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:29.361643 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:32:29.361643 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:32:29.361643 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:32:29.361643 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:32:29.363011 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:29.363011 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:29.363011 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:32:29.363011 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:29.363011 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:32:29.363011 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:29.363011 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:29.363011 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:29.363011 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:29.363011 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:29.363011 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:29.363011 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:29.363011 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:29.363011 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:29.363011 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:29.363011 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:29.363011 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:29.363011 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:29.364928 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:29.364928 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:29.364928 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:32:29.364928 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:32:29.364928 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:32:29.364928 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:32:29.364928 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:32:29.364928 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:32:29.364928 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 08:32:29.364928 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:29.364928 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 299/614] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:32:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:32:29.371506 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50326e-92e4-46c4-9de3-df8ea0f64198 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:29.395857 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:29.491495 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50326e-92e4-46c4-9de3-df8ea0f64198 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:29.529063 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe9f82-bd0f-4894-9ae8-bd1f57a8354e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:29.529746 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe9f82-bd0f-4894-9ae8-bd1f57a8354e None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:29.530026 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe9f82-bd0f-4894-9ae8-bd1f57a8354e None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:29.530300 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe9f82-bd0f-4894-9ae8-bd1f57a8354e None admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:29.531188 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe9f82-bd0f-4894-9ae8-bd1f57a8354e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:29.531993 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe9f82-bd0f-4894-9ae8-bd1f57a8354e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:29.533041 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe9f82-bd0f-4894-9ae8-bd1f57a8354e None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:29.552933 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 316/615] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Jul 25 08:32:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:29.558393 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f621d5-000c-4484-b290-5b898916c3a1 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:29.655883 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:29.701219 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f621d5-000c-4484-b290-5b898916c3a1 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:29.746395 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c1086-0609-4100-9aaf-7187e286fa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:29.747479 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c1086-0609-4100-9aaf-7187e286fa6e None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:29.747935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c1086-0609-4100-9aaf-7187e286fa6e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:29.748357 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c1086-0609-4100-9aaf-7187e286fa6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:29.764356 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c1086-0609-4100-9aaf-7187e286fa6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:29.766741 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c1086-0609-4100-9aaf-7187e286fa6e None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:29.788217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-a62c1086-0609-4100-9aaf-7187e286fa6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:29.788217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:29.788217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:29.788217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:29.788217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:29.788217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:29.788217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:29.788217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:29.788217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:29.788217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:29.788217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:29.788217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:29.788217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:29.788217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:29.788217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:29.789262 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:29.789262 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:29.789262 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:29.789262 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:29.789262 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:29.789262 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:29.789262 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:29.789262 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:29.789262 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:29.789262 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:29.789262 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:29.789262 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:29.789262 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:29.789262 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:29.789262 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:29.789262 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:29.789262 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:29.790343 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:29.790343 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:29.790343 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:29.790343 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:29.791908 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 300/616] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:29.798230 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe9f82-bd0f-4894-9ae8-bd1f57a8354e None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:29.829283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f988db0-a913-414c-a15c-14e7dd3f3321 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:29.829802 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f988db0-a913-414c-a15c-14e7dd3f3321 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:29.830225 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f988db0-a913-414c-a15c-14e7dd3f3321 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:29.832753 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 301/617] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:29.840981 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a223a35-0270-41a6-b15c-3fe80d99dfbb None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:29.841268 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a223a35-0270-41a6-b15c-3fe80d99dfbb None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:29.841549 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a223a35-0270-41a6-b15c-3fe80d99dfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:29.870305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-0a223a35-0270-41a6-b15c-3fe80d99dfbb None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:29.871508 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0a223a35-0270-41a6-b15c-3fe80d99dfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:29.929036 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:29.983505 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe9f82-bd0f-4894-9ae8-bd1f57a8354e None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:29.988699 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 302/618] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:32:30.010737 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a223a35-0270-41a6-b15c-3fe80d99dfbb None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:30.049032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb90ce3-34fd-4e40-acc8-cccf3c0445b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:30.049753 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb90ce3-34fd-4e40-acc8-cccf3c0445b8 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:30.050036 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb90ce3-34fd-4e40-acc8-cccf3c0445b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:30.050308 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb90ce3-34fd-4e40-acc8-cccf3c0445b8 None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:30.051080 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb90ce3-34fd-4e40-acc8-cccf3c0445b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:30.051392 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb90ce3-34fd-4e40-acc8-cccf3c0445b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:30.052797 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb90ce3-34fd-4e40-acc8-cccf3c0445b8 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:30.071782 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 317/619] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:30.073146 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7d91f-8a05-4e79-8867-aa108fc9dfef None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:30.073436 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7d91f-8a05-4e79-8867-aa108fc9dfef None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:30.073712 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7d91f-8a05-4e79-8867-aa108fc9dfef None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:30.075173 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 318/620] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:30.080481 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf8cc4-0953-4ec4-ae9e-a9a3b6a12dbf None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:30.080763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf8cc4-0953-4ec4-ae9e-a9a3b6a12dbf None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:30.081038 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf8cc4-0953-4ec4-ae9e-a9a3b6a12dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:30.097320 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:30.101327 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-4fdf8cc4-0953-4ec4-ae9e-a9a3b6a12dbf None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:30.102574 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-4fdf8cc4-0953-4ec4-ae9e-a9a3b6a12dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:30.151017 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a223a35-0270-41a6-b15c-3fe80d99dfbb None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:30.180033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 319/621] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:32:30.180850 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf8cc4-0953-4ec4-ae9e-a9a3b6a12dbf None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:30.196383 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262262d-76ae-4f7c-bec1-9dd9542e4f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:30.197196 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262262d-76ae-4f7c-bec1-9dd9542e4f4f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:30.197488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262262d-76ae-4f7c-bec1-9dd9542e4f4f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:30.197761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262262d-76ae-4f7c-bec1-9dd9542e4f4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:30.218298 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262262d-76ae-4f7c-bec1-9dd9542e4f4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:30.227299 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-6262262d-76ae-4f7c-bec1-9dd9542e4f4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:30.227299 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:30.227299 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:30.227299 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:30.227299 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:30.227299 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:30.227299 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:30.227299 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:30.227299 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:30.227299 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:30.227299 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:30.227299 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:30.227299 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:30.227299 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:30.227299 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:30.227299 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:30.228283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:30.228283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:30.228283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:30.228283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:30.228283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:30.228283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:30.228283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:30.228283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:30.228283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:30.228283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:30.228283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:30.228283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:30.228283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:30.228283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:30.228283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:30.228283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:30.229099 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:30.229099 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:30.229099 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:30.229099 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:30.229099 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:30.229099 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:30.229099 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:30.229099 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:30.229099 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:30.229099 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:30.229099 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:30.229099 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:30.229099 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 303/622] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 08:32:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:32:30.229797 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262262d-76ae-4f7c-bec1-9dd9542e4f4f None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:30.253982 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:30.294120 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf8cc4-0953-4ec4-ae9e-a9a3b6a12dbf None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:30.331218 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653cd9b-4d75-4637-b6c1-80845e836f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:30.332139 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653cd9b-4d75-4637-b6c1-80845e836f15 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:30.332428 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653cd9b-4d75-4637-b6c1-80845e836f15 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:30.332698 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653cd9b-4d75-4637-b6c1-80845e836f15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:30.340097 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653cd9b-4d75-4637-b6c1-80845e836f15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:30.341597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653cd9b-4d75-4637-b6c1-80845e836f15 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:30.341854 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262262d-76ae-4f7c-bec1-9dd9542e4f4f None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:30.356712 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:30.357256 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-0653cd9b-4d75-4637-b6c1-80845e836f15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:30.357256 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:30.357256 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:30.357256 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:30.357256 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:30.357256 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:30.357256 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:30.357256 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:30.357256 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:30.357256 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:30.357256 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:30.357256 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:30.357256 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:32:30.357256 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:32:30.357256 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:32:30.358284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:32:30.358284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:30.358284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:30.358284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:30.358284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:30.358284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:30.358284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:30.358284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:30.358284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:30.358284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:30.358284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:30.358284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:30.358284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:30.358284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:30.358284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:30.358284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:30.358284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:30.359948 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:32:30.359948 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:32:30.359948 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:32:30.359948 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:32:30.359948 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:32:30.359948 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:32:30.359948 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:30.359948 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:30.362916 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 320/623] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:32:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:30.363971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653cd9b-4d75-4637-b6c1-80845e836f15 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:30.384974 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e676b5-f2bc-455c-894b-5f645594a454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:30.385737 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e676b5-f2bc-455c-894b-5f645594a454 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:30.386021 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e676b5-f2bc-455c-894b-5f645594a454 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:30.386296 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e676b5-f2bc-455c-894b-5f645594a454 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:30.399328 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e676b5-f2bc-455c-894b-5f645594a454 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:30.409587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-21e676b5-f2bc-455c-894b-5f645594a454 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:30.409587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:30.409587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:30.409587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:30.409587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:30.409587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:30.409587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:30.409587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:30.409587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:30.409587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:30.409587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:30.409587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:30.409587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:30.409587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:30.409587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:30.409587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:30.410812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:30.410812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:30.410812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:30.410812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:30.410812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:30.410812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:30.410812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:30.410812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:30.410812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:30.410812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:30.410812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:30.410812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:30.410812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:30.410812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:30.410812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:30.410812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:30.411884 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:30.411884 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:30.411884 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:30.411884 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:30.411884 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:30.411884 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:30.411884 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:30.411884 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:30.411884 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:30.411884 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:30.411884 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:30.411884 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:30.413383 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 304/624] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 08:32:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:30.414340 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e676b5-f2bc-455c-894b-5f645594a454 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:30.482477 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653cd9b-4d75-4637-b6c1-80845e836f15 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:30.520237 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e676b5-f2bc-455c-894b-5f645594a454 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:30.521799 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:30.525335 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff05840-6930-4f28-be99-e8e5d4208825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:30.526200 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff05840-6930-4f28-be99-e8e5d4208825 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:30.526643 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff05840-6930-4f28-be99-e8e5d4208825 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:30.527063 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff05840-6930-4f28-be99-e8e5d4208825 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:30.528036 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff05840-6930-4f28-be99-e8e5d4208825 None admin] RBAC: Adding query filter params (name=service) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:30.528589 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff05840-6930-4f28-be99-e8e5d4208825 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:30.530105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff05840-6930-4f28-be99-e8e5d4208825 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:30.544478 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 321/625] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 08:32:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:30.545645 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff05840-6930-4f28-be99-e8e5d4208825 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:30.558434 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57e4f8-e8c7-4982-9ec4-3be02ddf976a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:30.559178 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57e4f8-e8c7-4982-9ec4-3be02ddf976a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:30.559525 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57e4f8-e8c7-4982-9ec4-3be02ddf976a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:30.559904 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57e4f8-e8c7-4982-9ec4-3be02ddf976a None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:30.560699 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57e4f8-e8c7-4982-9ec4-3be02ddf976a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:30.561005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57e4f8-e8c7-4982-9ec4-3be02ddf976a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:30.563062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57e4f8-e8c7-4982-9ec4-3be02ddf976a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:30.579890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 305/626] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:32:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:30.579890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57e4f8-e8c7-4982-9ec4-3be02ddf976a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:30.610420 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:30.660664 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff05840-6930-4f28-be99-e8e5d4208825 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:30.681296 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57e4f8-e8c7-4982-9ec4-3be02ddf976a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:30.701435 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b281fc-9ba8-4653-addb-3497e8a0a696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:30.702506 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b281fc-9ba8-4653-addb-3497e8a0a696 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:30.703045 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b281fc-9ba8-4653-addb-3497e8a0a696 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:30.703523 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b281fc-9ba8-4653-addb-3497e8a0a696 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:30.704425 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b281fc-9ba8-4653-addb-3497e8a0a696 None admin] RBAC: Adding query filter params (name=service) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:30.704740 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b281fc-9ba8-4653-addb-3497e8a0a696 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:30.706123 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b281fc-9ba8-4653-addb-3497e8a0a696 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:30.721071 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 322/627] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 08:32:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:30.721071 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61e8db-2eb4-4844-83f2-70b29b011fa6 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:30.721071 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61e8db-2eb4-4844-83f2-70b29b011fa6 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:30.721071 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61e8db-2eb4-4844-83f2-70b29b011fa6 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:30.721071 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 323/628] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:30.721071 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61e8db-2eb4-4844-83f2-70b29b011fa6 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:30.725648 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89166979-d17e-48f3-98c0-645229e6da02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:30.726480 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89166979-d17e-48f3-98c0-645229e6da02 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:30.726760 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89166979-d17e-48f3-98c0-645229e6da02 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:30.727030 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89166979-d17e-48f3-98c0-645229e6da02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:30.738986 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89166979-d17e-48f3-98c0-645229e6da02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:30.740369 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89166979-d17e-48f3-98c0-645229e6da02 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:30.758447 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-89166979-d17e-48f3-98c0-645229e6da02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:30.758447 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:30.758447 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:30.758447 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:30.758447 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:30.758447 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:30.758447 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:30.758447 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:30.758447 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:30.758447 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:30.758447 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:30.758447 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:30.758447 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:30.758447 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:30.758447 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:30.759558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:30.759558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:30.759558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:30.759558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:30.759558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:30.759558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:30.759558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:30.759558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:30.759558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:30.759558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:30.759558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:30.759558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:30.759558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:30.759558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:30.759558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:30.759558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:30.759558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:30.760594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:30.760594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:30.760594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:30.760594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:30.764282 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 306/629] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:30.765120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89166979-d17e-48f3-98c0-645229e6da02 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:30.776775 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:30.833082 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61e8db-2eb4-4844-83f2-70b29b011fa6 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:30.855307 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:30.867867 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b7eca-6755-422d-8ef4-39b4c020a137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:30.868766 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b7eca-6755-422d-8ef4-39b4c020a137 None admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:30.869217 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b7eca-6755-422d-8ef4-39b4c020a137 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:30.869365 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b7eca-6755-422d-8ef4-39b4c020a137 None admin] PATH_INFO: `/v3/projects/be349194440449209f19f6b535ffd4f6/users/2763e540681547d3a6677567b3be86ea/roles/a0a4f5f9b3264740a55056fed8fd7a33` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:30.871922 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89166979-d17e-48f3-98c0-645229e6da02 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:30.884981 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b7eca-6755-422d-8ef4-39b4c020a137 None admin] RBAC: Authorizing `identity:create_grant(project_id=be349194440449209f19f6b535ffd4f6, user_id=2763e540681547d3a6677567b3be86ea, role_id=a0a4f5f9b3264740a55056fed8fd7a33)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:30.886431 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b7eca-6755-422d-8ef4-39b4c020a137 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:30.908459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7428ca-0709-4e15-9d10-bf60d926b42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:30.909501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7428ca-0709-4e15-9d10-bf60d926b42d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:30.909781 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7428ca-0709-4e15-9d10-bf60d926b42d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:30.910054 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7428ca-0709-4e15-9d10-bf60d926b42d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:30.921332 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7428ca-0709-4e15-9d10-bf60d926b42d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:30.922907 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7428ca-0709-4e15-9d10-bf60d926b42d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:30.940426 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-8f7428ca-0709-4e15-9d10-bf60d926b42d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:30.940426 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:30.940426 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:30.940426 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:30.940426 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:30.940426 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:30.940426 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:30.940426 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:30.940426 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:30.940426 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:30.940426 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:30.940426 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:30.940426 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:30.940426 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:30.940426 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:30.941479 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:30.941479 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:30.941479 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:30.941479 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:30.941479 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:30.941479 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:30.941479 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:30.941479 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:30.941479 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:30.941479 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:30.941479 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:30.941479 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:30.941479 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:30.941479 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:30.941479 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:30.941479 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:30.941479 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:30.947352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:30.947352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:30.947352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:30.947352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:30.947352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 307/630] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:30.947352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd21a7f-1a40-4dc1-b736-f36a978ec2e2 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:30.947352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd21a7f-1a40-4dc1-b736-f36a978ec2e2 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:30.947352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd21a7f-1a40-4dc1-b736-f36a978ec2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:30.955954 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 324/631] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 08:32:30 2022] PUT /identity/v3/projects/be349194440449209f19f6b535ffd4f6/users/2763e540681547d3a6677567b3be86ea/roles/a0a4f5f9b3264740a55056fed8fd7a33 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:32:30.956784 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b7eca-6755-422d-8ef4-39b4c020a137 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:30.971960 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-bfd21a7f-1a40-4dc1-b736-f36a978ec2e2 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:30.974529 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-bfd21a7f-1a40-4dc1-b736-f36a978ec2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:31.065462 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 308/632] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:32:31.066547 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd21a7f-1a40-4dc1-b736-f36a978ec2e2 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:31.096791 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:31.103236 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b7eca-6755-422d-8ef4-39b4c020a137 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:31.146474 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:31.155560 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be662e6-6bd4-46d1-bdb4-101e52d6d771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:31.157271 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be662e6-6bd4-46d1-bdb4-101e52d6d771 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:31.157852 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be662e6-6bd4-46d1-bdb4-101e52d6d771 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:31.158035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be662e6-6bd4-46d1-bdb4-101e52d6d771 None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:31.159100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be662e6-6bd4-46d1-bdb4-101e52d6d771 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:31.159874 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be662e6-6bd4-46d1-bdb4-101e52d6d771 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:31.161738 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be662e6-6bd4-46d1-bdb4-101e52d6d771 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:31.175143 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 325/633] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:31.176019 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be662e6-6bd4-46d1-bdb4-101e52d6d771 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:31.189788 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd21a7f-1a40-4dc1-b736-f36a978ec2e2 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:31.231341 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386316b-4baa-4dad-ae55-88fba0e19b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:31.232292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386316b-4baa-4dad-ae55-88fba0e19b32 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:31.232754 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386316b-4baa-4dad-ae55-88fba0e19b32 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:31.233180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386316b-4baa-4dad-ae55-88fba0e19b32 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:31.234189 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386316b-4baa-4dad-ae55-88fba0e19b32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:31.235455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386316b-4baa-4dad-ae55-88fba0e19b32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:31.236990 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386316b-4baa-4dad-ae55-88fba0e19b32 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:31.250576 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 309/634] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:31.251899 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386316b-4baa-4dad-ae55-88fba0e19b32 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:31.294243 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be662e6-6bd4-46d1-bdb4-101e52d6d771 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:31.331244 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b10a69-9359-4c48-8184-cce1b2bd5621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:31.332144 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b10a69-9359-4c48-8184-cce1b2bd5621 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:31.332524 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b10a69-9359-4c48-8184-cce1b2bd5621 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:31.332894 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b10a69-9359-4c48-8184-cce1b2bd5621 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:31.345299 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b10a69-9359-4c48-8184-cce1b2bd5621 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:31.353079 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-91b10a69-9359-4c48-8184-cce1b2bd5621 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:31.353079 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:31.353079 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:31.353079 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:31.353079 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:31.353079 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:31.353079 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:31.353079 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:31.353079 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:31.353079 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:31.353079 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:31.353079 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:31.353079 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:31.353079 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:31.353079 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:31.353079 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:31.354189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:31.354189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:31.354189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:31.354189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:31.354189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:31.354189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:31.354189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:31.354189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:31.354189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:31.354189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:31.354189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:31.354189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:31.354189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:31.354189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:31.354189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:31.354189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:31.355160 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:31.355160 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:31.355160 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:31.355160 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:31.355160 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:31.355160 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:31.355160 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:31.355160 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:31.355160 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:31.355160 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:31.355160 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:31.355160 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:31.355160 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 326/635] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 08:32:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:31.355961 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b10a69-9359-4c48-8184-cce1b2bd5621 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:31.368728 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386316b-4baa-4dad-ae55-88fba0e19b32 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:31.375368 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:31.396269 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:31.405565 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815531e-e308-4140-93a6-4721c491194e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:31.406531 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815531e-e308-4140-93a6-4721c491194e None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:31.406820 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815531e-e308-4140-93a6-4721c491194e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:31.407101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815531e-e308-4140-93a6-4721c491194e None admin] PATH_INFO: `/v3/users/nova` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:31.415075 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b815531e-e308-4140-93a6-4721c491194e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:31.416613 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b815531e-e308-4140-93a6-4721c491194e None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:31.432039 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-b815531e-e308-4140-93a6-4721c491194e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:32:31.432039 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:31.432039 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:31.432039 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:31.432039 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:31.432039 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:31.432039 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:31.432039 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:31.432039 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:31.432039 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:31.432039 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:31.432039 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:31.432039 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:32:31.432039 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:32:31.432039 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:32:31.432039 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:32:31.433023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:31.433023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:31.433023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:32:31.433023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:31.433023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:32:31.433023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:31.433023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:31.433023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:31.433023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:31.433023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:31.433023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:31.433023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:31.433023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:31.433023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:31.433023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:31.433023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:31.433023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:31.433023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:31.433980 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:31.433980 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:31.433980 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:32:31.433980 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:32:31.433980 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:32:31.433980 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:32:31.433980 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:32:31.433980 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:32:31.433980 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:32:31.433980 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:31.437901 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 310/636] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Jul 25 08:32:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:31.439302 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770a59b-a44b-43a0-91ac-357ec772a4d8 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:31.439595 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770a59b-a44b-43a0-91ac-357ec772a4d8 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:31.439908 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770a59b-a44b-43a0-91ac-357ec772a4d8 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:31.441470 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 311/637] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:31.442179 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770a59b-a44b-43a0-91ac-357ec772a4d8 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:31.463879 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b10a69-9359-4c48-8184-cce1b2bd5621 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:31.501284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa3d41-7301-4ce9-9b45-7ae752033644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:31.502082 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa3d41-7301-4ce9-9b45-7ae752033644 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:31.502361 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa3d41-7301-4ce9-9b45-7ae752033644 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:31.502632 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa3d41-7301-4ce9-9b45-7ae752033644 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:31.510384 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa3d41-7301-4ce9-9b45-7ae752033644 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:31.511840 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa3d41-7301-4ce9-9b45-7ae752033644 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:31.525945 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-c6aa3d41-7301-4ce9-9b45-7ae752033644 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 08:32:31.525945 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:31.525945 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:31.525945 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:31.525945 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:31.525945 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:31.525945 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:31.525945 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:31.525945 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:31.525945 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:31.525945 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:31.525945 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:31.525945 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:32:31.525945 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:32:31.525945 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:32:31.525945 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:32:31.526888 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:31.526888 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:31.526888 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:32:31.526888 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:31.526888 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:32:31.526888 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:31.526888 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:31.526888 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:31.526888 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:31.526888 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:31.526888 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:31.526888 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:31.526888 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:31.526888 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:31.526888 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:31.526888 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:31.526888 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:31.526888 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:31.527946 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:31.527946 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:31.527946 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:32:31.527946 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:32:31.527946 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:32:31.527946 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:32:31.527946 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:32:31.527946 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:32:31.527946 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 08:32:31.527946 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:31.527946 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 327/638] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:32:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:31.527946 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa3d41-7301-4ce9-9b45-7ae752033644 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:31.569212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770a59b-a44b-43a0-91ac-357ec772a4d8 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:31.606670 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039a714-3358-441e-8182-c6b8cb3ad7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:31.607571 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039a714-3358-441e-8182-c6b8cb3ad7d5 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:31.608041 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039a714-3358-441e-8182-c6b8cb3ad7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:31.608484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039a714-3358-441e-8182-c6b8cb3ad7d5 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:31.610036 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e039a714-3358-441e-8182-c6b8cb3ad7d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:31.610553 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e039a714-3358-441e-8182-c6b8cb3ad7d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:31.612220 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e039a714-3358-441e-8182-c6b8cb3ad7d5 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:31.613309 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:31.621778 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 312/639] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 08:32:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:31.623256 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44843c6f-7bd3-413a-9115-2aa07fd0bcf6 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:31.623547 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44843c6f-7bd3-413a-9115-2aa07fd0bcf6 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:31.623865 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44843c6f-7bd3-413a-9115-2aa07fd0bcf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:31.638971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa3d41-7301-4ce9-9b45-7ae752033644 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:31.642543 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-44843c6f-7bd3-413a-9115-2aa07fd0bcf6 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:31.643785 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-44843c6f-7bd3-413a-9115-2aa07fd0bcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:31.676586 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ef7b7-9808-4605-804f-430ede29dd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:31.677528 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ef7b7-9808-4605-804f-430ede29dd77 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:31.677811 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ef7b7-9808-4605-804f-430ede29dd77 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:31.678086 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ef7b7-9808-4605-804f-430ede29dd77 None admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:31.678924 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ef7b7-9808-4605-804f-430ede29dd77 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:31.679229 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ef7b7-9808-4605-804f-430ede29dd77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:31.680702 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ef7b7-9808-4605-804f-430ede29dd77 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:31.689142 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:31.701620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 328/640] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Jul 25 08:32:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:31.702522 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ef7b7-9808-4605-804f-430ede29dd77 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:31.724321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 313/641] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:32:31.725769 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44843c6f-7bd3-413a-9115-2aa07fd0bcf6 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:31.810364 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ef7b7-9808-4605-804f-430ede29dd77 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:31.845095 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44843c6f-7bd3-413a-9115-2aa07fd0bcf6 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:31.845269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ad301-1d1e-4c06-9e9d-d2e344c72009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:31.845878 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ad301-1d1e-4c06-9e9d-d2e344c72009 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:31.846162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ad301-1d1e-4c06-9e9d-d2e344c72009 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:31.846432 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ad301-1d1e-4c06-9e9d-d2e344c72009 None admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:31.847265 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ad301-1d1e-4c06-9e9d-d2e344c72009 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:31.847570 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ad301-1d1e-4c06-9e9d-d2e344c72009 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:31.849106 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ad301-1d1e-4c06-9e9d-d2e344c72009 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:31.852315 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:31.867902 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 329/642] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Jul 25 08:32:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:31.873206 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ad301-1d1e-4c06-9e9d-d2e344c72009 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:31.882045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86034977-025f-4b68-9442-1599cbb8558f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:31.883090 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86034977-025f-4b68-9442-1599cbb8558f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:31.883491 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86034977-025f-4b68-9442-1599cbb8558f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:31.883894 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86034977-025f-4b68-9442-1599cbb8558f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:31.894605 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86034977-025f-4b68-9442-1599cbb8558f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:31.896249 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86034977-025f-4b68-9442-1599cbb8558f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:31.915179 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-86034977-025f-4b68-9442-1599cbb8558f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:31.915179 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:31.915179 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:31.915179 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:31.915179 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:31.915179 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:31.915179 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:31.915179 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:31.915179 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:31.915179 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:31.915179 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:31.915179 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:31.915179 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:31.915179 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:31.915179 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:31.916321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:31.916321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:31.916321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:31.916321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:31.916321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:31.916321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:31.916321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:31.916321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:31.916321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:31.916321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:31.916321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:31.916321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:31.916321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:31.916321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:31.916321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:31.916321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:31.916321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:31.917419 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:31.917419 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:31.917419 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:31.917419 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:31.923257 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 314/643] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:31.923257 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86034977-025f-4b68-9442-1599cbb8558f None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:31.951980 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:31.983853 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ad301-1d1e-4c06-9e9d-d2e344c72009 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:32.021178 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db782a41-1647-46ba-985e-c4b08d14e455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:32.021825 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db782a41-1647-46ba-985e-c4b08d14e455 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:32.022115 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db782a41-1647-46ba-985e-c4b08d14e455 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:32.022373 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db782a41-1647-46ba-985e-c4b08d14e455 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:32.026744 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86034977-025f-4b68-9442-1599cbb8558f None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:32.064533 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fde4c-2ee5-4b1f-9e2b-d236858d1686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:32.065330 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fde4c-2ee5-4b1f-9e2b-d236858d1686 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:32.065618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fde4c-2ee5-4b1f-9e2b-d236858d1686 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:32.065900 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fde4c-2ee5-4b1f-9e2b-d236858d1686 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:32.076852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898fde4c-2ee5-4b1f-9e2b-d236858d1686 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:32.085388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-898fde4c-2ee5-4b1f-9e2b-d236858d1686 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:32.085388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:32.085388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:32.085388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:32.085388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:32.085388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:32.085388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:32.085388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:32.085388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:32.085388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:32.085388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:32.085388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:32.085388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:32.085388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:32.085388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:32.085388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:32.086326 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:32.086326 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:32.086326 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:32.086326 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:32.086326 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:32.086326 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:32.086326 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:32.086326 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:32.086326 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:32.086326 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:32.086326 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:32.086326 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:32.086326 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:32.086326 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:32.086326 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:32.086326 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:32.087297 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:32.087297 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:32.087297 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:32.087297 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:32.087297 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:32.087297 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:32.087297 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:32.087297 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:32.087297 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:32.087297 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:32.087297 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:32.087297 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:32.087297 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 315/644] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 08:32:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:32.088160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fde4c-2ee5-4b1f-9e2b-d236858d1686 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:32.093260 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:32.101325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db782a41-1647-46ba-985e-c4b08d14e455 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:32.103950 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db782a41-1647-46ba-985e-c4b08d14e455 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:32.187466 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:32.198322 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fde4c-2ee5-4b1f-9e2b-d236858d1686 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:32.215674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 330/645] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:32:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:32:32.215674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db782a41-1647-46ba-985e-c4b08d14e455 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:32.239141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1c22b-42d9-472a-a521-0924774ccaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:32.239922 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1c22b-42d9-472a-a521-0924774ccaa6 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:32.240207 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1c22b-42d9-472a-a521-0924774ccaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:32.240482 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1c22b-42d9-472a-a521-0924774ccaa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:32.310485 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:32.311086 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1c22b-42d9-472a-a521-0924774ccaa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:32.313572 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1c22b-42d9-472a-a521-0924774ccaa6 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:32.318346 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db782a41-1647-46ba-985e-c4b08d14e455 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:32.351823 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a8ea7-b5fd-4901-a227-fad6bd8d7e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:32.352484 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a8ea7-b5fd-4901-a227-fad6bd8d7e7b None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:32.352771 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a8ea7-b5fd-4901-a227-fad6bd8d7e7b None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:32.353047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a8ea7-b5fd-4901-a227-fad6bd8d7e7b None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:32.353778 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a8ea7-b5fd-4901-a227-fad6bd8d7e7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:32.354303 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a8ea7-b5fd-4901-a227-fad6bd8d7e7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:32.355452 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a8ea7-b5fd-4901-a227-fad6bd8d7e7b None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:32.368315 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 331/646] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:32.373221 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a8ea7-b5fd-4901-a227-fad6bd8d7e7b None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:32.406866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:32.423426 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 316/647] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:32:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:32:32.423426 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1c22b-42d9-472a-a521-0924774ccaa6 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:32.479468 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a8ea7-b5fd-4901-a227-fad6bd8d7e7b None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:32.516732 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176af63c-f3b2-48a8-901f-81a2651d3e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:32.517465 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176af63c-f3b2-48a8-901f-81a2651d3e7a None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:32.517755 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176af63c-f3b2-48a8-901f-81a2651d3e7a None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:32.518030 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176af63c-f3b2-48a8-901f-81a2651d3e7a None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:32.518813 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176af63c-f3b2-48a8-901f-81a2651d3e7a None admin] RBAC: Adding query filter params (name=service) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:32.519126 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176af63c-f3b2-48a8-901f-81a2651d3e7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:32.520550 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176af63c-f3b2-48a8-901f-81a2651d3e7a None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:32.528673 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1c22b-42d9-472a-a521-0924774ccaa6 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:32.529238 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 332/648] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 08:32:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:32.530048 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176af63c-f3b2-48a8-901f-81a2651d3e7a None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:32.551365 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:32.572023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd6665-3263-475f-8590-fdd847d72317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:32.572824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd6665-3263-475f-8590-fdd847d72317 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:32.573113 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd6665-3263-475f-8590-fdd847d72317 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:32.573397 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd6665-3263-475f-8590-fdd847d72317 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:32.584162 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd6665-3263-475f-8590-fdd847d72317 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:32.585713 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd6665-3263-475f-8590-fdd847d72317 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:32.605450 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-92dd6665-3263-475f-8590-fdd847d72317 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:32.605450 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:32.605450 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:32.605450 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:32.605450 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:32.605450 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:32.605450 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:32.605450 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:32.605450 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:32.605450 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:32.605450 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:32.605450 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:32.605450 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:32.605450 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:32.605450 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:32.612703 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:32.612703 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:32.612703 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:32.612703 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:32.612703 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:32.612703 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:32.612703 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:32.612703 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:32.612703 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:32.612703 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:32.612703 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:32.612703 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:32.612703 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:32.612703 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:32.612703 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:32.612703 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:32.612703 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:32.613829 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:32.613829 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:32.613829 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:32.613829 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:32.613829 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 317/649] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:32.613829 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd6665-3263-475f-8590-fdd847d72317 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:32.640780 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176af63c-f3b2-48a8-901f-81a2651d3e7a None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:32.660295 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:32.676848 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c59c90-eff6-40d8-88e0-4b7fe87bc965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:32.677783 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c59c90-eff6-40d8-88e0-4b7fe87bc965 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:32.678135 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c59c90-eff6-40d8-88e0-4b7fe87bc965 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:32.678480 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c59c90-eff6-40d8-88e0-4b7fe87bc965 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:32.691937 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c59c90-eff6-40d8-88e0-4b7fe87bc965 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:32.693902 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c59c90-eff6-40d8-88e0-4b7fe87bc965 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:32.715752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-91c59c90-eff6-40d8-88e0-4b7fe87bc965 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 08:32:32.715752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:32.715752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:32.715752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:32.715752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:32.715752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:32.715752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:32.715752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:32.715752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:32.715752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:32.715752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:32.715752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:32.715752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:32:32.715752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:32:32.715752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:32:32.715752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:32:32.716757 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:32.716757 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:32.716757 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:32:32.716757 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:32.716757 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:32:32.716757 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:32.716757 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:32.716757 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:32.716757 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:32.716757 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:32.716757 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:32.716757 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:32.716757 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:32.716757 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:32.716757 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:32.716757 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:32.716757 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:32.716757 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:32.724439 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:32.724439 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:32.724439 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:32:32.724439 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:32:32.724439 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:32:32.724439 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:32:32.724439 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:32:32.724439 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:32:32.724439 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 08:32:32.724439 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:32.724439 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 333/650] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:32:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:32.724439 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c59c90-eff6-40d8-88e0-4b7fe87bc965 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:32.740001 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd6665-3263-475f-8590-fdd847d72317 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:32.779957 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498d17f-8019-4eb6-af97-f39ba33cd2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:32.780793 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498d17f-8019-4eb6-af97-f39ba33cd2eb None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:32.781700 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498d17f-8019-4eb6-af97-f39ba33cd2eb None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:32.781983 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498d17f-8019-4eb6-af97-f39ba33cd2eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:32.793149 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498d17f-8019-4eb6-af97-f39ba33cd2eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:32.794690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498d17f-8019-4eb6-af97-f39ba33cd2eb None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:32.802326 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:32.814305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-4498d17f-8019-4eb6-af97-f39ba33cd2eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:32.814305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:32.814305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:32.814305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:32.814305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:32.814305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:32.814305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:32.814305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:32.814305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:32.814305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:32.814305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:32.814305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:32.814305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:32.814305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:32.814305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:32.821101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:32.821101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:32.821101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:32.821101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:32.821101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:32.821101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:32.821101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:32.821101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:32.821101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:32.821101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:32.821101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:32.821101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:32.821101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:32.821101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:32.821101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:32.821101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:32.821101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:32.822219 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:32.822219 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:32.822219 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:32.822219 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:32.822219 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 318/651] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:32.822219 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498d17f-8019-4eb6-af97-f39ba33cd2eb None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:32.834548 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c59c90-eff6-40d8-88e0-4b7fe87bc965 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:32.870267 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5a364-bd43-4232-9892-181f095e3f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:32.871240 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5a364-bd43-4232-9892-181f095e3f51 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:32.871483 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5a364-bd43-4232-9892-181f095e3f51 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:32.871802 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5a364-bd43-4232-9892-181f095e3f51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:32.882579 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da5a364-bd43-4232-9892-181f095e3f51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:32.884158 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da5a364-bd43-4232-9892-181f095e3f51 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:32.901622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-9da5a364-bd43-4232-9892-181f095e3f51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:32.901622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:32.901622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:32.901622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:32.901622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:32.901622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:32.901622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:32.901622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:32.901622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:32.901622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:32.901622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:32.901622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:32.901622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:32.901622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:32.901622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:32.902536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:32.902536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:32.902536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:32.902536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:32.902536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:32.902536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:32.902536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:32.902536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:32.902536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:32.902536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:32.902536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:32.902536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:32.902536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:32.902536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:32.902536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:32.902536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:32.902536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:32.903520 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:32.903520 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:32.903520 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:32.903520 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:32.903520 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 334/652] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:32.904415 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5a364-bd43-4232-9892-181f095e3f51 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:32.924852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:32.931099 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498d17f-8019-4eb6-af97-f39ba33cd2eb None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:32.965163 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de610f4-24b0-409b-8ff2-fe41b4892e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:32.965969 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de610f4-24b0-409b-8ff2-fe41b4892e99 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:32.966263 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de610f4-24b0-409b-8ff2-fe41b4892e99 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:32.966546 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de610f4-24b0-409b-8ff2-fe41b4892e99 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:32.967285 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de610f4-24b0-409b-8ff2-fe41b4892e99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:32.967598 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de610f4-24b0-409b-8ff2-fe41b4892e99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:32.969615 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de610f4-24b0-409b-8ff2-fe41b4892e99 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:32.981591 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 319/653] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:32.983737 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de610f4-24b0-409b-8ff2-fe41b4892e99 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:33.010582 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5a364-bd43-4232-9892-181f095e3f51 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:33.041884 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:33.050846 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f7beb-38ed-40c4-bfa0-988a98b6749c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:33.051802 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f7beb-38ed-40c4-bfa0-988a98b6749c None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:33.052092 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f7beb-38ed-40c4-bfa0-988a98b6749c None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:33.052372 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f7beb-38ed-40c4-bfa0-988a98b6749c None admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:33.053220 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f7beb-38ed-40c4-bfa0-988a98b6749c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:33.053531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f7beb-38ed-40c4-bfa0-988a98b6749c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:33.054962 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f7beb-38ed-40c4-bfa0-988a98b6749c None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:33.072983 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 335/654] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Jul 25 08:32:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:33.073934 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f7beb-38ed-40c4-bfa0-988a98b6749c None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:33.094155 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de610f4-24b0-409b-8ff2-fe41b4892e99 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:33.129117 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30900c4-c06f-410f-aa13-3b0493b4841a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:33.129774 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30900c4-c06f-410f-aa13-3b0493b4841a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:33.130059 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30900c4-c06f-410f-aa13-3b0493b4841a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:33.130334 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30900c4-c06f-410f-aa13-3b0493b4841a None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:33.131059 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30900c4-c06f-410f-aa13-3b0493b4841a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:33.131368 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30900c4-c06f-410f-aa13-3b0493b4841a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:33.132757 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30900c4-c06f-410f-aa13-3b0493b4841a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:33.144680 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 320/655] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:33.145308 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30900c4-c06f-410f-aa13-3b0493b4841a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:33.159969 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:33.178358 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f7beb-38ed-40c4-bfa0-988a98b6749c None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:33.212889 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c32c7-7ca6-48f3-8a2f-4a0ac28cb515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:33.213558 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c32c7-7ca6-48f3-8a2f-4a0ac28cb515 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:33.213842 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c32c7-7ca6-48f3-8a2f-4a0ac28cb515 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:33.214122 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c32c7-7ca6-48f3-8a2f-4a0ac28cb515 None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:33.214843 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c32c7-7ca6-48f3-8a2f-4a0ac28cb515 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:33.215151 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c32c7-7ca6-48f3-8a2f-4a0ac28cb515 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:33.216553 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c32c7-7ca6-48f3-8a2f-4a0ac28cb515 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:33.228601 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 336/656] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:33.230083 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c4938-b99d-43fe-94fd-2a7d87d32ec8 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:33.230535 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c4938-b99d-43fe-94fd-2a7d87d32ec8 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:33.230965 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c4938-b99d-43fe-94fd-2a7d87d32ec8 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:33.232753 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 337/657] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:33.233686 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c4938-b99d-43fe-94fd-2a7d87d32ec8 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:33.244747 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30900c4-c06f-410f-aa13-3b0493b4841a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:33.279544 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b225563-d7ac-4e26-8958-efc59de2ffd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:33.280310 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b225563-d7ac-4e26-8958-efc59de2ffd3 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:33.280591 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b225563-d7ac-4e26-8958-efc59de2ffd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:33.280870 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b225563-d7ac-4e26-8958-efc59de2ffd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:33.281213 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:33.287905 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b225563-d7ac-4e26-8958-efc59de2ffd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:33.289411 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b225563-d7ac-4e26-8958-efc59de2ffd3 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:33.303474 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-3b225563-d7ac-4e26-8958-efc59de2ffd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:33.303474 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:33.303474 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:33.303474 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:33.303474 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:33.303474 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:33.303474 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:33.303474 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:33.303474 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:33.303474 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:33.303474 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:33.303474 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:33.303474 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:32:33.303474 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:32:33.303474 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:32:33.304608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:32:33.304608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:33.304608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:33.304608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:33.304608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:33.304608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:33.304608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:33.304608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:33.304608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:33.304608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:33.304608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:33.304608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:33.304608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:33.304608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:33.304608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:33.304608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:33.304608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:33.310486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:32:33.310486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:32:33.310486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:32:33.310486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:32:33.310486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:32:33.310486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:32:33.310486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:33.310486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:33.310486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 321/658] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:32:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:33.310486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b225563-d7ac-4e26-8958-efc59de2ffd3 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:33.337227 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c4938-b99d-43fe-94fd-2a7d87d32ec8 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:33.369456 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb2fa1-b86d-42a7-986a-7325da62e50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:33.370103 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb2fa1-b86d-42a7-986a-7325da62e50a None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:33.370387 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb2fa1-b86d-42a7-986a-7325da62e50a None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:33.370666 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb2fa1-b86d-42a7-986a-7325da62e50a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:33.383807 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:33.408432 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b225563-d7ac-4e26-8958-efc59de2ffd3 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:33.438475 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb2fa1-b86d-42a7-986a-7325da62e50a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:33.439966 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb2fa1-b86d-42a7-986a-7325da62e50a None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:33.441860 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d4a09-d771-4210-afe4-e22e586d339e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:33.442652 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d4a09-d771-4210-afe4-e22e586d339e None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:33.442943 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d4a09-d771-4210-afe4-e22e586d339e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:33.443226 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d4a09-d771-4210-afe4-e22e586d339e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:33.450484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d4a09-d771-4210-afe4-e22e586d339e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:33.451951 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d4a09-d771-4210-afe4-e22e586d339e None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:33.466892 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-7b0d4a09-d771-4210-afe4-e22e586d339e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:33.466892 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:33.466892 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:33.466892 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:33.466892 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:33.466892 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:33.466892 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:33.466892 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:33.466892 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:33.466892 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:33.466892 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:33.466892 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:33.466892 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:32:33.466892 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:32:33.466892 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:32:33.467984 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:32:33.467984 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:33.467984 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:33.467984 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:33.467984 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:33.467984 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:33.467984 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:33.467984 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:33.467984 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:33.467984 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:33.467984 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:33.467984 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:33.467984 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:33.467984 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:33.467984 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:33.467984 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:33.467984 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:33.469523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:32:33.469523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:32:33.469523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:32:33.469523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:32:33.469523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:32:33.469523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:32:33.469523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:33.469523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:33.471842 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 322/659] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:32:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:33.472645 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d4a09-d771-4210-afe4-e22e586d339e None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:33.486404 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:33.539348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 338/660] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:32:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:32:33.540557 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb84bf-282c-4d55-94f6-2caed153edc1 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:33.540841 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb84bf-282c-4d55-94f6-2caed153edc1 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:33.541113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb84bf-282c-4d55-94f6-2caed153edc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:33.558769 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-7afb84bf-282c-4d55-94f6-2caed153edc1 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:33.560011 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-7afb84bf-282c-4d55-94f6-2caed153edc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:33.578058 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d4a09-d771-4210-afe4-e22e586d339e None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:33.613211 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd494e-0335-4f17-a089-36b1b3f1bdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:33.614007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd494e-0335-4f17-a089-36b1b3f1bdd8 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:33.614295 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd494e-0335-4f17-a089-36b1b3f1bdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:33.614598 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd494e-0335-4f17-a089-36b1b3f1bdd8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:33.616557 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:33.621979 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd494e-0335-4f17-a089-36b1b3f1bdd8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:33.623449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd494e-0335-4f17-a089-36b1b3f1bdd8 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:33.626943 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 339/661] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:32:33.628315 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb84bf-282c-4d55-94f6-2caed153edc1 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:33.645357 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-61fd494e-0335-4f17-a089-36b1b3f1bdd8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 08:32:33.645357 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:33.645357 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:33.645357 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:33.645357 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:33.645357 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:33.645357 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:33.645357 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:33.645357 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:33.645357 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:33.645357 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:33.645357 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:33.645357 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:32:33.645357 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:32:33.645357 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:32:33.645357 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:32:33.646484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:33.646484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:33.646484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:32:33.646484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:33.646484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:32:33.646484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:33.646484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:33.646484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:33.646484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:33.646484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:33.646484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:33.646484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:33.646484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:33.646484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:33.646484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:33.646484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:33.646484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:33.646484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:33.647550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:33.647550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:33.647550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:32:33.647550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:32:33.647550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:32:33.647550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:32:33.647550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:32:33.647550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:32:33.647550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 08:32:33.647550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:33.647550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 323/662] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 08:32:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:33.648365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd494e-0335-4f17-a089-36b1b3f1bdd8 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:33.717962 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:33.740708 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb84bf-282c-4d55-94f6-2caed153edc1 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:33.747049 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd494e-0335-4f17-a089-36b1b3f1bdd8 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:33.774304 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb19ce-930c-4f30-8b17-43f097ee15e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:33.774961 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb19ce-930c-4f30-8b17-43f097ee15e2 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:33.775249 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb19ce-930c-4f30-8b17-43f097ee15e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:33.775529 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb19ce-930c-4f30-8b17-43f097ee15e2 None admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:33.776372 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb19ce-930c-4f30-8b17-43f097ee15e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:33.776686 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb19ce-930c-4f30-8b17-43f097ee15e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:33.778126 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb19ce-930c-4f30-8b17-43f097ee15e2 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:33.780429 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86616000-a070-407a-a9ed-a0eadf9142bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:33.781139 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86616000-a070-407a-a9ed-a0eadf9142bb None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:33.781419 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86616000-a070-407a-a9ed-a0eadf9142bb None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:33.781692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86616000-a070-407a-a9ed-a0eadf9142bb None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:33.782478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86616000-a070-407a-a9ed-a0eadf9142bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:33.782783 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86616000-a070-407a-a9ed-a0eadf9142bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:33.784488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86616000-a070-407a-a9ed-a0eadf9142bb None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:33.789961 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 340/663] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:32:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:33.790691 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb19ce-930c-4f30-8b17-43f097ee15e2 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:33.800746 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 324/664] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:32:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:33.801550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86616000-a070-407a-a9ed-a0eadf9142bb None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:33.855117 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:33.893192 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb19ce-930c-4f30-8b17-43f097ee15e2 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:33.900474 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86616000-a070-407a-a9ed-a0eadf9142bb None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:33.926135 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d9f05-1284-4b78-9368-e70207720321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:33.927044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d9f05-1284-4b78-9368-e70207720321 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:33.927335 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d9f05-1284-4b78-9368-e70207720321 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:33.927628 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d9f05-1284-4b78-9368-e70207720321 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:33.930312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:33.933566 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9844c6-f1c9-437c-9c94-4385f08f5f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:33.934362 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9844c6-f1c9-437c-9c94-4385f08f5f90 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:33.934657 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9844c6-f1c9-437c-9c94-4385f08f5f90 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:33.934934 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9844c6-f1c9-437c-9c94-4385f08f5f90 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:33.939156 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d9f05-1284-4b78-9368-e70207720321 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:33.944904 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d9f05-1284-4b78-9368-e70207720321 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:33.945617 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9844c6-f1c9-437c-9c94-4385f08f5f90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:33.953501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-6f9844c6-f1c9-437c-9c94-4385f08f5f90 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:33.953501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:33.953501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:33.953501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:33.953501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:33.953501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:33.953501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:33.953501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:33.953501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:33.953501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:33.953501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:33.953501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:33.953501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:33.953501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:33.953501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:33.953501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:33.954646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:33.954646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:33.954646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:33.954646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:33.954646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:33.954646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:33.954646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:33.954646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:33.954646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:33.954646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:33.954646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:33.954646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:33.954646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:33.954646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:33.954646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:33.954646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:33.960610 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:33.960610 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:33.960610 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:33.960610 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:33.960610 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:33.960610 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:33.960610 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:33.960610 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:33.960610 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:33.960610 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:33.960610 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:33.960610 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:33.960610 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 325/665] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 08:32:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:33.960610 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9844c6-f1c9-437c-9c94-4385f08f5f90 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:33.961580 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-a44d9f05-1284-4b78-9368-e70207720321 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:33.961580 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:33.961580 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:33.961580 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:33.961580 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:33.961580 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:33.961580 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:33.961580 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:33.961580 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:33.961580 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:33.961580 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:33.961580 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:33.961580 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:33.961580 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:33.961580 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:33.962551 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:33.962551 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:33.962551 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:33.962551 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:33.962551 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:33.962551 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:33.962551 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:33.962551 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:33.962551 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:33.962551 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:33.962551 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:33.962551 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:33.962551 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:33.962551 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:33.962551 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:33.962551 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:33.962551 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:33.964082 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:33.964082 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:33.964082 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:33.964082 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:33.964082 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 341/666] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:33.964082 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d9f05-1284-4b78-9368-e70207720321 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:34.060107 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d9f05-1284-4b78-9368-e70207720321 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:34.063449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9844c6-f1c9-437c-9c94-4385f08f5f90 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:34.076764 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:34.094085 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93623940-4e9b-42a2-8202-5e1e18a7944d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:34.094733 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93623940-4e9b-42a2-8202-5e1e18a7944d None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:34.095019 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93623940-4e9b-42a2-8202-5e1e18a7944d None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:34.095296 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93623940-4e9b-42a2-8202-5e1e18a7944d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:34.096175 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93623940-4e9b-42a2-8202-5e1e18a7944d None admin] RBAC: Adding query filter params (role.id=a0a4f5f9b3264740a55056fed8fd7a33, scope.project.id=be349194440449209f19f6b535ffd4f6, user.id=1c1a08d3a76643a9996dc0daa8714ac6) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:34.096534 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93623940-4e9b-42a2-8202-5e1e18a7944d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:34.097289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e253c2c-fd12-47eb-a180-faed4a402c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:34.097947 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e253c2c-fd12-47eb-a180-faed4a402c23 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:34.098054 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93623940-4e9b-42a2-8202-5e1e18a7944d None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:34.098238 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e253c2c-fd12-47eb-a180-faed4a402c23 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:34.098514 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e253c2c-fd12-47eb-a180-faed4a402c23 None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:34.099354 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e253c2c-fd12-47eb-a180-faed4a402c23 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:34.099769 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e253c2c-fd12-47eb-a180-faed4a402c23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:34.101179 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e253c2c-fd12-47eb-a180-faed4a402c23 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:34.103836 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 342/667] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:32:33 2022] GET /identity/v3/role_assignments?user.id=1c1a08d3a76643a9996dc0daa8714ac6&scope.project.id=be349194440449209f19f6b535ffd4f6&role.id=a0a4f5f9b3264740a55056fed8fd7a33 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:34.104618 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93623940-4e9b-42a2-8202-5e1e18a7944d None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:34.121856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 326/668] 10.222.0.18 () {56 vars in 1139 bytes} [Mon Jul 25 08:32:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:34.123042 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e253c2c-fd12-47eb-a180-faed4a402c23 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:34.170749 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:34.232658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93623940-4e9b-42a2-8202-5e1e18a7944d None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:34.243273 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e253c2c-fd12-47eb-a180-faed4a402c23 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:34.274578 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7333e1-eb27-40b5-80ab-2c59a1b32a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:34.275905 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7333e1-eb27-40b5-80ab-2c59a1b32a72 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:34.275905 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7333e1-eb27-40b5-80ab-2c59a1b32a72 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:34.275905 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7333e1-eb27-40b5-80ab-2c59a1b32a72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:34.276648 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7333e1-eb27-40b5-80ab-2c59a1b32a72 None admin] RBAC: Adding query filter params (role.id=a0a4f5f9b3264740a55056fed8fd7a33, scope.project.id=be349194440449209f19f6b535ffd4f6, user.id=c53b69c61d9a46bc9e8aa1b4a9fd5fec) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:34.276963 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7333e1-eb27-40b5-80ab-2c59a1b32a72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:34.278419 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7333e1-eb27-40b5-80ab-2c59a1b32a72 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:34.283308 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c156e-4be0-4373-ad67-f2d5a669c806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:34.284263 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c156e-4be0-4373-ad67-f2d5a669c806 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:34.284550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c156e-4be0-4373-ad67-f2d5a669c806 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:34.284828 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c156e-4be0-4373-ad67-f2d5a669c806 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:34.285584 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c156e-4be0-4373-ad67-f2d5a669c806 None admin] RBAC: Adding query filter params (name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:34.285835 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 343/669] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:32:34 2022] GET /identity/v3/role_assignments?user.id=c53b69c61d9a46bc9e8aa1b4a9fd5fec&scope.project.id=be349194440449209f19f6b535ffd4f6&role.id=a0a4f5f9b3264740a55056fed8fd7a33 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:34.285943 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c156e-4be0-4373-ad67-f2d5a669c806 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:34.286691 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7333e1-eb27-40b5-80ab-2c59a1b32a72 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:34.287244 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c156e-4be0-4373-ad67-f2d5a669c806 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:34.298445 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 327/670] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 08:32:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:34.299331 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c156e-4be0-4373-ad67-f2d5a669c806 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:34.349176 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:34.420403 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7333e1-eb27-40b5-80ab-2c59a1b32a72 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:34.440884 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:34.446007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c156e-4be0-4373-ad67-f2d5a669c806 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:34.460681 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781da7c-beae-4c12-bdbf-5b01980c6bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:34.461357 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781da7c-beae-4c12-bdbf-5b01980c6bcc None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:34.461647 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781da7c-beae-4c12-bdbf-5b01980c6bcc None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:34.461927 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781da7c-beae-4c12-bdbf-5b01980c6bcc None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:34.462667 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781da7c-beae-4c12-bdbf-5b01980c6bcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:34.462987 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781da7c-beae-4c12-bdbf-5b01980c6bcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:34.464536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781da7c-beae-4c12-bdbf-5b01980c6bcc None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:34.479707 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 344/671] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:34.480869 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781da7c-beae-4c12-bdbf-5b01980c6bcc None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:34.489284 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad1583-dd29-4b01-8bdb-df5e4c58aa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:34.490275 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad1583-dd29-4b01-8bdb-df5e4c58aa92 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:34.490763 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad1583-dd29-4b01-8bdb-df5e4c58aa92 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:34.491257 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad1583-dd29-4b01-8bdb-df5e4c58aa92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:34.589037 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad1583-dd29-4b01-8bdb-df5e4c58aa92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:34.591817 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad1583-dd29-4b01-8bdb-df5e4c58aa92 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:34.611151 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781da7c-beae-4c12-bdbf-5b01980c6bcc None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:34.628348 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:34.656943 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880053ca-cb7e-4226-b57c-1056dad2f8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:34.658295 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880053ca-cb7e-4226-b57c-1056dad2f8b4 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:34.658840 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880053ca-cb7e-4226-b57c-1056dad2f8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:34.659115 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880053ca-cb7e-4226-b57c-1056dad2f8b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:34.673507 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880053ca-cb7e-4226-b57c-1056dad2f8b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:34.675454 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880053ca-cb7e-4226-b57c-1056dad2f8b4 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:34.699509 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-880053ca-cb7e-4226-b57c-1056dad2f8b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:34.699509 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:34.699509 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:34.699509 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:34.699509 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:34.699509 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:34.699509 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:34.699509 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:34.699509 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:34.699509 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:34.699509 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:34.699509 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:34.699509 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:34.699509 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:34.699509 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:34.700674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:34.700674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:34.700674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:34.700674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:34.700674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:34.700674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:34.700674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:34.700674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:34.700674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:34.700674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:34.700674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:34.700674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:34.700674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:34.700674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:34.700674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:34.700674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:34.700674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:34.701723 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:34.701723 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:34.701723 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:34.701723 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:34.701723 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 345/672] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:34.702008 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880053ca-cb7e-4226-b57c-1056dad2f8b4 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:34.707170 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 328/673] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:32:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:32:34.708150 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad1583-dd29-4b01-8bdb-df5e4c58aa92 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:34.736322 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:34.833098 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880053ca-cb7e-4226-b57c-1056dad2f8b4 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:34.838554 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad1583-dd29-4b01-8bdb-df5e4c58aa92 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:34.879112 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b21ed-efac-4d13-b2cd-85a050c4f16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:34.880042 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b21ed-efac-4d13-b2cd-85a050c4f16b None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:34.880329 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b21ed-efac-4d13-b2cd-85a050c4f16b None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:34.880606 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b21ed-efac-4d13-b2cd-85a050c4f16b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:34.890165 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c3e3e-1edc-4da1-9576-d1bf09debe31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:34.890980 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b21ed-efac-4d13-b2cd-85a050c4f16b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:34.892237 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c3e3e-1edc-4da1-9576-d1bf09debe31 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:34.892758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c3e3e-1edc-4da1-9576-d1bf09debe31 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:34.892982 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b21ed-efac-4d13-b2cd-85a050c4f16b None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:34.893624 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c3e3e-1edc-4da1-9576-d1bf09debe31 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:34.894690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c3e3e-1edc-4da1-9576-d1bf09debe31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:34.895203 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c3e3e-1edc-4da1-9576-d1bf09debe31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:34.896866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c3e3e-1edc-4da1-9576-d1bf09debe31 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:34.898674 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:34.908132 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-d62b21ed-efac-4d13-b2cd-85a050c4f16b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:34.908132 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:34.908132 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:34.908132 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:34.908132 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:34.908132 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:34.908132 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:34.908132 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:34.908132 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:34.908132 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:34.908132 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:34.908132 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:34.908132 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:32:34.908132 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:32:34.908132 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:32:34.917153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:32:34.917153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:34.917153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:34.917153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:34.917153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:34.917153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:34.917153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:34.917153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:34.917153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:34.917153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:34.917153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:34.917153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:34.917153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:34.917153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:34.917153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:34.917153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:34.917153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:34.918162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:32:34.918162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:32:34.918162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:32:34.918162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:32:34.918162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:32:34.918162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:32:34.918162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:34.918162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:34.918162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 346/674] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:32:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:34.918162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b21ed-efac-4d13-b2cd-85a050c4f16b None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:34.918706 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 329/675] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:34.918706 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c3e3e-1edc-4da1-9576-d1bf09debe31 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:35.022735 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:35.041211 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b21ed-efac-4d13-b2cd-85a050c4f16b None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:35.048410 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c3e3e-1edc-4da1-9576-d1bf09debe31 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:35.083732 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb195e31-361e-4ace-9c30-211b94b3b586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:35.084403 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb195e31-361e-4ace-9c30-211b94b3b586 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:35.084670 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb195e31-361e-4ace-9c30-211b94b3b586 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:35.084950 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb195e31-361e-4ace-9c30-211b94b3b586 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:35.085748 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb195e31-361e-4ace-9c30-211b94b3b586 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:35.086099 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb195e31-361e-4ace-9c30-211b94b3b586 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:35.087501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb195e31-361e-4ace-9c30-211b94b3b586 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:35.089860 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88890693-761d-4657-a13e-f3f72311ebea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:35.091340 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88890693-761d-4657-a13e-f3f72311ebea None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:35.091898 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88890693-761d-4657-a13e-f3f72311ebea None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:35.092403 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88890693-761d-4657-a13e-f3f72311ebea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:35.106120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 330/676] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:32:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:35.106120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb195e31-361e-4ace-9c30-211b94b3b586 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:35.113247 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88890693-761d-4657-a13e-f3f72311ebea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:35.114928 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88890693-761d-4657-a13e-f3f72311ebea None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:35.140977 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-88890693-761d-4657-a13e-f3f72311ebea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:35.140977 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:35.140977 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:35.140977 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:35.140977 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:35.140977 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:35.140977 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:35.140977 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:35.140977 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:35.140977 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:35.140977 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:35.140977 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:35.140977 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:35.140977 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:35.140977 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:35.142059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:35.142059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:35.142059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:35.142059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:35.142059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:35.142059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:35.142059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:35.142059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:35.142059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:35.142059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:35.142059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:35.142059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:35.142059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:35.142059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:35.142059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:35.142059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:35.142059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:35.143161 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:35.143161 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:35.143161 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:35.143161 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:35.150398 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 347/677] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:35.151434 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88890693-761d-4657-a13e-f3f72311ebea None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:35.170081 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:35.220475 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb195e31-361e-4ace-9c30-211b94b3b586 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:35.267580 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad8504-d8e5-415d-a090-ec77f2f84c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:35.268716 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad8504-d8e5-415d-a090-ec77f2f84c8b None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:35.269095 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad8504-d8e5-415d-a090-ec77f2f84c8b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:35.269801 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad8504-d8e5-415d-a090-ec77f2f84c8b None admin] PATH_INFO: `/v3/users/swift` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:35.276173 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88890693-761d-4657-a13e-f3f72311ebea None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:35.278344 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad8504-d8e5-415d-a090-ec77f2f84c8b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:35.280797 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad8504-d8e5-415d-a090-ec77f2f84c8b None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:35.299740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-36ad8504-d8e5-415d-a090-ec77f2f84c8b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 08:32:35.299740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:35.299740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:35.299740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:35.299740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:35.299740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:35.299740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:35.299740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:35.299740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:35.299740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:35.299740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:35.299740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:35.299740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:32:35.299740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:32:35.299740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:32:35.299740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:32:35.300766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:35.300766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:35.300766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:32:35.300766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:35.300766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:32:35.300766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:35.300766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:35.300766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:35.300766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:35.300766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:35.300766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:35.300766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:35.300766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:35.300766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:35.300766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:35.300766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:35.300766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:35.300766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:35.301700 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:35.301700 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:35.301700 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:32:35.301700 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:32:35.301700 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:32:35.301700 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:32:35.301700 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:32:35.301700 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:32:35.301700 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 08:32:35.301700 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:35.304585 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 331/678] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:32:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:35.305783 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad8504-d8e5-415d-a090-ec77f2f84c8b None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:35.326540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557acdb-110d-4277-9633-d81b7ba0ce2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:35.328737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557acdb-110d-4277-9633-d81b7ba0ce2b None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:35.329196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557acdb-110d-4277-9633-d81b7ba0ce2b None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:35.329643 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557acdb-110d-4277-9633-d81b7ba0ce2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:35.330850 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557acdb-110d-4277-9633-d81b7ba0ce2b None admin] RBAC: Adding query filter params (role.id=a0a4f5f9b3264740a55056fed8fd7a33, scope.project.id=be349194440449209f19f6b535ffd4f6, user.id=dd75a24363c14e86b0fbbb782b372646) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:35.331638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557acdb-110d-4277-9633-d81b7ba0ce2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:35.333288 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557acdb-110d-4277-9633-d81b7ba0ce2b None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:35.347647 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 348/679] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:32:35 2022] GET /identity/v3/role_assignments?user.id=dd75a24363c14e86b0fbbb782b372646&scope.project.id=be349194440449209f19f6b535ffd4f6&role.id=a0a4f5f9b3264740a55056fed8fd7a33 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:35.347647 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557acdb-110d-4277-9633-d81b7ba0ce2b None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:35.349404 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:35.516575 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad8504-d8e5-415d-a090-ec77f2f84c8b None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:35.536879 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:35.561961 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557acdb-110d-4277-9633-d81b7ba0ce2b None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:35.568731 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c34082-9dc7-4c85-8d71-8cdfebdc97a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:35.569891 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c34082-9dc7-4c85-8d71-8cdfebdc97a9 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:35.570398 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c34082-9dc7-4c85-8d71-8cdfebdc97a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:35.571040 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c34082-9dc7-4c85-8d71-8cdfebdc97a9 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:35.572063 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c34082-9dc7-4c85-8d71-8cdfebdc97a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:35.572630 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c34082-9dc7-4c85-8d71-8cdfebdc97a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:35.574358 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c34082-9dc7-4c85-8d71-8cdfebdc97a9 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:35.595808 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 332/680] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:35.599942 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c34082-9dc7-4c85-8d71-8cdfebdc97a9 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:35.606087 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11cbd5-fa5d-423f-ba15-590371d35a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:35.606769 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11cbd5-fa5d-423f-ba15-590371d35a5f None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:35.607053 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11cbd5-fa5d-423f-ba15-590371d35a5f None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:35.607456 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11cbd5-fa5d-423f-ba15-590371d35a5f None admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:35.608349 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11cbd5-fa5d-423f-ba15-590371d35a5f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:35.608662 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11cbd5-fa5d-423f-ba15-590371d35a5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:35.610720 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11cbd5-fa5d-423f-ba15-590371d35a5f None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:35.632356 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 349/681] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Jul 25 08:32:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:35.638647 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11cbd5-fa5d-423f-ba15-590371d35a5f None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:35.707271 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:35.721233 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c34082-9dc7-4c85-8d71-8cdfebdc97a9 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:35.750455 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11cbd5-fa5d-423f-ba15-590371d35a5f None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:35.758312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ff3c0-078c-4f95-8433-05d48ba28d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:35.759117 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ff3c0-078c-4f95-8433-05d48ba28d9d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:35.759408 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ff3c0-078c-4f95-8433-05d48ba28d9d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:35.759738 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ff3c0-078c-4f95-8433-05d48ba28d9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:35.767995 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ff3c0-078c-4f95-8433-05d48ba28d9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:35.769381 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ff3c0-078c-4f95-8433-05d48ba28d9d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:35.784992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-e31ff3c0-078c-4f95-8433-05d48ba28d9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:35.784992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:35.784992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:35.784992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:35.784992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:35.784992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:35.784992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:35.784992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:35.784992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:35.784992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:35.784992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:35.784992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:35.784992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:32:35.784992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:32:35.784992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:32:35.785897 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:32:35.785897 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:35.785897 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:35.785897 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:35.785897 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:35.785897 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:35.785897 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:35.785897 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:35.785897 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:35.785897 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:35.785897 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:35.785897 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:35.785897 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:35.785897 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:35.785897 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:35.785897 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:35.785897 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:35.786824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:32:35.786824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:32:35.786824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:32:35.786824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:32:35.786824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:32:35.786824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:32:35.786824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:35.786824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:35.787652 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 333/682] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:32:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:35.792729 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ff3c0-078c-4f95-8433-05d48ba28d9d None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:35.797607 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f9540-db1d-4728-8990-a0a90ab92acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:35.798069 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f9540-db1d-4728-8990-a0a90ab92acf None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:35.798356 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f9540-db1d-4728-8990-a0a90ab92acf None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:35.798626 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f9540-db1d-4728-8990-a0a90ab92acf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:35.831572 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:35.874925 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f9540-db1d-4728-8990-a0a90ab92acf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:35.876556 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f9540-db1d-4728-8990-a0a90ab92acf None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:35.900626 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ff3c0-078c-4f95-8433-05d48ba28d9d None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:35.938876 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f93e12-3a8f-45c8-8206-d618e4428eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:35.939945 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f93e12-3a8f-45c8-8206-d618e4428eb9 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:35.940462 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f93e12-3a8f-45c8-8206-d618e4428eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:35.940943 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f93e12-3a8f-45c8-8206-d618e4428eb9 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:35.941966 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f93e12-3a8f-45c8-8206-d618e4428eb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:35.942501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f93e12-3a8f-45c8-8206-d618e4428eb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:35.944174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f93e12-3a8f-45c8-8206-d618e4428eb9 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:35.961440 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:35.962163 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 334/683] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:32:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:35.963424 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f93e12-3a8f-45c8-8206-d618e4428eb9 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:35.988074 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 350/684] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:32:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:32:36.001667 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f9540-db1d-4728-8990-a0a90ab92acf None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:36.108081 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f9540-db1d-4728-8990-a0a90ab92acf None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:36.130118 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:36.141909 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f93e12-3a8f-45c8-8206-d618e4428eb9 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:36.145663 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99f154-2a03-4c39-b947-27d7799d9544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:36.146578 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99f154-2a03-4c39-b947-27d7799d9544 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:36.146934 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99f154-2a03-4c39-b947-27d7799d9544 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:36.147281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99f154-2a03-4c39-b947-27d7799d9544 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:36.159642 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99f154-2a03-4c39-b947-27d7799d9544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:36.159889 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99f154-2a03-4c39-b947-27d7799d9544 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:36.181117 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-9c99f154-2a03-4c39-b947-27d7799d9544 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:36.181117 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:36.181117 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:36.181117 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:36.181117 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:36.181117 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:36.181117 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:36.181117 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:36.181117 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:36.181117 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:36.181117 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:36.181117 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:36.181117 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:36.181117 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:36.181117 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:36.182072 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:36.182072 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:36.182072 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:36.182072 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:36.182072 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:36.182072 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:36.182072 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:36.182072 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:36.182072 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:36.182072 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:36.182072 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:36.182072 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:36.182072 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:36.182072 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:36.182072 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:36.182072 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:36.182072 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:36.182974 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:36.182974 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:36.182974 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:36.182974 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:36.182974 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 351/685] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:32:36.189073 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99f154-2a03-4c39-b947-27d7799d9544 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:36.205923 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:36.225277 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5eb96-314c-42d4-abf9-d2a44165438b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:36.226338 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5eb96-314c-42d4-abf9-d2a44165438b None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:36.226841 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5eb96-314c-42d4-abf9-d2a44165438b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:36.227398 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5eb96-314c-42d4-abf9-d2a44165438b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:36.228497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5eb96-314c-42d4-abf9-d2a44165438b None admin] RBAC: Adding query filter params (role.id=a0a4f5f9b3264740a55056fed8fd7a33, scope.project.id=be349194440449209f19f6b535ffd4f6, user.id=a08bd52110074f11ba56b2f02397062f) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:36.229041 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5eb96-314c-42d4-abf9-d2a44165438b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:36.230696 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5eb96-314c-42d4-abf9-d2a44165438b None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:36.247945 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 335/686] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:32:35 2022] GET /identity/v3/role_assignments?user.id=a08bd52110074f11ba56b2f02397062f&scope.project.id=be349194440449209f19f6b535ffd4f6&role.id=a0a4f5f9b3264740a55056fed8fd7a33 => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:32:36.300580 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99f154-2a03-4c39-b947-27d7799d9544 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:36.337380 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e323092-4343-47c0-9f84-ffaf16384d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:36.338058 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e323092-4343-47c0-9f84-ffaf16384d2a None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:36.338344 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e323092-4343-47c0-9f84-ffaf16384d2a None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:36.338621 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e323092-4343-47c0-9f84-ffaf16384d2a None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:36.339354 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e323092-4343-47c0-9f84-ffaf16384d2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:36.339688 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e323092-4343-47c0-9f84-ffaf16384d2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:36.341085 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e323092-4343-47c0-9f84-ffaf16384d2a None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:36.346924 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6fbc7-9894-4763-8a8e-593e1b89c8c1 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:36.347231 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6fbc7-9894-4763-8a8e-593e1b89c8c1 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:36.347502 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6fbc7-9894-4763-8a8e-593e1b89c8c1 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:36.349103 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 336/687] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:32:36.354969 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdacd6-b48e-4aef-9aea-af5ea10898b2 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:36.355165 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 352/688] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:32:36.355246 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdacd6-b48e-4aef-9aea-af5ea10898b2 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:36.355538 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdacd6-b48e-4aef-9aea-af5ea10898b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:36.361459 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e323092-4343-47c0-9f84-ffaf16384d2a None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:36.397418 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-eafdacd6-b48e-4aef-9aea-af5ea10898b2 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:36.399250 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-eafdacd6-b48e-4aef-9aea-af5ea10898b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:36.477152 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:36.505994 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e323092-4343-47c0-9f84-ffaf16384d2a None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:36.506680 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 337/689] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:32:36.533986 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdacd6-b48e-4aef-9aea-af5ea10898b2 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:36.544831 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac28943-daf1-4be4-873c-cea9dd3af063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:36.545727 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac28943-daf1-4be4-873c-cea9dd3af063 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:36.546000 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac28943-daf1-4be4-873c-cea9dd3af063 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:36.546281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac28943-daf1-4be4-873c-cea9dd3af063 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:36.555471 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac28943-daf1-4be4-873c-cea9dd3af063 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:36.556816 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac28943-daf1-4be4-873c-cea9dd3af063 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:36.572756 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-8ac28943-daf1-4be4-873c-cea9dd3af063 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:36.572756 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:36.572756 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:36.572756 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:36.572756 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:36.572756 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:36.572756 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:36.572756 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:36.572756 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:36.572756 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:36.572756 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:36.572756 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:36.572756 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:32:36.572756 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:32:36.572756 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:32:36.573734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:32:36.573734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:36.573734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:36.573734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:36.573734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:36.573734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:36.573734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:36.573734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:36.573734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:36.573734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:36.573734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:36.573734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:36.573734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:36.573734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:36.573734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:36.573734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:36.573734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:36.574620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:32:36.574620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:32:36.574620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:32:36.574620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:32:36.574620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:32:36.574620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:32:36.574620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:36.574620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:36.574620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 353/690] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:32:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:32:36.580981 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac28943-daf1-4be4-873c-cea9dd3af063 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:36.639549 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:36.652253 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdacd6-b48e-4aef-9aea-af5ea10898b2 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:36.690355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9a31e-2491-4b07-80b5-dae7a9555d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:36.691497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9a31e-2491-4b07-80b5-dae7a9555d9b None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:36.692127 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9a31e-2491-4b07-80b5-dae7a9555d9b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:36.692622 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9a31e-2491-4b07-80b5-dae7a9555d9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:36.704563 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9a31e-2491-4b07-80b5-dae7a9555d9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:36.704929 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac28943-daf1-4be4-873c-cea9dd3af063 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:36.713850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-96b9a31e-2491-4b07-80b5-dae7a9555d9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:32:36.713850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:36.713850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:36.713850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:36.713850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:36.713850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:36.713850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:36.713850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:36.713850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:36.713850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:36.713850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:36.713850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:36.713850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:36.713850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:36.713850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:36.713850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:36.714775 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:36.714775 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:36.714775 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:36.714775 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:36.714775 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:36.714775 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:36.714775 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:36.714775 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:36.714775 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:36.714775 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:36.714775 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:36.714775 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:36.714775 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:36.714775 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:36.714775 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:36.714775 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:36.715667 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:36.715667 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:36.715667 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:36.715667 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:36.715667 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:36.715667 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:36.715667 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:36.715667 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:36.715667 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:36.715667 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:36.715667 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:32:36.715667 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:36.715667 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 338/691] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:32:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:36.719991 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3a15d-6d44-4e81-9433-6eb09fb4934b None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:36.719991 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3a15d-6d44-4e81-9433-6eb09fb4934b None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:36.719991 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3a15d-6d44-4e81-9433-6eb09fb4934b None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:36.719991 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 339/692] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:36.725291 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3a15d-6d44-4e81-9433-6eb09fb4934b None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:36.752169 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3677c0-058b-489b-9ee5-f2f50ad36582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:36.753334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3677c0-058b-489b-9ee5-f2f50ad36582 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:36.753920 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3677c0-058b-489b-9ee5-f2f50ad36582 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:36.754399 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3677c0-058b-489b-9ee5-f2f50ad36582 None admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:36.755421 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3677c0-058b-489b-9ee5-f2f50ad36582 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:36.756106 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3677c0-058b-489b-9ee5-f2f50ad36582 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:36.757856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3677c0-058b-489b-9ee5-f2f50ad36582 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:36.760043 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:36.773188 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 354/693] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:32:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:32:36.779523 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1021d-5dd6-40c7-8dda-c6db737721d5 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:36.780127 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1021d-5dd6-40c7-8dda-c6db737721d5 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:36.780720 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1021d-5dd6-40c7-8dda-c6db737721d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:36.801994 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-a5a1021d-5dd6-40c7-8dda-c6db737721d5 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:36.803564 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-a5a1021d-5dd6-40c7-8dda-c6db737721d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:36.833619 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3a15d-6d44-4e81-9433-6eb09fb4934b None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:36.877125 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab98a7-d55c-475b-9d9c-058d1be82cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:36.877790 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab98a7-d55c-475b-9d9c-058d1be82cb5 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:36.878145 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab98a7-d55c-475b-9d9c-058d1be82cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:36.878343 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab98a7-d55c-475b-9d9c-058d1be82cb5 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:36.878538 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 355/694] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:32:36.879165 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ab98a7-d55c-475b-9d9c-058d1be82cb5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:36.879480 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ab98a7-d55c-475b-9d9c-058d1be82cb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:36.880062 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1021d-5dd6-40c7-8dda-c6db737721d5 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:36.880884 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ab98a7-d55c-475b-9d9c-058d1be82cb5 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:36.896544 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 340/695] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:32:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:36.900611 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab98a7-d55c-475b-9d9c-058d1be82cb5 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:36.917322 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:37.013046 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1021d-5dd6-40c7-8dda-c6db737721d5 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:37.032536 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab98a7-d55c-475b-9d9c-058d1be82cb5 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:37.046115 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:37.062566 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288318f-854a-41ef-8eed-eb1c66689820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:37.073203 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288318f-854a-41ef-8eed-eb1c66689820 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:37.073203 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288318f-854a-41ef-8eed-eb1c66689820 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:37.073203 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288318f-854a-41ef-8eed-eb1c66689820 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:37.073203 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c288318f-854a-41ef-8eed-eb1c66689820 None admin] RBAC: Adding query filter params (role.id=a0a4f5f9b3264740a55056fed8fd7a33, scope.project.id=be349194440449209f19f6b535ffd4f6, user.id=2763e540681547d3a6677567b3be86ea) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:37.073203 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c288318f-854a-41ef-8eed-eb1c66689820 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:37.073203 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c288318f-854a-41ef-8eed-eb1c66689820 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:37.073622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 356/696] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:32:36 2022] GET /identity/v3/role_assignments?user.id=2763e540681547d3a6677567b3be86ea&scope.project.id=be349194440449209f19f6b535ffd4f6&role.id=a0a4f5f9b3264740a55056fed8fd7a33 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:37.073622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288318f-854a-41ef-8eed-eb1c66689820 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:37.074882 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331c2fd-dfec-41d3-897e-763e6237f7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:37.075951 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331c2fd-dfec-41d3-897e-763e6237f7a6 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:37.076449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331c2fd-dfec-41d3-897e-763e6237f7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:37.076932 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331c2fd-dfec-41d3-897e-763e6237f7a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:37.090189 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331c2fd-dfec-41d3-897e-763e6237f7a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:37.092100 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331c2fd-dfec-41d3-897e-763e6237f7a6 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:37.113204 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-2331c2fd-dfec-41d3-897e-763e6237f7a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:37.113204 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:37.113204 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:37.113204 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:37.113204 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:37.113204 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:37.113204 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:37.113204 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:37.113204 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:37.113204 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:37.113204 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:37.113204 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:37.113204 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:37.113204 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:37.113204 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:37.114173 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:37.114173 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:37.114173 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:37.114173 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:37.114173 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:37.114173 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:37.114173 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:37.114173 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:37.114173 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:37.114173 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:37.114173 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:37.114173 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:37.114173 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:37.114173 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:37.114173 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:37.114173 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:37.114173 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:37.115048 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:37.115048 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:37.115048 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:37.115048 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:37.117513 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 341/697] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:37.123920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331c2fd-dfec-41d3-897e-763e6237f7a6 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:37.244272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:37.293443 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288318f-854a-41ef-8eed-eb1c66689820 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:37.295675 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331c2fd-dfec-41d3-897e-763e6237f7a6 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:37.332627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0de69-a9ce-432a-a40b-1f7cb967f8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:37.333520 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0de69-a9ce-432a-a40b-1f7cb967f8cd None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:37.333893 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0de69-a9ce-432a-a40b-1f7cb967f8cd None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:37.334328 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0de69-a9ce-432a-a40b-1f7cb967f8cd None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:37.335323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0de69-a9ce-432a-a40b-1f7cb967f8cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:37.335722 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0de69-a9ce-432a-a40b-1f7cb967f8cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:37.336778 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af05053-7d75-42ba-bf8c-afae37d8bf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:37.337272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0de69-a9ce-432a-a40b-1f7cb967f8cd None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:37.338267 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af05053-7d75-42ba-bf8c-afae37d8bf96 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:37.338737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af05053-7d75-42ba-bf8c-afae37d8bf96 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:37.339212 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af05053-7d75-42ba-bf8c-afae37d8bf96 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:37.340115 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af05053-7d75-42ba-bf8c-afae37d8bf96 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:37.341674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af05053-7d75-42ba-bf8c-afae37d8bf96 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:37.350596 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 342/698] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:32:37.361719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-3af05053-7d75-42ba-bf8c-afae37d8bf96 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 08:32:37.361719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:37.361719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:32:37.361719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:32:37.361719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:32:37.361719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:32:37.361719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:32:37.361719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:32:37.361719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 08:32:37.361719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:37.361719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:32:37.361719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:37.361719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:37.361719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:37.361719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:37.361719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:37.362737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:37.362737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:37.362737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:37.362737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:37.362737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:37.362737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:37.362737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:37.362737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:32:37.362737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:32:37.362737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:32:37.362737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:32:37.362737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:37.362737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:37.362737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:37.362737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:37.362737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:37.363570 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:37.363570 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:37.363570 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:37.363570 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:37.363570 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:37.363570 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:37.363570 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:37.363570 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:37.363570 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:37.363570 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:37.363570 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:37.363570 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:32:37.363570 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:32:37.363570 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 08:32:37.363570 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:37.364384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0de69-a9ce-432a-a40b-1f7cb967f8cd None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:37.366536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 357/699] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Jul 25 08:32:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:37.373130 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af05053-7d75-42ba-bf8c-afae37d8bf96 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:37.438980 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:37.481220 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0de69-a9ce-432a-a40b-1f7cb967f8cd None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:37.499838 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af05053-7d75-42ba-bf8c-afae37d8bf96 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:37.507207 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:37.520694 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41594c1-fe2e-4ec9-9eab-cef6921e50a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:37.521638 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41594c1-fe2e-4ec9-9eab-cef6921e50a9 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:37.521929 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41594c1-fe2e-4ec9-9eab-cef6921e50a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:37.522209 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41594c1-fe2e-4ec9-9eab-cef6921e50a9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:37.532110 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41594c1-fe2e-4ec9-9eab-cef6921e50a9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:37.533872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41594c1-fe2e-4ec9-9eab-cef6921e50a9 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:37.540406 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753104c9-10dc-4dc6-b538-e4b99f8662ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:37.541077 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753104c9-10dc-4dc6-b538-e4b99f8662ae None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:37.541650 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753104c9-10dc-4dc6-b538-e4b99f8662ae None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:37.541909 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753104c9-10dc-4dc6-b538-e4b99f8662ae None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:37.542621 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753104c9-10dc-4dc6-b538-e4b99f8662ae None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:37.542930 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753104c9-10dc-4dc6-b538-e4b99f8662ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:37.545092 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753104c9-10dc-4dc6-b538-e4b99f8662ae None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:37.549883 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-e41594c1-fe2e-4ec9-9eab-cef6921e50a9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:32:37.549883 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:37.549883 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:37.549883 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:37.549883 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:37.549883 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:37.549883 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:37.549883 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:37.549883 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:37.549883 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:37.549883 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:37.549883 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:37.549883 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:32:37.549883 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:32:37.549883 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:32:37.549883 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:32:37.551142 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:37.551142 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:37.551142 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:32:37.551142 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:37.551142 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:32:37.551142 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:37.551142 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:37.551142 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:37.551142 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:37.551142 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:37.551142 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:37.551142 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:37.551142 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:37.551142 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:37.551142 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:37.551142 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:37.551142 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:37.551142 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:37.552105 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:37.552105 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:37.552105 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:32:37.552105 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:32:37.552105 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:32:37.552105 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:32:37.552105 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:32:37.552105 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:32:37.552105 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:32:37.552105 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:37.552105 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 343/700] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Jul 25 08:32:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:37.554452 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 358/701] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Jul 25 08:32:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:32:37.555341 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41594c1-fe2e-4ec9-9eab-cef6921e50a9 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:37.564642 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753104c9-10dc-4dc6-b538-e4b99f8662ae None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:37.683101 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753104c9-10dc-4dc6-b538-e4b99f8662ae None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:37.684110 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41594c1-fe2e-4ec9-9eab-cef6921e50a9 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:37.719042 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:37.740093 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c022616-b794-4d88-9d1d-b80e95c2667d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:37.740768 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c022616-b794-4d88-9d1d-b80e95c2667d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:37.741060 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c022616-b794-4d88-9d1d-b80e95c2667d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:37.741342 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c022616-b794-4d88-9d1d-b80e95c2667d None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:37.742075 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c022616-b794-4d88-9d1d-b80e95c2667d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:37.742388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c022616-b794-4d88-9d1d-b80e95c2667d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:37.743791 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c022616-b794-4d88-9d1d-b80e95c2667d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:37.747642 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1b9c8-9d63-4d3f-a185-27e804b944d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:37.748605 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1b9c8-9d63-4d3f-a185-27e804b944d4 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:37.748886 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1b9c8-9d63-4d3f-a185-27e804b944d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:37.749158 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1b9c8-9d63-4d3f-a185-27e804b944d4 None admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:37.750862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 344/702] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Jul 25 08:32:37 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:37.759918 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1b9c8-9d63-4d3f-a185-27e804b944d4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:37.760364 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1b9c8-9d63-4d3f-a185-27e804b944d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:37.761885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1b9c8-9d63-4d3f-a185-27e804b944d4 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:37.801531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 359/703] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Jul 25 08:32:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:37.807329 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c022616-b794-4d88-9d1d-b80e95c2667d None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:37.880004 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:37.957187 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c022616-b794-4d88-9d1d-b80e95c2667d None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:37.992651 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba06284-472d-4a8d-a928-e90ec234c934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:37.993305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba06284-472d-4a8d-a928-e90ec234c934 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:37.993590 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba06284-472d-4a8d-a928-e90ec234c934 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:37.993870 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba06284-472d-4a8d-a928-e90ec234c934 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:38.071498 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba06284-472d-4a8d-a928-e90ec234c934 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:38.073023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba06284-472d-4a8d-a928-e90ec234c934 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:38.133737 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:38.164790 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5388e4-262b-4308-b2f0-d68f0bf3fd12 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:38.165100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5388e4-262b-4308-b2f0-d68f0bf3fd12 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:38.165360 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5388e4-262b-4308-b2f0-d68f0bf3fd12 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:38.168011 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 360/704] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:32:38.172802 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b35d3-7f98-45c5-a2d6-80a0a7d98db3 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:38.173090 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b35d3-7f98-45c5-a2d6-80a0a7d98db3 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:38.173370 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b35d3-7f98-45c5-a2d6-80a0a7d98db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:38.193733 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-d85b35d3-7f98-45c5-a2d6-80a0a7d98db3 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:38.195254 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-d85b35d3-7f98-45c5-a2d6-80a0a7d98db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:38.207496 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 345/705] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:32:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:32:38.215071 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba06284-472d-4a8d-a928-e90ec234c934 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:38.330382 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 361/706] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:32:38.372928 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b35d3-7f98-45c5-a2d6-80a0a7d98db3 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:38.384931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba06284-472d-4a8d-a928-e90ec234c934 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:38.425908 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479db84-4b53-4aa2-b320-0f7f79fe1588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:38.427540 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479db84-4b53-4aa2-b320-0f7f79fe1588 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:38.428103 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479db84-4b53-4aa2-b320-0f7f79fe1588 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:38.428530 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479db84-4b53-4aa2-b320-0f7f79fe1588 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:38.443362 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479db84-4b53-4aa2-b320-0f7f79fe1588 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:38.445493 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479db84-4b53-4aa2-b320-0f7f79fe1588 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:38.455296 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:38.467988 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-c479db84-4b53-4aa2-b320-0f7f79fe1588 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:38.467988 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:38.467988 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:38.467988 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:38.467988 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:38.467988 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:38.467988 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:38.467988 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:38.467988 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:38.467988 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:38.467988 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:38.467988 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:38.467988 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:38.467988 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:38.467988 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:38.469092 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:38.469092 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:38.469092 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:38.469092 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:38.469092 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:38.469092 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:38.469092 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:38.469092 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:38.469092 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:38.469092 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:38.469092 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:38.469092 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:38.469092 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:38.469092 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:38.469092 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:38.469092 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:38.469092 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:38.469976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:38.469976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:38.469976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:38.469976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:38.472221 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 346/707] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:38.478233 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479db84-4b53-4aa2-b320-0f7f79fe1588 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:38.603881 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479db84-4b53-4aa2-b320-0f7f79fe1588 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:38.629589 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b35d3-7f98-45c5-a2d6-80a0a7d98db3 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:38.637795 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:38.658323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664548b-5507-46ac-9be7-af680465c92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:38.659632 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664548b-5507-46ac-9be7-af680465c92b None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:38.660183 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664548b-5507-46ac-9be7-af680465c92b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:38.660644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664548b-5507-46ac-9be7-af680465c92b None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:38.661566 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664548b-5507-46ac-9be7-af680465c92b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:38.662121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664548b-5507-46ac-9be7-af680465c92b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:38.664725 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664548b-5507-46ac-9be7-af680465c92b None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:38.693106 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 347/708] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:38.702181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664548b-5507-46ac-9be7-af680465c92b None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:38.729201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898af9a-2f0f-4e3a-a8ef-88889bdded95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:38.730381 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898af9a-2f0f-4e3a-a8ef-88889bdded95 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:38.730845 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898af9a-2f0f-4e3a-a8ef-88889bdded95 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:38.731358 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898af9a-2f0f-4e3a-a8ef-88889bdded95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:38.764651 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898af9a-2f0f-4e3a-a8ef-88889bdded95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:38.766706 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898af9a-2f0f-4e3a-a8ef-88889bdded95 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:38.803660 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:38.807595 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-9898af9a-2f0f-4e3a-a8ef-88889bdded95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:38.807595 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:38.807595 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:38.807595 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:38.807595 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:38.807595 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:38.807595 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:38.807595 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:38.807595 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:38.807595 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:38.807595 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:38.807595 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:38.807595 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:38.807595 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:38.807595 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:38.808569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:38.808569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:38.808569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:38.808569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:38.808569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:38.808569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:38.808569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:38.808569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:38.808569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:38.808569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:38.808569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:38.808569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:38.808569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:38.808569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:38.808569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:38.808569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:38.808569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:38.809494 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:38.809494 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:38.809494 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:38.809494 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:38.815006 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 362/709] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 437 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:32:38.822843 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898af9a-2f0f-4e3a-a8ef-88889bdded95 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:38.882459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664548b-5507-46ac-9be7-af680465c92b None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:38.918904 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978298e-9b10-4a0e-a1cd-6806e978440d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:38.919326 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898af9a-2f0f-4e3a-a8ef-88889bdded95 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:38.920377 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978298e-9b10-4a0e-a1cd-6806e978440d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:38.921123 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978298e-9b10-4a0e-a1cd-6806e978440d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:38.923018 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978298e-9b10-4a0e-a1cd-6806e978440d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:38.932028 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b978298e-9b10-4a0e-a1cd-6806e978440d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:38.934427 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b978298e-9b10-4a0e-a1cd-6806e978440d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:38.955160 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0aa305-0c1e-40fe-a8e5-ce468185e674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:38.955851 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0aa305-0c1e-40fe-a8e5-ce468185e674 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:38.956135 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0aa305-0c1e-40fe-a8e5-ce468185e674 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:38.956416 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0aa305-0c1e-40fe-a8e5-ce468185e674 None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:38.956535 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-b978298e-9b10-4a0e-a1cd-6806e978440d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:38.956535 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:38.956535 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:38.956535 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:38.956535 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:38.956535 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:38.956535 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:38.956535 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:38.956535 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:38.956535 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:38.956535 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:38.956535 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:38.956535 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:32:38.956535 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:32:38.956535 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:32:38.957414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:32:38.957414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:38.957414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:38.957414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:38.957414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:38.957414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:38.957414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:38.957414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:38.957414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:38.957414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:38.957414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:38.957414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:38.957414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:38.957414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:38.957414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:38.957414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:38.957414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:38.958401 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:32:38.958401 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:32:38.958401 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:32:38.958401 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:32:38.958401 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:32:38.958401 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:32:38.958401 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:38.958401 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:38.958829 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0aa305-0c1e-40fe-a8e5-ce468185e674 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:38.958829 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0aa305-0c1e-40fe-a8e5-ce468185e674 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:38.958829 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0aa305-0c1e-40fe-a8e5-ce468185e674 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:38.961950 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 348/710] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:32:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:38.963397 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d207f-1a60-45e6-81c5-a175f3e47474 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:38.963922 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d207f-1a60-45e6-81c5-a175f3e47474 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:38.964676 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d207f-1a60-45e6-81c5-a175f3e47474 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:38.972035 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 349/711] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:38.972497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d207f-1a60-45e6-81c5-a175f3e47474 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:38.980156 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 363/712] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:38.981790 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78ec75-219b-46f4-9e15-43a0919157bb None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:38.982288 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78ec75-219b-46f4-9e15-43a0919157bb None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:38.982778 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78ec75-219b-46f4-9e15-43a0919157bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:39.010278 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-8f78ec75-219b-46f4-9e15-43a0919157bb None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:39.012077 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-8f78ec75-219b-46f4-9e15-43a0919157bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:39.026473 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:39.098237 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d207f-1a60-45e6-81c5-a175f3e47474 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:39.107677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 364/713] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:32:39.107677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78ec75-219b-46f4-9e15-43a0919157bb None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:39.136072 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:39.157362 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda175d-ed07-4206-a820-65855bea8ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:39.158654 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda175d-ed07-4206-a820-65855bea8ffd None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:39.159154 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda175d-ed07-4206-a820-65855bea8ffd None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:39.159958 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda175d-ed07-4206-a820-65855bea8ffd None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:39.161920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda175d-ed07-4206-a820-65855bea8ffd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:39.162462 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda175d-ed07-4206-a820-65855bea8ffd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:39.164145 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda175d-ed07-4206-a820-65855bea8ffd None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:39.186580 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 350/714] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:32:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:39.186580 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda175d-ed07-4206-a820-65855bea8ffd None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:39.238018 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78ec75-219b-46f4-9e15-43a0919157bb None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:39.274185 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027abf59-fbe7-4508-999d-4f3fa30cf8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:39.275235 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027abf59-fbe7-4508-999d-4f3fa30cf8cb None admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:39.275805 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027abf59-fbe7-4508-999d-4f3fa30cf8cb None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:39.276309 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027abf59-fbe7-4508-999d-4f3fa30cf8cb None admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:39.277218 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027abf59-fbe7-4508-999d-4f3fa30cf8cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:39.278870 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027abf59-fbe7-4508-999d-4f3fa30cf8cb None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:39.295577 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda175d-ed07-4206-a820-65855bea8ffd None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:39.331579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ab132-b174-45de-9988-a09d3a006ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:39.332468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ab132-b174-45de-9988-a09d3a006ac7 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:39.332861 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ab132-b174-45de-9988-a09d3a006ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:39.333144 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ab132-b174-45de-9988-a09d3a006ac7 None admin] PATH_INFO: `/v3/services/network` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:39.333918 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ab132-b174-45de-9988-a09d3a006ac7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:39.335413 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ab132-b174-45de-9988-a09d3a006ac7 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:39.350754 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-a44ab132-b174-45de-9988-a09d3a006ac7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 08:32:39.350754 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:39.350754 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:32:39.350754 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:32:39.350754 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:32:39.350754 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:32:39.350754 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:32:39.350754 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:32:39.350754 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 08:32:39.350754 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:39.350754 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:32:39.350754 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:39.350754 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:39.350754 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:39.350754 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:39.350754 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:39.350754 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:39.352062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:39.352062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:39.352062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:39.352062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:39.352062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:39.352062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:39.352062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:32:39.352062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:32:39.352062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:32:39.352062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:32:39.352062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:39.352062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:39.352062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:39.352062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:39.352062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:39.352062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:39.352912 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:39.352912 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:39.352912 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:39.352912 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:39.352912 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:39.352912 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:39.352912 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:39.352912 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:39.352912 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:39.352912 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:39.352912 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:32:39.352912 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:32:39.352912 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 08:32:39.352912 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:39.354200 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 351/715] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:32:39 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:39.355211 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ab132-b174-45de-9988-a09d3a006ac7 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:39.370094 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 365/716] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jul 25 08:32:39 2022] POST /identity/v3/users => generated 254 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:32:39.371249 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027abf59-fbe7-4508-999d-4f3fa30cf8cb None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:39.374434 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:39.456652 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:39.554504 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ab132-b174-45de-9988-a09d3a006ac7 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:39.593581 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027abf59-fbe7-4508-999d-4f3fa30cf8cb None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:39.600368 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2aada-c7b7-4db5-bed6-f051387a1632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:39.607777 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2aada-c7b7-4db5-bed6-f051387a1632 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:39.607777 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2aada-c7b7-4db5-bed6-f051387a1632 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:39.607777 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2aada-c7b7-4db5-bed6-f051387a1632 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:39.607777 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2aada-c7b7-4db5-bed6-f051387a1632 None admin] RBAC: Adding query filter params (role.id=25b0f48c10474bf6b98aad8f093868ee, scope.project.id=be349194440449209f19f6b535ffd4f6, user.id=1c1a08d3a76643a9996dc0daa8714ac6) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:39.607777 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2aada-c7b7-4db5-bed6-f051387a1632 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:39.607777 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2aada-c7b7-4db5-bed6-f051387a1632 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:39.619762 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 352/717] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:32:39 2022] GET /identity/v3/role_assignments?user.id=1c1a08d3a76643a9996dc0daa8714ac6&scope.project.id=be349194440449209f19f6b535ffd4f6&role.id=25b0f48c10474bf6b98aad8f093868ee => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:39.635308 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aadfb2b-5e89-40cc-9461-f9a27c01f760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:39.636117 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadfb2b-5e89-40cc-9461-f9a27c01f760 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:39.636406 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadfb2b-5e89-40cc-9461-f9a27c01f760 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:39.636682 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadfb2b-5e89-40cc-9461-f9a27c01f760 None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:39.637574 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aadfb2b-5e89-40cc-9461-f9a27c01f760 None admin] RBAC: Adding query filter params (name=network) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:39.637883 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aadfb2b-5e89-40cc-9461-f9a27c01f760 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:39.639313 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aadfb2b-5e89-40cc-9461-f9a27c01f760 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:39.645822 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 366/718] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jul 25 08:32:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:39.651503 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2aada-c7b7-4db5-bed6-f051387a1632 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:39.774277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeedca1-782e-4124-83f3-6677ba6737d1 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:39.774628 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeedca1-782e-4124-83f3-6677ba6737d1 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:39.774838 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeedca1-782e-4124-83f3-6677ba6737d1 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:39.777306 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 367/719] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:32:39.781375 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2aada-c7b7-4db5-bed6-f051387a1632 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:39.782074 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a925e0b-792c-4a09-983a-026af7f5cffe None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:39.782372 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a925e0b-792c-4a09-983a-026af7f5cffe None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:39.782656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a925e0b-792c-4a09-983a-026af7f5cffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:39.790232 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:39.809593 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-1a925e0b-792c-4a09-983a-026af7f5cffe None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:39.810809 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-1a925e0b-792c-4a09-983a-026af7f5cffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:39.818471 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42e824-fa4d-4d3d-a772-81bc7830388b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:39.819143 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42e824-fa4d-4d3d-a772-81bc7830388b None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:39.819424 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42e824-fa4d-4d3d-a772-81bc7830388b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:39.819738 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42e824-fa4d-4d3d-a772-81bc7830388b None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:39.820458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42e824-fa4d-4d3d-a772-81bc7830388b None admin] RBAC: Adding query filter params (type=network) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:39.820759 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42e824-fa4d-4d3d-a772-81bc7830388b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:39.822124 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42e824-fa4d-4d3d-a772-81bc7830388b None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:39.826828 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 353/720] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jul 25 08:32:39 2022] GET /identity/v3/services?type=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:39.906741 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:39.922621 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 368/721] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:32:39.965064 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42e824-fa4d-4d3d-a772-81bc7830388b None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:40.101019 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a7fb1-4a20-49fd-98c9-dee5cacd75ad None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:40.101346 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a7fb1-4a20-49fd-98c9-dee5cacd75ad None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:40.101554 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a7fb1-4a20-49fd-98c9-dee5cacd75ad None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:40.103161 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 369/722] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:40.107988 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037583fe-4f47-4f62-9734-2326ed356c6c None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:40.108275 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037583fe-4f47-4f62-9734-2326ed356c6c None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:40.108555 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037583fe-4f47-4f62-9734-2326ed356c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:40.112633 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42e824-fa4d-4d3d-a772-81bc7830388b None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:40.135080 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-037583fe-4f47-4f62-9734-2326ed356c6c None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:40.136302 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-037583fe-4f47-4f62-9734-2326ed356c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:40.176711 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf03e2-4b53-40b8-9409-e9fc8d3839e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:40.177508 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf03e2-4b53-40b8-9409-e9fc8d3839e5 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:40.177789 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf03e2-4b53-40b8-9409-e9fc8d3839e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:40.178066 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf03e2-4b53-40b8-9409-e9fc8d3839e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:40.196896 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf03e2-4b53-40b8-9409-e9fc8d3839e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:40.206869 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-0ecf03e2-4b53-40b8-9409-e9fc8d3839e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:32:40.206869 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:40.206869 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:40.206869 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:40.206869 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:40.206869 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:40.206869 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:40.206869 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:40.206869 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:40.206869 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:40.206869 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:40.206869 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:40.206869 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:40.206869 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:40.206869 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:40.206869 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:40.207813 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:40.207813 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:40.207813 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:40.207813 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:40.207813 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:40.207813 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:40.207813 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:40.207813 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:40.207813 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:40.207813 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:40.207813 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:40.207813 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:40.207813 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:40.207813 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:40.207813 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:40.207813 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:40.208650 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:40.208650 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:40.208650 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:40.208650 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:40.208650 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:40.208650 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:40.208650 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:40.208650 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:40.208650 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:40.208650 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:40.208650 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:32:40.208650 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:40.209603 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 354/723] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:32:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:40.217735 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf03e2-4b53-40b8-9409-e9fc8d3839e5 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:40.257082 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:40.277006 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 370/724] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 08:32:40.320184 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037583fe-4f47-4f62-9734-2326ed356c6c None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:40.358741 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf03e2-4b53-40b8-9409-e9fc8d3839e5 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:40.394566 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d00914-88cc-40cb-8c12-e8b96d6f91a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:40.395294 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d00914-88cc-40cb-8c12-e8b96d6f91a9 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:40.395579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d00914-88cc-40cb-8c12-e8b96d6f91a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:40.395884 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d00914-88cc-40cb-8c12-e8b96d6f91a9 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:40.399632 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d00914-88cc-40cb-8c12-e8b96d6f91a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:40.399632 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d00914-88cc-40cb-8c12-e8b96d6f91a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:40.399632 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d00914-88cc-40cb-8c12-e8b96d6f91a9 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:40.407805 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 355/725] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:32:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:40.414431 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d00914-88cc-40cb-8c12-e8b96d6f91a9 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:40.539320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037583fe-4f47-4f62-9734-2326ed356c6c None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:40.593109 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:40.596371 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:40.607261 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d00914-88cc-40cb-8c12-e8b96d6f91a9 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:40.616174 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b22ab-ae1f-4636-81bf-9cd6c3dacaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:40.616844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b22ab-ae1f-4636-81bf-9cd6c3dacaba None admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:40.617126 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b22ab-ae1f-4636-81bf-9cd6c3dacaba None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:40.617397 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b22ab-ae1f-4636-81bf-9cd6c3dacaba None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:40.618124 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b22ab-ae1f-4636-81bf-9cd6c3dacaba None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:40.619564 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b22ab-ae1f-4636-81bf-9cd6c3dacaba None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:40.653750 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74c8c0-a186-4e6a-861a-6cecf99d75b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:40.654680 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74c8c0-a186-4e6a-861a-6cecf99d75b8 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:40.654988 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74c8c0-a186-4e6a-861a-6cecf99d75b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:40.655260 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74c8c0-a186-4e6a-861a-6cecf99d75b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:40.667448 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74c8c0-a186-4e6a-861a-6cecf99d75b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:40.669109 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74c8c0-a186-4e6a-861a-6cecf99d75b8 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:40.686847 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-df74c8c0-a186-4e6a-861a-6cecf99d75b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:40.686847 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:40.686847 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:40.686847 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:40.686847 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:40.686847 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:40.686847 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:40.686847 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:40.686847 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:40.686847 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:40.686847 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:40.686847 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:40.686847 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:40.686847 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:40.686847 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:40.692172 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:40.692172 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:40.692172 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:40.692172 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:40.692172 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:40.692172 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:40.692172 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:40.692172 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:40.692172 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:40.692172 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:40.692172 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:40.692172 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:40.692172 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:40.692172 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:40.692172 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:40.692172 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:40.692172 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:40.693310 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:40.693310 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:40.693310 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:40.693310 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:40.693310 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 356/726] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:40.699910 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74c8c0-a186-4e6a-861a-6cecf99d75b8 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:40.719062 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 371/727] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jul 25 08:32:40 2022] POST /identity/v3/services => generated 251 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:32:40.835227 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74c8c0-a186-4e6a-861a-6cecf99d75b8 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:40.893015 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23283a4-7231-493b-9313-3b75671fca54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:40.893964 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23283a4-7231-493b-9313-3b75671fca54 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:40.894397 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23283a4-7231-493b-9313-3b75671fca54 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:40.894817 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23283a4-7231-493b-9313-3b75671fca54 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:40.895716 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23283a4-7231-493b-9313-3b75671fca54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:40.896190 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23283a4-7231-493b-9313-3b75671fca54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:40.897707 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23283a4-7231-493b-9313-3b75671fca54 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:40.912105 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:40.914536 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 357/728] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:40.919959 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b22ab-ae1f-4636-81bf-9cd6c3dacaba None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:41.060686 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b22ab-ae1f-4636-81bf-9cd6c3dacaba None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:41.100605 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76598de0-6d3b-4f5d-bed8-0ffd1d5b6c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:41.101329 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76598de0-6d3b-4f5d-bed8-0ffd1d5b6c9a None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:41.101611 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76598de0-6d3b-4f5d-bed8-0ffd1d5b6c9a None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:41.101889 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76598de0-6d3b-4f5d-bed8-0ffd1d5b6c9a None admin] PATH_INFO: `/v3/users/swift` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:41.109870 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76598de0-6d3b-4f5d-bed8-0ffd1d5b6c9a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:41.111309 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76598de0-6d3b-4f5d-bed8-0ffd1d5b6c9a None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:41.125524 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-76598de0-6d3b-4f5d-bed8-0ffd1d5b6c9a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 08:32:41.125524 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:41.125524 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:41.125524 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:41.125524 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:41.125524 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:41.125524 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:41.125524 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:41.125524 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:41.125524 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:41.125524 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:41.125524 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:41.125524 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:32:41.125524 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:32:41.125524 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:32:41.125524 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:32:41.126457 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:41.126457 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:41.126457 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:32:41.126457 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:41.126457 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:32:41.126457 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:41.126457 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:41.126457 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:41.126457 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:41.126457 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:41.126457 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:41.126457 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:41.126457 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:41.126457 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:41.126457 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:41.126457 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:41.126457 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:41.126457 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:41.127373 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:41.127373 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:41.127373 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:32:41.127373 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:32:41.127373 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:32:41.127373 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:32:41.127373 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:32:41.127373 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:32:41.127373 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 08:32:41.127373 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:41.127373 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 372/729] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:32:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:41.132395 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23283a4-7231-493b-9313-3b75671fca54 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:41.241826 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23283a4-7231-493b-9313-3b75671fca54 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:41.276231 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5dc285-091d-496b-8bc4-ac5d0d9740ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:41.276899 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5dc285-091d-496b-8bc4-ac5d0d9740ae None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:41.277183 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5dc285-091d-496b-8bc4-ac5d0d9740ae None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:41.277459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5dc285-091d-496b-8bc4-ac5d0d9740ae None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:41.278357 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5dc285-091d-496b-8bc4-ac5d0d9740ae None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:41.278672 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5dc285-091d-496b-8bc4-ac5d0d9740ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:41.280158 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5dc285-091d-496b-8bc4-ac5d0d9740ae None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:41.299642 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 358/730] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Jul 25 08:32:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:41.305268 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76598de0-6d3b-4f5d-bed8-0ffd1d5b6c9a None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:41.384157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:41.444538 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76598de0-6d3b-4f5d-bed8-0ffd1d5b6c9a None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:41.496679 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7bd1e-4496-4549-bd15-27a5c428d997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:41.497722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7bd1e-4496-4549-bd15-27a5c428d997 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:41.498213 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7bd1e-4496-4549-bd15-27a5c428d997 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:41.498712 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7bd1e-4496-4549-bd15-27a5c428d997 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:41.599501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7bd1e-4496-4549-bd15-27a5c428d997 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:41.601795 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7bd1e-4496-4549-bd15-27a5c428d997 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:41.668757 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:41.737799 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 373/731] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:32:41 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 08:32:41.748914 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5dc285-091d-496b-8bc4-ac5d0d9740ae None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:41.830442 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:41.881613 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5dc285-091d-496b-8bc4-ac5d0d9740ae None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:41.917666 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b9971-c13a-48a1-a521-51f0883e66c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:41.918468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b9971-c13a-48a1-a521-51f0883e66c9 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:41.918751 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b9971-c13a-48a1-a521-51f0883e66c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:41.919079 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b9971-c13a-48a1-a521-51f0883e66c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:41.930171 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b9971-c13a-48a1-a521-51f0883e66c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:41.931641 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b9971-c13a-48a1-a521-51f0883e66c9 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:41.949523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-479b9971-c13a-48a1-a521-51f0883e66c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:41.949523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:41.949523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:41.949523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:41.949523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:41.949523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:41.949523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:41.949523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:41.949523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:41.949523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:41.949523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:41.949523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:41.949523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:41.949523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:41.949523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:41.950439 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:41.950439 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:41.950439 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:41.950439 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:41.950439 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:41.950439 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:41.950439 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:41.950439 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:41.950439 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:41.950439 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:41.950439 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:41.950439 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:41.950439 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:41.950439 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:41.950439 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:41.950439 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:41.950439 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:41.952312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:41.952312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:41.952312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:41.952312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:41.952312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 359/732] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:41.960782 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7bd1e-4496-4549-bd15-27a5c428d997 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:42.035770 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b85142-9f29-40a1-8c64-bde3972d5e90 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:42.036100 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b85142-9f29-40a1-8c64-bde3972d5e90 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:42.036333 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b85142-9f29-40a1-8c64-bde3972d5e90 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:42.037992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 360/733] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:42.045840 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f8561-9ab6-4d2c-83c2-2b297e16b025 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:42.046135 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f8561-9ab6-4d2c-83c2-2b297e16b025 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:42.047027 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f8561-9ab6-4d2c-83c2-2b297e16b025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:42.084242 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-7c6f8561-9ab6-4d2c-83c2-2b297e16b025 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:42.085457 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-7c6f8561-9ab6-4d2c-83c2-2b297e16b025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:42.131261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7bd1e-4496-4549-bd15-27a5c428d997 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:42.181347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eeddea-d5e4-425f-bd83-c738efd2cb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:42.181945 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eeddea-d5e4-425f-bd83-c738efd2cb54 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:42.182231 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eeddea-d5e4-425f-bd83-c738efd2cb54 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:42.182508 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eeddea-d5e4-425f-bd83-c738efd2cb54 None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:42.183246 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eeddea-d5e4-425f-bd83-c738efd2cb54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:42.183555 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eeddea-d5e4-425f-bd83-c738efd2cb54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:42.185068 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eeddea-d5e4-425f-bd83-c738efd2cb54 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:42.198982 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 374/734] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:42.204586 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ceca35-0a7a-43e8-8d3a-1747951c8396 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:42.204876 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ceca35-0a7a-43e8-8d3a-1747951c8396 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:42.205161 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ceca35-0a7a-43e8-8d3a-1747951c8396 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:42.210789 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 375/735] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:42.210789 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ceca35-0a7a-43e8-8d3a-1747951c8396 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:42.217022 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 361/736] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:42 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:32:42.218698 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12368d9d-f50a-462b-8616-462361d25256 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:42.219322 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12368d9d-f50a-462b-8616-462361d25256 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:42.219843 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12368d9d-f50a-462b-8616-462361d25256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:42.221389 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:42.245336 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-12368d9d-f50a-462b-8616-462361d25256 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:42.247265 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-12368d9d-f50a-462b-8616-462361d25256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:42.285146 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:42.319413 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 362/737] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:42 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:32:42.320808 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aeef55-a57b-49dd-b9d0-d425b514f8b0 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:42.321155 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aeef55-a57b-49dd-b9d0-d425b514f8b0 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:42.321436 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aeef55-a57b-49dd-b9d0-d425b514f8b0 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:42.326780 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 363/738] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:42.326780 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aeef55-a57b-49dd-b9d0-d425b514f8b0 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:42.336477 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ceca35-0a7a-43e8-8d3a-1747951c8396 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:42.374218 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200af0aa-818e-4b27-8415-4aaf0c93f617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:42.375988 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200af0aa-818e-4b27-8415-4aaf0c93f617 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:42.376360 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200af0aa-818e-4b27-8415-4aaf0c93f617 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:42.376697 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200af0aa-818e-4b27-8415-4aaf0c93f617 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:42.383439 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200af0aa-818e-4b27-8415-4aaf0c93f617 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:42.385000 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200af0aa-818e-4b27-8415-4aaf0c93f617 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:42.400100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-200af0aa-818e-4b27-8415-4aaf0c93f617 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:42.400100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:42.400100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:42.400100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:42.400100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:42.400100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:42.400100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:42.400100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:42.400100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:42.400100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:42.400100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:42.400100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:42.400100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:32:42.400100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:32:42.400100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:32:42.401017 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:32:42.401017 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:42.401017 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:42.401017 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:42.401017 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:42.401017 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:42.401017 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:42.401017 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:42.401017 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:42.401017 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:42.401017 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:42.401017 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:42.401017 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:42.401017 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:42.401017 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:42.401017 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:42.401017 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:42.401914 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:32:42.401914 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:32:42.401914 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:32:42.401914 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:32:42.401914 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:32:42.401914 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:32:42.401914 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:42.401914 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:42.401914 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 376/739] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:32:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:42.402407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cb57a-2ccb-458e-b82d-178be85151b0 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:42.403013 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cb57a-2ccb-458e-b82d-178be85151b0 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:42.403114 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cb57a-2ccb-458e-b82d-178be85151b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:42.421137 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-422cb57a-2ccb-458e-b82d-178be85151b0 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:42.422671 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-422cb57a-2ccb-458e-b82d-178be85151b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:42.442613 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aeef55-a57b-49dd-b9d0-d425b514f8b0 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:42.480263 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600fbe48-5907-4253-839f-8477fd386a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:42.481058 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fbe48-5907-4253-839f-8477fd386a72 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:42.481347 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fbe48-5907-4253-839f-8477fd386a72 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:42.481630 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fbe48-5907-4253-839f-8477fd386a72 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:42.487904 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:42.494259 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600fbe48-5907-4253-839f-8477fd386a72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:42.495256 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 377/740] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:42 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 08:32:42.500519 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422cb57a-2ccb-458e-b82d-178be85151b0 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:42.502651 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-600fbe48-5907-4253-839f-8477fd386a72 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:42.502651 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:42.502651 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:42.502651 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:42.502651 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:42.502651 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:42.502651 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:42.502651 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:42.502651 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:42.502651 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:42.502651 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:42.502651 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:42.502651 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:42.502651 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:42.502651 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:42.502651 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:42.503644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:42.503644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:42.503644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:42.503644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:42.503644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:42.503644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:42.503644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:42.503644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:42.503644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:42.503644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:42.503644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:42.503644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:42.503644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:42.503644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:42.503644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:42.503644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:42.504522 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:42.504522 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:42.504522 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:42.504522 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:42.504522 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:42.504522 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:42.504522 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:42.504522 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:42.504522 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:42.504522 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:42.504522 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:42.504522 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:42.504522 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 364/741] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 08:32:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:42.505211 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600fbe48-5907-4253-839f-8477fd386a72 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:42.539871 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:42.618043 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600fbe48-5907-4253-839f-8477fd386a72 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:42.618803 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422cb57a-2ccb-458e-b82d-178be85151b0 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:42.682784 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54f163-c637-41e7-a4c5-fe390840df4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:42.683575 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54f163-c637-41e7-a4c5-fe390840df4b None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:42.683887 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54f163-c637-41e7-a4c5-fe390840df4b None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:42.684202 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54f163-c637-41e7-a4c5-fe390840df4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:42.685315 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7ca0f-c4e0-484c-8771-fa7ab7f68aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:42.686126 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7ca0f-c4e0-484c-8771-fa7ab7f68aed None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:42.686410 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7ca0f-c4e0-484c-8771-fa7ab7f68aed None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:42.687031 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7ca0f-c4e0-484c-8771-fa7ab7f68aed None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:42.688370 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7ca0f-c4e0-484c-8771-fa7ab7f68aed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:42.688664 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7ca0f-c4e0-484c-8771-fa7ab7f68aed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:42.690413 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7ca0f-c4e0-484c-8771-fa7ab7f68aed None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:42.697401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54f163-c637-41e7-a4c5-fe390840df4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:42.702407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-df54f163-c637-41e7-a4c5-fe390840df4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:32:42.702407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:42.702407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:42.702407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:42.702407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:42.702407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:42.702407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:42.702407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:42.702407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:42.702407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:42.702407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:42.702407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:42.702407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:42.702407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:42.702407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:42.702407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:42.703323 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:42.703323 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:42.703323 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:42.703323 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:42.703323 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:42.703323 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:42.703323 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:42.703323 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:42.703323 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:42.703323 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:42.703323 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:42.703323 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:42.703323 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:42.703323 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:42.703323 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:42.703323 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:42.704190 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:42.704190 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:42.704190 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:42.704190 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:42.704190 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:42.704190 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:42.704190 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:42.704190 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:42.704190 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:42.704190 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:42.704190 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:32:42.704190 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:42.704190 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 378/742] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:32:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:42.705345 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54f163-c637-41e7-a4c5-fe390840df4b None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:42.707752 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 365/743] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:32:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:42.708751 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7ca0f-c4e0-484c-8771-fa7ab7f68aed None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:42.770016 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:42.802475 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:42.814390 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7ca0f-c4e0-484c-8771-fa7ab7f68aed None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:42.816694 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54f163-c637-41e7-a4c5-fe390840df4b None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:42.850630 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c35544-62fe-43ba-a5d4-e5d7c9e81e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:42.851144 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b715d84-f437-4169-90ed-d2d97a99bc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:42.851832 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b715d84-f437-4169-90ed-d2d97a99bc52 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:42.852093 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c35544-62fe-43ba-a5d4-e5d7c9e81e07 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:42.852204 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b715d84-f437-4169-90ed-d2d97a99bc52 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:42.852369 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b715d84-f437-4169-90ed-d2d97a99bc52 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:42.852817 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c35544-62fe-43ba-a5d4-e5d7c9e81e07 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:42.853110 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b715d84-f437-4169-90ed-d2d97a99bc52 None admin] RBAC: Adding query filter params (name=service) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:42.853413 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b715d84-f437-4169-90ed-d2d97a99bc52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:42.853622 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c35544-62fe-43ba-a5d4-e5d7c9e81e07 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:42.854505 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c35544-62fe-43ba-a5d4-e5d7c9e81e07 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:42.854770 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b715d84-f437-4169-90ed-d2d97a99bc52 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:42.856437 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c35544-62fe-43ba-a5d4-e5d7c9e81e07 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:42.863267 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 379/744] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 08:32:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:42.864074 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b715d84-f437-4169-90ed-d2d97a99bc52 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:42.959020 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 366/745] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jul 25 08:32:42 2022] POST /identity/v3/services => generated 240 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:32:42.959971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c35544-62fe-43ba-a5d4-e5d7c9e81e07 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:42.971292 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b715d84-f437-4169-90ed-d2d97a99bc52 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:43.008099 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:43.032749 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341317f1-523a-4dd2-b4f5-4df1be1a59b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:43.035032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341317f1-523a-4dd2-b4f5-4df1be1a59b8 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:43.035340 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341317f1-523a-4dd2-b4f5-4df1be1a59b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:43.035641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341317f1-523a-4dd2-b4f5-4df1be1a59b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:43.036559 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341317f1-523a-4dd2-b4f5-4df1be1a59b8 None admin] RBAC: Adding query filter params (role.id=25b0f48c10474bf6b98aad8f093868ee, scope.project.id=be349194440449209f19f6b535ffd4f6, user.id=2763e540681547d3a6677567b3be86ea) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:43.037292 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341317f1-523a-4dd2-b4f5-4df1be1a59b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:43.039002 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341317f1-523a-4dd2-b4f5-4df1be1a59b8 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:43.052005 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 380/746] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:32:42 2022] GET /identity/v3/role_assignments?user.id=2763e540681547d3a6677567b3be86ea&scope.project.id=be349194440449209f19f6b535ffd4f6&role.id=25b0f48c10474bf6b98aad8f093868ee => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:43.053244 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341317f1-523a-4dd2-b4f5-4df1be1a59b8 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:43.099010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c35544-62fe-43ba-a5d4-e5d7c9e81e07 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:43.139745 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717ff91-05a4-40cf-a8df-c72a9c967dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:43.140746 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717ff91-05a4-40cf-a8df-c72a9c967dd8 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:43.141052 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717ff91-05a4-40cf-a8df-c72a9c967dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:43.141340 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717ff91-05a4-40cf-a8df-c72a9c967dd8 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:43.142139 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717ff91-05a4-40cf-a8df-c72a9c967dd8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:43.142459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717ff91-05a4-40cf-a8df-c72a9c967dd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:43.144008 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717ff91-05a4-40cf-a8df-c72a9c967dd8 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:43.156858 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 367/747] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:32:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:43.162245 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717ff91-05a4-40cf-a8df-c72a9c967dd8 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:43.183677 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:43.202390 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341317f1-523a-4dd2-b4f5-4df1be1a59b8 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:43.245924 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a66b1-2700-434e-9712-e21fb4fa508c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:43.246804 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a66b1-2700-434e-9712-e21fb4fa508c None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:43.247537 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a66b1-2700-434e-9712-e21fb4fa508c None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:43.247866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a66b1-2700-434e-9712-e21fb4fa508c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:43.307524 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717ff91-05a4-40cf-a8df-c72a9c967dd8 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:43.348001 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458dabb-f970-44a3-a118-b775f35e18a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:43.349209 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458dabb-f970-44a3-a118-b775f35e18a6 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:43.349705 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458dabb-f970-44a3-a118-b775f35e18a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:43.350180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458dabb-f970-44a3-a118-b775f35e18a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:43.372392 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2458dabb-f970-44a3-a118-b775f35e18a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:43.374229 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2458dabb-f970-44a3-a118-b775f35e18a6 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:43.385170 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a66b1-2700-434e-9712-e21fb4fa508c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:43.386629 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a66b1-2700-434e-9712-e21fb4fa508c None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:43.403186 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-2458dabb-f970-44a3-a118-b775f35e18a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:43.403186 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:43.403186 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:43.403186 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:43.403186 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:43.403186 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:43.403186 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:43.403186 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:43.403186 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:43.403186 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:43.403186 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:43.403186 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:43.403186 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:43.403186 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:43.403186 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:43.404242 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:43.404242 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:43.404242 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:43.404242 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:43.404242 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:43.404242 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:43.404242 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:43.404242 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:43.404242 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:43.404242 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:43.404242 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:43.404242 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:43.404242 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:43.404242 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:43.404242 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:43.404242 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:43.404242 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:43.405124 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:43.405124 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:43.405124 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:43.405124 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:43.411677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-023a66b1-2700-434e-9712-e21fb4fa508c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:43.411677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:43.411677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:43.411677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:43.411677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:43.411677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:43.411677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:43.411677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:43.411677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:43.411677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:43.411677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:43.411677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:43.411677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:43.411677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:43.411677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:43.412620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:43.412620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:43.412620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:43.412620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:43.412620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:43.412620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:43.412620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:43.412620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:43.412620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:43.412620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:43.412620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:43.412620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:43.412620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:43.412620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:43.412620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:43.412620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:43.412620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:43.413504 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:43.413504 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:43.413504 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:43.413504 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:43.413504 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 381/748] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:43.415137 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 368/749] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:32:43.416153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a66b1-2700-434e-9712-e21fb4fa508c None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:43.428653 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458dabb-f970-44a3-a118-b775f35e18a6 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:43.481419 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:43.524110 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:43.590611 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458dabb-f970-44a3-a118-b775f35e18a6 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:43.596432 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a66b1-2700-434e-9712-e21fb4fa508c None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:43.627933 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a64153-04cd-478e-9b43-2f4a6382f5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:43.628878 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a64153-04cd-478e-9b43-2f4a6382f5cd None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:43.629310 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a64153-04cd-478e-9b43-2f4a6382f5cd None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:43.629837 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a64153-04cd-478e-9b43-2f4a6382f5cd None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:43.630831 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a64153-04cd-478e-9b43-2f4a6382f5cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:43.631330 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a64153-04cd-478e-9b43-2f4a6382f5cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:43.633189 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a64153-04cd-478e-9b43-2f4a6382f5cd None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:43.638786 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4069f-76e0-4b4f-be55-26f701f211a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:43.639462 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4069f-76e0-4b4f-be55-26f701f211a5 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:43.639780 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4069f-76e0-4b4f-be55-26f701f211a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:43.640648 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4069f-76e0-4b4f-be55-26f701f211a5 None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:43.641469 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4069f-76e0-4b4f-be55-26f701f211a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:43.641695 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4069f-76e0-4b4f-be55-26f701f211a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:43.643800 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4069f-76e0-4b4f-be55-26f701f211a5 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:43.654555 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 369/750] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:43.654555 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e07ca0-2252-498d-8de3-eb31ec25448c None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:43.654555 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e07ca0-2252-498d-8de3-eb31ec25448c None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:43.654555 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e07ca0-2252-498d-8de3-eb31ec25448c None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:43.654555 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 370/751] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:43.656647 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e07ca0-2252-498d-8de3-eb31ec25448c None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:43.669823 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 382/752] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:43.671937 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cebf9-e3aa-4a25-bfe9-4e44a7e831d3 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:43.672233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cebf9-e3aa-4a25-bfe9-4e44a7e831d3 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:43.672522 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cebf9-e3aa-4a25-bfe9-4e44a7e831d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:43.692484 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-622cebf9-e3aa-4a25-bfe9-4e44a7e831d3 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:43.693801 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-622cebf9-e3aa-4a25-bfe9-4e44a7e831d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:43.767852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e07ca0-2252-498d-8de3-eb31ec25448c None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:43.791365 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 383/753] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:32:43.803635 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622cebf9-e3aa-4a25-bfe9-4e44a7e831d3 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:43.813062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:43.816811 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:43.826155 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb568b-ce3b-476d-a9ae-51705ea0be81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:43.826954 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb568b-ce3b-476d-a9ae-51705ea0be81 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:43.837180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb568b-ce3b-476d-a9ae-51705ea0be81 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:43.837180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb568b-ce3b-476d-a9ae-51705ea0be81 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:43.837180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb568b-ce3b-476d-a9ae-51705ea0be81 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:43.837180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb568b-ce3b-476d-a9ae-51705ea0be81 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:43.853309 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-aadb568b-ce3b-476d-a9ae-51705ea0be81 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:32:43.853309 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:43.853309 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:43.853309 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:43.853309 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:43.853309 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:43.853309 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:43.853309 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:43.853309 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:43.853309 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:43.853309 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:43.853309 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:43.853309 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:32:43.853309 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:32:43.853309 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:32:43.853309 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:32:43.854354 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:43.854354 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:43.854354 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:32:43.854354 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:43.854354 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:32:43.854354 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:43.854354 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:43.854354 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:43.854354 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:43.854354 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:43.854354 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:43.854354 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:43.854354 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:43.854354 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:43.854354 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:43.854354 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:43.854354 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:43.854354 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:43.855289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:43.855289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:43.855289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:32:43.855289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:32:43.855289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:32:43.855289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:32:43.855289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:32:43.855289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:32:43.855289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:32:43.855289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:43.863024 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 371/754] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Jul 25 08:32:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:32:43.864128 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb568b-ce3b-476d-a9ae-51705ea0be81 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:43.914357 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622cebf9-e3aa-4a25-bfe9-4e44a7e831d3 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:43.960238 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50f57e-e10b-4b9f-b5cc-5a2f59bce543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:43.961365 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50f57e-e10b-4b9f-b5cc-5a2f59bce543 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:43.961852 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50f57e-e10b-4b9f-b5cc-5a2f59bce543 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:43.962307 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50f57e-e10b-4b9f-b5cc-5a2f59bce543 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:43.970948 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50f57e-e10b-4b9f-b5cc-5a2f59bce543 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:43.972692 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50f57e-e10b-4b9f-b5cc-5a2f59bce543 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:43.974943 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb568b-ce3b-476d-a9ae-51705ea0be81 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:43.989033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-0d50f57e-e10b-4b9f-b5cc-5a2f59bce543 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 08:32:43.989033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:43.989033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:43.989033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:43.989033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:43.989033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:43.989033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:43.989033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:43.989033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:43.989033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:43.989033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:43.989033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:43.989033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:32:43.989033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:32:43.989033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:32:43.989033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:32:43.989997 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:43.989997 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:43.989997 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:32:43.989997 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:43.989997 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:32:43.989997 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:43.989997 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:43.989997 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:43.989997 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:43.989997 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:43.989997 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:43.989997 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:43.989997 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:43.989997 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:43.989997 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:43.989997 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:43.989997 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:43.989997 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:43.990949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:43.990949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:43.990949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:32:43.990949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:32:43.990949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:32:43.990949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:32:43.990949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:32:43.990949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:32:43.990949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 08:32:43.990949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:43.992965 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 384/755] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Jul 25 08:32:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:43.993874 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50f57e-e10b-4b9f-b5cc-5a2f59bce543 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:44.016122 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5a7da-135a-4432-823d-45d26f13d203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:44.017456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5a7da-135a-4432-823d-45d26f13d203 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:44.017740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5a7da-135a-4432-823d-45d26f13d203 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:44.018016 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5a7da-135a-4432-823d-45d26f13d203 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:44.018997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5a7da-135a-4432-823d-45d26f13d203 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:44.021028 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5a7da-135a-4432-823d-45d26f13d203 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:44.037255 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-2ea5a7da-135a-4432-823d-45d26f13d203 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 08:32:44.037255 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:44.037255 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:32:44.037255 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:32:44.037255 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:32:44.037255 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:32:44.037255 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:32:44.037255 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:32:44.037255 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 08:32:44.037255 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:44.037255 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:32:44.037255 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:44.037255 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:44.037255 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:44.037255 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:44.037255 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:44.038370 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:44.038370 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:44.038370 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:44.038370 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:44.038370 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:44.038370 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:44.038370 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:44.038370 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:32:44.038370 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:32:44.038370 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:32:44.038370 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:32:44.038370 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:44.038370 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:44.038370 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:44.038370 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:44.038370 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:44.039346 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:44.039346 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:44.039346 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:44.039346 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:44.039346 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:44.039346 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:44.039346 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:44.039346 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:44.039346 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:44.039346 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:44.039346 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:44.039346 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:32:44.039346 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:32:44.039346 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 08:32:44.039346 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:44.047216 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 372/756] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Jul 25 08:32:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:44.048257 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5a7da-135a-4432-823d-45d26f13d203 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:44.091691 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:44.106986 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:44.117828 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50f57e-e10b-4b9f-b5cc-5a2f59bce543 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:44.162965 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf76861-e606-4044-919a-43560da9d1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:44.163927 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf76861-e606-4044-919a-43560da9d1eb None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:44.164360 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf76861-e606-4044-919a-43560da9d1eb None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:44.164860 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf76861-e606-4044-919a-43560da9d1eb None admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:44.165964 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf76861-e606-4044-919a-43560da9d1eb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:44.166463 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf76861-e606-4044-919a-43560da9d1eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:44.168146 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5a7da-135a-4432-823d-45d26f13d203 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:44.168338 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf76861-e606-4044-919a-43560da9d1eb None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:44.196119 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 385/757] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Jul 25 08:32:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:44.196119 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf76861-e606-4044-919a-43560da9d1eb None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:44.208351 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e879ab-723b-4af2-9533-e64bfe6b6716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:44.209377 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e879ab-723b-4af2-9533-e64bfe6b6716 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:44.209855 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e879ab-723b-4af2-9533-e64bfe6b6716 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:44.210280 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e879ab-723b-4af2-9533-e64bfe6b6716 None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:44.211298 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e879ab-723b-4af2-9533-e64bfe6b6716 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:44.211900 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e879ab-723b-4af2-9533-e64bfe6b6716 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:44.213580 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e879ab-723b-4af2-9533-e64bfe6b6716 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:44.233063 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 373/758] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Jul 25 08:32:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:44.234881 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e879ab-723b-4af2-9533-e64bfe6b6716 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:44.316398 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf76861-e606-4044-919a-43560da9d1eb None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:44.353533 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e879ab-723b-4af2-9533-e64bfe6b6716 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:44.354269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf715b7b-d663-43cd-af70-323e1e12fd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:44.354951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf715b7b-d663-43cd-af70-323e1e12fd15 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:44.355534 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf715b7b-d663-43cd-af70-323e1e12fd15 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:44.355842 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf715b7b-d663-43cd-af70-323e1e12fd15 None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:44.357662 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf715b7b-d663-43cd-af70-323e1e12fd15 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:44.357983 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf715b7b-d663-43cd-af70-323e1e12fd15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:44.359674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf715b7b-d663-43cd-af70-323e1e12fd15 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:44.363483 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:44.367344 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 386/759] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Jul 25 08:32:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:44.369090 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf715b7b-d663-43cd-af70-323e1e12fd15 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:44.372232 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:44.416391 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d657b-e796-4643-a702-2b99e5eac9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:44.417738 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d657b-e796-4643-a702-2b99e5eac9f3 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:44.418176 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d657b-e796-4643-a702-2b99e5eac9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:44.418618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d657b-e796-4643-a702-2b99e5eac9f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:44.432796 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d657b-e796-4643-a702-2b99e5eac9f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:44.435120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d657b-e796-4643-a702-2b99e5eac9f3 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:44.461045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-3f3d657b-e796-4643-a702-2b99e5eac9f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:44.461045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:44.461045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:44.461045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:44.461045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:44.461045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:44.461045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:44.461045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:44.461045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:44.461045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:44.461045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:44.461045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:44.461045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:44.461045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:44.461045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:44.462217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:44.462217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:44.462217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:44.462217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:44.462217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:44.462217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:44.462217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:44.462217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:44.462217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:44.462217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:44.462217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:44.462217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:44.462217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:44.462217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:44.462217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:44.462217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:44.462217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:44.463335 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:44.463335 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:44.463335 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:44.463335 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:44.465050 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 374/760] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:44.465927 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d657b-e796-4643-a702-2b99e5eac9f3 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:44.497654 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf715b7b-d663-43cd-af70-323e1e12fd15 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:44.535495 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea518338-4cef-4a50-a607-925d6a315ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:44.536421 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea518338-4cef-4a50-a607-925d6a315ef6 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:44.536855 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea518338-4cef-4a50-a607-925d6a315ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:44.537280 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea518338-4cef-4a50-a607-925d6a315ef6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:44.575729 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d657b-e796-4643-a702-2b99e5eac9f3 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:44.612732 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f970d4-c283-4cc0-82a5-28643baec7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:44.612955 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea518338-4cef-4a50-a607-925d6a315ef6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:44.613810 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f970d4-c283-4cc0-82a5-28643baec7dc None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:44.614261 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f970d4-c283-4cc0-82a5-28643baec7dc None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:44.614438 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea518338-4cef-4a50-a607-925d6a315ef6 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:44.615132 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f970d4-c283-4cc0-82a5-28643baec7dc None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:44.616109 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f970d4-c283-4cc0-82a5-28643baec7dc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:44.616579 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:44.617203 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f970d4-c283-4cc0-82a5-28643baec7dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:44.619321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f970d4-c283-4cc0-82a5-28643baec7dc None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:44.625974 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 375/761] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Jul 25 08:32:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:44.627012 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f970d4-c283-4cc0-82a5-28643baec7dc None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:44.652422 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:44.730398 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 387/762] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:32:44 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 08:32:44.731426 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea518338-4cef-4a50-a607-925d6a315ef6 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:44.744096 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f970d4-c283-4cc0-82a5-28643baec7dc None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:44.781185 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ea3e8-44b7-459f-87a9-159ba24b77d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:44.782198 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ea3e8-44b7-459f-87a9-159ba24b77d7 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:44.782638 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ea3e8-44b7-459f-87a9-159ba24b77d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:44.783064 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ea3e8-44b7-459f-87a9-159ba24b77d7 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:44.784266 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ea3e8-44b7-459f-87a9-159ba24b77d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:44.784746 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ea3e8-44b7-459f-87a9-159ba24b77d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:44.786254 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ea3e8-44b7-459f-87a9-159ba24b77d7 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:44.799386 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 376/763] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:44.800556 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ea3e8-44b7-459f-87a9-159ba24b77d7 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:44.841180 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea518338-4cef-4a50-a607-925d6a315ef6 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:44.852031 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:44.885996 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66127346-0cf8-4de0-99a5-5f262bb68e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:44.886673 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66127346-0cf8-4de0-99a5-5f262bb68e21 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:44.886960 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66127346-0cf8-4de0-99a5-5f262bb68e21 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:44.887240 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66127346-0cf8-4de0-99a5-5f262bb68e21 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:44.888611 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66127346-0cf8-4de0-99a5-5f262bb68e21 None admin] RBAC: Adding query filter params (interface=public, service_id=c758eb5baa974ab18bb40bbbc47e90c9, region_id=RegionOne) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:44.888611 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66127346-0cf8-4de0-99a5-5f262bb68e21 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:44.890863 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:44.892225 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66127346-0cf8-4de0-99a5-5f262bb68e21 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:44.902869 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 388/764] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Jul 25 08:32:44 2022] GET /identity/v3/endpoints?service_id=c758eb5baa974ab18bb40bbbc47e90c9&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:44.903952 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66127346-0cf8-4de0-99a5-5f262bb68e21 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:44.913761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ea3e8-44b7-459f-87a9-159ba24b77d7 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:44.951828 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c706b-7f6d-4bd1-99d5-cbd69fccc99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:44.953674 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c706b-7f6d-4bd1-99d5-cbd69fccc99b None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:44.954064 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c706b-7f6d-4bd1-99d5-cbd69fccc99b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:44.954447 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c706b-7f6d-4bd1-99d5-cbd69fccc99b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:44.966383 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c706b-7f6d-4bd1-99d5-cbd69fccc99b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:44.968184 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c706b-7f6d-4bd1-99d5-cbd69fccc99b None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:44.987797 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-be9c706b-7f6d-4bd1-99d5-cbd69fccc99b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:44.987797 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:44.987797 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:44.987797 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:44.987797 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:44.987797 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:44.987797 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:44.987797 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:44.987797 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:44.987797 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:44.987797 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:44.987797 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:44.987797 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:44.987797 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:44.987797 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:44.988872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:44.988872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:44.988872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:44.988872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:44.988872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:44.988872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:44.988872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:44.988872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:44.988872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:44.988872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:44.988872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:44.988872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:44.988872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:44.988872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:44.988872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:44.988872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:44.988872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:44.989748 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:44.989748 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:44.989748 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:44.989748 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:44.994630 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 377/765] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:44.995683 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c706b-7f6d-4bd1-99d5-cbd69fccc99b None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:45.037288 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66127346-0cf8-4de0-99a5-5f262bb68e21 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:45.088304 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbd2f4-6885-48b8-a611-fd814efebf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:45.089453 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbd2f4-6885-48b8-a611-fd814efebf28 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:45.089933 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbd2f4-6885-48b8-a611-fd814efebf28 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:45.090394 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbd2f4-6885-48b8-a611-fd814efebf28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:45.102680 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bbd2f4-6885-48b8-a611-fd814efebf28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:45.104972 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bbd2f4-6885-48b8-a611-fd814efebf28 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:45.105975 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c706b-7f6d-4bd1-99d5-cbd69fccc99b None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:45.126008 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-95bbd2f4-6885-48b8-a611-fd814efebf28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:45.126008 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:45.126008 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:45.126008 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:45.126008 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:45.126008 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:45.126008 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:45.126008 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:45.126008 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:45.126008 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:45.126008 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:45.126008 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:45.126008 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:32:45.126008 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:32:45.126008 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:32:45.126959 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:32:45.126959 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:45.126959 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:45.126959 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:45.126959 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:45.126959 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:45.126959 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:45.126959 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:45.126959 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:45.126959 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:45.126959 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:45.126959 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:45.126959 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:45.126959 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:45.126959 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:45.126959 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:45.126959 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:45.127890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:32:45.127890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:32:45.127890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:32:45.127890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:32:45.127890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:32:45.127890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:32:45.127890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:45.127890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:45.130977 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 389/766] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:32:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:45.132277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbd2f4-6885-48b8-a611-fd814efebf28 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:45.148954 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb5966-9098-4532-8163-50cc5ccb3077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:45.149898 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb5966-9098-4532-8163-50cc5ccb3077 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:45.150188 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb5966-9098-4532-8163-50cc5ccb3077 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:45.150470 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb5966-9098-4532-8163-50cc5ccb3077 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:45.151165 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb5966-9098-4532-8163-50cc5ccb3077 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:45.153069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb5966-9098-4532-8163-50cc5ccb3077 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:45.154283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:45.162376 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 378/767] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Jul 25 08:32:44 2022] GET /identity/v3/services => generated 772 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:45.163484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb5966-9098-4532-8163-50cc5ccb3077 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:45.177113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:45.277695 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb5966-9098-4532-8163-50cc5ccb3077 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:45.294027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbd2f4-6885-48b8-a611-fd814efebf28 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:45.319748 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a6f79-3ae3-40d4-9cb2-dceee44b0c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:45.321008 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a6f79-3ae3-40d4-9cb2-dceee44b0c00 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:45.321533 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a6f79-3ae3-40d4-9cb2-dceee44b0c00 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:45.321890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a6f79-3ae3-40d4-9cb2-dceee44b0c00 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:45.322716 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a6f79-3ae3-40d4-9cb2-dceee44b0c00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:45.323033 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a6f79-3ae3-40d4-9cb2-dceee44b0c00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:45.324543 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a6f79-3ae3-40d4-9cb2-dceee44b0c00 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:45.334269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d75bd8-a484-49a5-be86-2a7c7e53189e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:45.335064 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d75bd8-a484-49a5-be86-2a7c7e53189e None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:45.335348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d75bd8-a484-49a5-be86-2a7c7e53189e None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:45.335648 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d75bd8-a484-49a5-be86-2a7c7e53189e None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:45.336447 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d75bd8-a484-49a5-be86-2a7c7e53189e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:45.336758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d75bd8-a484-49a5-be86-2a7c7e53189e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:45.338165 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d75bd8-a484-49a5-be86-2a7c7e53189e None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:45.338854 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 379/768] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:32:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:45.340233 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020723f0-599e-4ae3-97bc-d9acb3da225d None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:45.340533 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020723f0-599e-4ae3-97bc-d9acb3da225d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:45.340815 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020723f0-599e-4ae3-97bc-d9acb3da225d None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:45.346285 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 380/769] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:45.346285 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427b181-7f4f-4c11-be0b-bcc2bce25dcb None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:45.346285 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427b181-7f4f-4c11-be0b-bcc2bce25dcb None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:45.346285 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427b181-7f4f-4c11-be0b-bcc2bce25dcb None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:45.346285 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 381/770] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:45.346716 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427b181-7f4f-4c11-be0b-bcc2bce25dcb None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:45.359300 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 390/771] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:45.361210 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f685f25-e077-4f5e-9321-c1da3e706b59 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:45.361564 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f685f25-e077-4f5e-9321-c1da3e706b59 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:45.361909 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f685f25-e077-4f5e-9321-c1da3e706b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:45.383887 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-1f685f25-e077-4f5e-9321-c1da3e706b59 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:45.385965 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-1f685f25-e077-4f5e-9321-c1da3e706b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:45.418382 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:45.462520 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 391/772] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:32:45.464122 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e96d0d-8ddb-4109-a4d5-6624f64ae26e None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:45.464444 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e96d0d-8ddb-4109-a4d5-6624f64ae26e None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:45.464689 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e96d0d-8ddb-4109-a4d5-6624f64ae26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:45.465572 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427b181-7f4f-4c11-be0b-bcc2bce25dcb None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:45.491377 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-b3e96d0d-8ddb-4109-a4d5-6624f64ae26e None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:45.492619 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-b3e96d0d-8ddb-4109-a4d5-6624f64ae26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:45.504853 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:45.506767 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7740db-4b34-48ad-b2d5-e01b6019ac85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:45.507845 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7740db-4b34-48ad-b2d5-e01b6019ac85 None admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:45.508512 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7740db-4b34-48ad-b2d5-e01b6019ac85 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:45.508797 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7740db-4b34-48ad-b2d5-e01b6019ac85 None admin] PATH_INFO: `/v3/projects/be349194440449209f19f6b535ffd4f6/users/1c1a08d3a76643a9996dc0daa8714ac6/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:45.510905 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7740db-4b34-48ad-b2d5-e01b6019ac85 None admin] RBAC: Authorizing `identity:create_grant(project_id=be349194440449209f19f6b535ffd4f6, user_id=1c1a08d3a76643a9996dc0daa8714ac6, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:45.512365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7740db-4b34-48ad-b2d5-e01b6019ac85 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:45.561680 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 392/773] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:32:45.562665 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e96d0d-8ddb-4109-a4d5-6624f64ae26e None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:45.592430 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 382/774] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 08:32:45 2022] PUT /identity/v3/projects/be349194440449209f19f6b535ffd4f6/users/1c1a08d3a76643a9996dc0daa8714ac6/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:32:45.595087 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7740db-4b34-48ad-b2d5-e01b6019ac85 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:45.712501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e96d0d-8ddb-4109-a4d5-6624f64ae26e None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:45.752381 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7740db-4b34-48ad-b2d5-e01b6019ac85 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:45.760093 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3f998-dca7-4bcb-adfb-daab677f103d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:45.760879 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3f998-dca7-4bcb-adfb-daab677f103d None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:45.761161 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3f998-dca7-4bcb-adfb-daab677f103d None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:45.761431 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3f998-dca7-4bcb-adfb-daab677f103d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:45.770741 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3f998-dca7-4bcb-adfb-daab677f103d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:45.772393 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3f998-dca7-4bcb-adfb-daab677f103d None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:45.778282 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:45.788658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-00d3f998-dca7-4bcb-adfb-daab677f103d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:45.788658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:45.788658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:45.788658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:45.788658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:45.788658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:45.788658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:45.788658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:45.788658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:45.788658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:45.788658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:45.788658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:45.788658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:32:45.788658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:32:45.788658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:32:45.789561 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:32:45.789561 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:45.789561 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:45.789561 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:45.789561 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:45.789561 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:45.789561 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:45.789561 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:45.789561 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:45.789561 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:45.789561 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:45.789561 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:45.789561 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:45.789561 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:45.789561 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:45.789561 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:45.789561 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:45.790441 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:32:45.790441 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:32:45.790441 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:32:45.790441 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:32:45.790441 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:32:45.790441 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:32:45.790441 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:45.790441 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:45.790441 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 393/775] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:32:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:45.790913 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3f998-dca7-4bcb-adfb-daab677f103d None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:45.802355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b24102-f3f3-42d3-8c29-63f331888b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:45.803722 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b24102-f3f3-42d3-8c29-63f331888b86 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:45.805205 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b24102-f3f3-42d3-8c29-63f331888b86 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:45.805438 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:45.805564 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b24102-f3f3-42d3-8c29-63f331888b86 None admin] PATH_INFO: `/v3/services/network` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:45.806133 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b24102-f3f3-42d3-8c29-63f331888b86 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:45.807923 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b24102-f3f3-42d3-8c29-63f331888b86 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:45.821658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-33b24102-f3f3-42d3-8c29-63f331888b86 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 08:32:45.821658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:45.821658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:32:45.821658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:32:45.821658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:32:45.821658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:32:45.821658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:32:45.821658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:32:45.821658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 08:32:45.821658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:45.821658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:32:45.821658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:45.821658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:45.821658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:45.821658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:45.821658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:45.821658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:45.822889 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:45.822889 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:45.822889 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:45.822889 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:45.822889 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:45.822889 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:45.822889 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:32:45.822889 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:32:45.822889 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:32:45.822889 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:32:45.822889 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:45.822889 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:45.822889 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:45.822889 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:45.822889 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:45.822889 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:45.823955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:45.823955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:45.823955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:45.823955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:45.823955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:45.823955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:45.823955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:45.823955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:45.823955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:45.823955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:45.823955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:32:45.823955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:32:45.823955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 08:32:45.823955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:45.825042 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 383/776] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:32:45 2022] GET /identity/v3/services/network => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:45.825953 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b24102-f3f3-42d3-8c29-63f331888b86 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:45.913954 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3f998-dca7-4bcb-adfb-daab677f103d None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:45.950378 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b24102-f3f3-42d3-8c29-63f331888b86 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:45.958647 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57606e4-5aa2-463b-aeb1-ddfa7c29c886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:45.959562 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57606e4-5aa2-463b-aeb1-ddfa7c29c886 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:45.959872 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57606e4-5aa2-463b-aeb1-ddfa7c29c886 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:45.960150 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57606e4-5aa2-463b-aeb1-ddfa7c29c886 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:45.972193 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57606e4-5aa2-463b-aeb1-ddfa7c29c886 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:45.980467 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-c57606e4-5aa2-463b-aeb1-ddfa7c29c886 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:32:45.980467 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:45.980467 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:45.980467 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:45.980467 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:45.980467 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:45.980467 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:45.980467 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:45.980467 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:45.980467 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:45.980467 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:45.980467 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:45.980467 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:45.980467 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:45.980467 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:45.980467 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:45.981381 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:45.981381 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:45.981381 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:45.981381 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:45.981381 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:45.981381 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:45.981381 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:45.981381 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:45.981381 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:45.981381 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:45.981381 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:45.981381 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:45.981381 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:45.981381 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:45.981381 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:45.981381 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:45.982197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:45.982197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:45.982197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:45.982197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:45.982197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:45.982197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:45.982197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:45.982197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:45.982197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:45.982197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:45.982197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:32:45.982197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:45.982197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 394/777] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:32:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:45.982879 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57606e4-5aa2-463b-aeb1-ddfa7c29c886 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:45.988650 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33dd779-7899-4e21-ae0e-c4c0dd664598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:45.989719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dd779-7899-4e21-ae0e-c4c0dd664598 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:45.990011 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dd779-7899-4e21-ae0e-c4c0dd664598 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:45.990292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dd779-7899-4e21-ae0e-c4c0dd664598 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:45.991086 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33dd779-7899-4e21-ae0e-c4c0dd664598 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:45.991394 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33dd779-7899-4e21-ae0e-c4c0dd664598 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:45.992871 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33dd779-7899-4e21-ae0e-c4c0dd664598 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:46.006617 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 384/778] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:32:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:46.007644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33dd779-7899-4e21-ae0e-c4c0dd664598 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:46.054363 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:46.056423 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:46.098293 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57606e4-5aa2-463b-aeb1-ddfa7c29c886 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:46.113182 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33dd779-7899-4e21-ae0e-c4c0dd664598 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:46.137892 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8dbab-8304-4086-88ff-d076e5c5c203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:46.138812 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8dbab-8304-4086-88ff-d076e5c5c203 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:46.139330 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8dbab-8304-4086-88ff-d076e5c5c203 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:46.139893 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8dbab-8304-4086-88ff-d076e5c5c203 None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:46.141395 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e8dbab-8304-4086-88ff-d076e5c5c203 None admin] RBAC: Adding query filter params (name=network) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:46.141919 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e8dbab-8304-4086-88ff-d076e5c5c203 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:46.143772 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e8dbab-8304-4086-88ff-d076e5c5c203 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:46.149608 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 395/779] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jul 25 08:32:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:46.150930 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8dbab-8304-4086-88ff-d076e5c5c203 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:46.151382 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09becfd-ed72-42a2-9e35-ba1926d94d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:46.152079 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09becfd-ed72-42a2-9e35-ba1926d94d47 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:46.152362 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09becfd-ed72-42a2-9e35-ba1926d94d47 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:46.152638 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09becfd-ed72-42a2-9e35-ba1926d94d47 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:46.153389 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09becfd-ed72-42a2-9e35-ba1926d94d47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:46.153693 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09becfd-ed72-42a2-9e35-ba1926d94d47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:46.155260 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09becfd-ed72-42a2-9e35-ba1926d94d47 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:46.165629 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 385/780] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:32:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:46.166507 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09becfd-ed72-42a2-9e35-ba1926d94d47 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:46.262426 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8dbab-8304-4086-88ff-d076e5c5c203 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:46.271843 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09becfd-ed72-42a2-9e35-ba1926d94d47 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:46.274450 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:46.294327 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:46.302386 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1491d-4540-4885-90a0-92d7d2ae7c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:46.303422 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1491d-4540-4885-90a0-92d7d2ae7c43 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:46.303979 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1491d-4540-4885-90a0-92d7d2ae7c43 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:46.304532 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1491d-4540-4885-90a0-92d7d2ae7c43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:46.305652 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1491d-4540-4885-90a0-92d7d2ae7c43 None admin] RBAC: Adding query filter params (role.id=a0a4f5f9b3264740a55056fed8fd7a33, scope.project.id=be349194440449209f19f6b535ffd4f6, user.id=b3c1d56bc0a64411a68f97a4417b0379) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:46.306148 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1491d-4540-4885-90a0-92d7d2ae7c43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:46.308201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1491d-4540-4885-90a0-92d7d2ae7c43 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:46.310163 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd53c8-2f4e-4b50-899c-8cf7ce36e812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:46.310821 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd53c8-2f4e-4b50-899c-8cf7ce36e812 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:46.311108 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd53c8-2f4e-4b50-899c-8cf7ce36e812 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:46.311384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd53c8-2f4e-4b50-899c-8cf7ce36e812 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:46.312921 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd53c8-2f4e-4b50-899c-8cf7ce36e812 None admin] RBAC: Adding query filter params (type=network) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:46.312921 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd53c8-2f4e-4b50-899c-8cf7ce36e812 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:46.314006 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd53c8-2f4e-4b50-899c-8cf7ce36e812 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:46.316210 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 396/781] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:32:46 2022] GET /identity/v3/role_assignments?user.id=b3c1d56bc0a64411a68f97a4417b0379&scope.project.id=be349194440449209f19f6b535ffd4f6&role.id=a0a4f5f9b3264740a55056fed8fd7a33 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:46.317191 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1491d-4540-4885-90a0-92d7d2ae7c43 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:46.319657 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 386/782] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jul 25 08:32:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:46.333007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd53c8-2f4e-4b50-899c-8cf7ce36e812 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:46.436717 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1491d-4540-4885-90a0-92d7d2ae7c43 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:46.475693 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f910a5-b286-4a57-a7f0-3e035952b607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:46.476713 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f910a5-b286-4a57-a7f0-3e035952b607 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:46.477091 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f910a5-b286-4a57-a7f0-3e035952b607 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:46.477471 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f910a5-b286-4a57-a7f0-3e035952b607 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:46.489947 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f910a5-b286-4a57-a7f0-3e035952b607 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:46.491405 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f910a5-b286-4a57-a7f0-3e035952b607 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:46.523885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-d9f910a5-b286-4a57-a7f0-3e035952b607 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:46.523885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:46.523885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:46.523885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:46.523885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:46.523885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:46.523885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:46.523885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:46.523885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:46.523885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:46.523885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:46.523885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:46.523885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:46.523885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:46.523885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:46.524810 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:46.524810 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:46.524810 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:46.524810 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:46.524810 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:46.524810 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:46.524810 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:46.524810 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:46.524810 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:46.524810 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:46.524810 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:46.524810 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:46.524810 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:46.524810 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:46.524810 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:46.524810 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:46.524810 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:46.525691 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:46.525691 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:46.525691 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:46.525691 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:46.525691 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 397/783] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:46.532533 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f910a5-b286-4a57-a7f0-3e035952b607 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:46.566729 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd53c8-2f4e-4b50-899c-8cf7ce36e812 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:46.616847 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa4a21-0814-47ef-9175-6d7b37d2de04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:46.617513 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa4a21-0814-47ef-9175-6d7b37d2de04 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:46.617796 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa4a21-0814-47ef-9175-6d7b37d2de04 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:46.618078 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa4a21-0814-47ef-9175-6d7b37d2de04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:46.618880 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aa4a21-0814-47ef-9175-6d7b37d2de04 None admin] RBAC: Adding query filter params (interface=public, service_id=6b6ff79270444f71a7027f08030b16b4, region_id=RegionOne) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:46.619190 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aa4a21-0814-47ef-9175-6d7b37d2de04 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:46.619934 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:46.628216 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aa4a21-0814-47ef-9175-6d7b37d2de04 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:46.646534 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 387/784] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Jul 25 08:32:46 2022] GET /identity/v3/endpoints?service_id=6b6ff79270444f71a7027f08030b16b4&interface=public®ion_id=RegionOne => generated 194 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:46.648758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa4a21-0814-47ef-9175-6d7b37d2de04 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:46.715961 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:46.722797 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f910a5-b286-4a57-a7f0-3e035952b607 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:46.794199 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe18ed-c386-431c-b745-f4e6fa9e594a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:46.794941 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe18ed-c386-431c-b745-f4e6fa9e594a None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:46.795162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe18ed-c386-431c-b745-f4e6fa9e594a None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:46.795444 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe18ed-c386-431c-b745-f4e6fa9e594a None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:46.796400 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe18ed-c386-431c-b745-f4e6fa9e594a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:46.796767 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe18ed-c386-431c-b745-f4e6fa9e594a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:46.800196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe18ed-c386-431c-b745-f4e6fa9e594a None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:46.817305 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 398/785] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:46.823053 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe18ed-c386-431c-b745-f4e6fa9e594a None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:46.861607 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa4a21-0814-47ef-9175-6d7b37d2de04 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:46.934112 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe18ed-c386-431c-b745-f4e6fa9e594a None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:46.944493 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a03798-26f3-4973-a589-bf0acf6136c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:46.945173 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a03798-26f3-4973-a589-bf0acf6136c2 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:46.945456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a03798-26f3-4973-a589-bf0acf6136c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:46.945731 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a03798-26f3-4973-a589-bf0acf6136c2 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:46.946146 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:46.946422 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a03798-26f3-4973-a589-bf0acf6136c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:46.947825 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a03798-26f3-4973-a589-bf0acf6136c2 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:46.953940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 388/786] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Jul 25 08:32:46 2022] GET /identity/v3/services => generated 772 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:46.972029 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc955c-3315-4ec0-96de-f8cf80d1664e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:46.972885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc955c-3315-4ec0-96de-f8cf80d1664e None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:46.973167 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc955c-3315-4ec0-96de-f8cf80d1664e None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:46.977179 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc955c-3315-4ec0-96de-f8cf80d1664e None admin] PATH_INFO: `/v3/users/swift` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:46.982001 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc955c-3315-4ec0-96de-f8cf80d1664e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:46.983469 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc955c-3315-4ec0-96de-f8cf80d1664e None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:47.000567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-2ecc955c-3315-4ec0-96de-f8cf80d1664e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 08:32:47.000567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:47.000567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:47.000567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:47.000567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:47.000567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:47.000567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:47.000567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:47.000567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:47.000567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:47.000567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:47.000567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:47.000567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:32:47.000567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:32:47.000567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:32:47.000567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:32:47.001604 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:47.001604 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:47.001604 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:32:47.001604 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:47.001604 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:32:47.001604 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:47.001604 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:47.001604 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:47.001604 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:47.001604 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:47.001604 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:47.001604 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:47.001604 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:47.001604 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:47.001604 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:47.001604 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:47.001604 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:47.001604 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:47.002568 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:47.002568 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:47.002568 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:32:47.002568 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:32:47.002568 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:32:47.002568 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:32:47.002568 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:32:47.002568 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:32:47.002568 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 08:32:47.002568 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:47.002568 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 399/787] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:32:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:47.012782 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a03798-26f3-4973-a589-bf0acf6136c2 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:47.158800 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:47.164636 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a03798-26f3-4973-a589-bf0acf6136c2 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:47.199520 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f7cea-daa4-43b9-8c2d-09d760e90e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:47.200218 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f7cea-daa4-43b9-8c2d-09d760e90e4f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:47.200501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f7cea-daa4-43b9-8c2d-09d760e90e4f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:47.200776 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f7cea-daa4-43b9-8c2d-09d760e90e4f None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:47.201612 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f7cea-daa4-43b9-8c2d-09d760e90e4f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:47.201918 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f7cea-daa4-43b9-8c2d-09d760e90e4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:47.204298 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f7cea-daa4-43b9-8c2d-09d760e90e4f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:47.223323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 389/788] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Jul 25 08:32:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:47.228796 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc955c-3315-4ec0-96de-f8cf80d1664e None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:47.336073 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc955c-3315-4ec0-96de-f8cf80d1664e None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:47.379134 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8cc54f-cd8e-4d45-a0e2-4363737edd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:47.379960 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cc54f-cd8e-4d45-a0e2-4363737edd7d None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:47.380240 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cc54f-cd8e-4d45-a0e2-4363737edd7d None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:47.380514 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cc54f-cd8e-4d45-a0e2-4363737edd7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:47.401637 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8cc54f-cd8e-4d45-a0e2-4363737edd7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:47.403105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8cc54f-cd8e-4d45-a0e2-4363737edd7d None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:47.426931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-de8cc54f-cd8e-4d45-a0e2-4363737edd7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:47.426931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:47.426931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:47.426931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:47.426931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:47.426931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:47.426931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:47.426931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:47.426931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:47.426931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:47.426931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:47.426931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:47.426931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:47.426931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:47.426931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:47.427960 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:47.427960 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:47.427960 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:47.427960 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:47.427960 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:47.427960 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:47.427960 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:47.427960 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:47.427960 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:47.427960 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:47.427960 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:47.427960 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:47.427960 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:47.427960 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:47.427960 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:47.427960 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:47.427960 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:47.428853 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:47.428853 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:47.428853 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:47.428853 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:47.431723 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 400/789] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:47.433855 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f7cea-daa4-43b9-8c2d-09d760e90e4f None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:47.563164 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f7cea-daa4-43b9-8c2d-09d760e90e4f None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:47.600968 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7528e-952e-4953-be7b-6b3e3e9b58fc None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:47.601267 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7528e-952e-4953-be7b-6b3e3e9b58fc None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:47.601518 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7528e-952e-4953-be7b-6b3e3e9b58fc None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:47.605162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 401/790] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:47.607057 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171a58b-f796-4118-912f-a05d3c05544f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:47.607766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171a58b-f796-4118-912f-a05d3c05544f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:47.608053 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171a58b-f796-4118-912f-a05d3c05544f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:47.608333 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171a58b-f796-4118-912f-a05d3c05544f None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:47.609915 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171a58b-f796-4118-912f-a05d3c05544f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:47.610228 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171a58b-f796-4118-912f-a05d3c05544f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:47.611598 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171a58b-f796-4118-912f-a05d3c05544f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:47.618376 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525ec85-0419-4462-b4cf-9ac439fbdad6 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:47.618665 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525ec85-0419-4462-b4cf-9ac439fbdad6 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:47.618934 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525ec85-0419-4462-b4cf-9ac439fbdad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:47.643712 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 390/791] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:47.645481 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-a525ec85-0419-4462-b4cf-9ac439fbdad6 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:47.646272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171a58b-f796-4118-912f-a05d3c05544f None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:47.646616 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-a525ec85-0419-4462-b4cf-9ac439fbdad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:47.667552 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:47.715633 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:47.790344 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 402/792] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 08:32:47.813885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525ec85-0419-4462-b4cf-9ac439fbdad6 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:47.817564 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171a58b-f796-4118-912f-a05d3c05544f None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:47.855368 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104dabf4-1b59-4bb0-9b72-683014d7b82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:47.857091 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104dabf4-1b59-4bb0-9b72-683014d7b82d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:47.857710 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104dabf4-1b59-4bb0-9b72-683014d7b82d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:47.858137 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104dabf4-1b59-4bb0-9b72-683014d7b82d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:47.866046 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104dabf4-1b59-4bb0-9b72-683014d7b82d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:47.867727 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104dabf4-1b59-4bb0-9b72-683014d7b82d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:47.885095 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-104dabf4-1b59-4bb0-9b72-683014d7b82d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:47.885095 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:47.885095 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:47.885095 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:47.885095 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:47.885095 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:47.885095 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:47.885095 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:47.885095 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:47.885095 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:47.885095 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:47.885095 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:47.885095 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:32:47.885095 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:32:47.885095 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:32:47.886026 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:32:47.886026 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:47.886026 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:47.886026 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:47.886026 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:47.886026 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:47.886026 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:47.886026 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:47.886026 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:47.886026 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:47.886026 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:47.886026 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:47.886026 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:47.886026 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:47.886026 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:47.886026 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:47.886026 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:47.886938 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:32:47.886938 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:32:47.886938 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:32:47.886938 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:32:47.886938 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:32:47.886938 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:32:47.886938 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:47.886938 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:47.890813 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 391/793] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:32:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:32:47.905053 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104dabf4-1b59-4bb0-9b72-683014d7b82d None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:48.002318 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525ec85-0419-4462-b4cf-9ac439fbdad6 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:48.017815 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:48.042748 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2a354-0eb7-4a20-8284-a799c6a344f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:48.043467 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104dabf4-1b59-4bb0-9b72-683014d7b82d None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:48.044401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2a354-0eb7-4a20-8284-a799c6a344f9 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:48.044908 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2a354-0eb7-4a20-8284-a799c6a344f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:48.045378 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2a354-0eb7-4a20-8284-a799c6a344f9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:48.046902 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2a354-0eb7-4a20-8284-a799c6a344f9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:48.048766 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2a354-0eb7-4a20-8284-a799c6a344f9 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:48.063018 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-55e2a354-0eb7-4a20-8284-a799c6a344f9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 08:32:48.063018 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:48.063018 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:32:48.063018 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:32:48.063018 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:32:48.063018 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:32:48.063018 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:32:48.063018 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:32:48.063018 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 08:32:48.063018 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:48.063018 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:32:48.063018 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:48.063018 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:48.063018 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:48.063018 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:48.063018 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:48.064040 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:48.064040 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:48.064040 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:48.064040 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:48.064040 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:48.064040 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:48.064040 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:48.064040 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:32:48.064040 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:32:48.064040 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:32:48.064040 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:32:48.064040 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:48.064040 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:48.064040 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:48.064040 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:48.064040 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:48.065027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:48.065027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:48.065027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:48.065027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:48.065027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:48.065027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:48.065027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:48.065027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:48.065027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:48.065027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:48.065027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:48.065027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:32:48.065027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:32:48.065027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 08:32:48.065027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:48.067938 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 403/794] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Jul 25 08:32:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:32:48.069492 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151b28f-4aab-4f15-a98b-7796395b3b2c None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:48.069985 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151b28f-4aab-4f15-a98b-7796395b3b2c None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:48.070475 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151b28f-4aab-4f15-a98b-7796395b3b2c None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:48.072207 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 404/795] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:48.077078 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151b28f-4aab-4f15-a98b-7796395b3b2c None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:48.081133 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b8c99-fdec-4d6a-90ad-086f449b581e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:48.081808 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b8c99-fdec-4d6a-90ad-086f449b581e None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:48.082097 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b8c99-fdec-4d6a-90ad-086f449b581e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:48.082379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b8c99-fdec-4d6a-90ad-086f449b581e None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:48.083468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b8c99-fdec-4d6a-90ad-086f449b581e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:48.083468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b8c99-fdec-4d6a-90ad-086f449b581e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:48.084974 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b8c99-fdec-4d6a-90ad-086f449b581e None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:48.095786 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:48.098495 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 392/796] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:32:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:48.103746 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83c9af-5306-40c4-b5f4-edcb79432400 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:48.103746 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83c9af-5306-40c4-b5f4-edcb79432400 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:48.103746 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83c9af-5306-40c4-b5f4-edcb79432400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:48.121491 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-9f83c9af-5306-40c4-b5f4-edcb79432400 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:48.122906 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9f83c9af-5306-40c4-b5f4-edcb79432400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:48.203319 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151b28f-4aab-4f15-a98b-7796395b3b2c None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:48.221513 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 393/797] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:32:48.222595 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83c9af-5306-40c4-b5f4-edcb79432400 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:48.269053 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7835fa-f78e-4184-9669-0e248f2fc5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:48.269642 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7835fa-f78e-4184-9669-0e248f2fc5e8 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:48.269924 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7835fa-f78e-4184-9669-0e248f2fc5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:48.270194 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7835fa-f78e-4184-9669-0e248f2fc5e8 None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:48.270904 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7835fa-f78e-4184-9669-0e248f2fc5e8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:48.271212 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7835fa-f78e-4184-9669-0e248f2fc5e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:48.272622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7835fa-f78e-4184-9669-0e248f2fc5e8 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:48.277770 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 405/798] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Jul 25 08:32:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:48.278628 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7835fa-f78e-4184-9669-0e248f2fc5e8 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:48.298797 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:48.339910 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83c9af-5306-40c4-b5f4-edcb79432400 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:48.358389 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:48.379345 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f41936-732e-4f4c-a6ad-c9a92878f344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:48.380801 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f41936-732e-4f4c-a6ad-c9a92878f344 None admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:48.381363 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f41936-732e-4f4c-a6ad-c9a92878f344 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:48.381872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f41936-732e-4f4c-a6ad-c9a92878f344 None admin] PATH_INFO: `/v3/projects/be349194440449209f19f6b535ffd4f6/users/2763e540681547d3a6677567b3be86ea/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:48.383028 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7835fa-f78e-4184-9669-0e248f2fc5e8 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:48.384483 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f41936-732e-4f4c-a6ad-c9a92878f344 None admin] RBAC: Authorizing `identity:create_grant(project_id=be349194440449209f19f6b535ffd4f6, user_id=2763e540681547d3a6677567b3be86ea, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:48.386165 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f41936-732e-4f4c-a6ad-c9a92878f344 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:48.419394 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7928e-71aa-4210-a4e6-5127d9add88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:48.420224 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7928e-71aa-4210-a4e6-5127d9add88a None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:48.420507 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7928e-71aa-4210-a4e6-5127d9add88a None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:48.420784 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7928e-71aa-4210-a4e6-5127d9add88a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:48.431407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7928e-71aa-4210-a4e6-5127d9add88a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:48.440004 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-21a7928e-71aa-4210-a4e6-5127d9add88a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:32:48.440004 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:48.440004 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:48.440004 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:48.440004 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:48.440004 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:48.440004 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:48.440004 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:48.440004 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:48.440004 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:48.440004 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:48.440004 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:48.440004 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:48.440004 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:48.440004 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:48.440004 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:48.440936 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:48.440936 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:48.440936 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:48.440936 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:48.440936 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:48.440936 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:48.440936 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:48.440936 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:48.440936 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:48.440936 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:48.440936 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:48.440936 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:48.440936 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:48.440936 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:48.440936 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:48.440936 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:48.441862 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:48.441862 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:48.441862 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:48.441862 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:48.441862 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:48.441862 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:48.441862 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:48.441862 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:48.441862 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:48.441862 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:48.441862 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:32:48.441862 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:48.446137 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 406/799] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:32:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:48.446869 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7928e-71aa-4210-a4e6-5127d9add88a None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:48.462988 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 394/800] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 08:32:48 2022] PUT /identity/v3/projects/be349194440449209f19f6b535ffd4f6/users/2763e540681547d3a6677567b3be86ea/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:32:48.465367 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f41936-732e-4f4c-a6ad-c9a92878f344 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:48.599099 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7928e-71aa-4210-a4e6-5127d9add88a None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:48.608126 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f41936-732e-4f4c-a6ad-c9a92878f344 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:48.640283 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891b705-21bd-47c0-8e85-7e8b65da237d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:48.641276 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891b705-21bd-47c0-8e85-7e8b65da237d None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:48.641571 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891b705-21bd-47c0-8e85-7e8b65da237d None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:48.641846 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891b705-21bd-47c0-8e85-7e8b65da237d None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:48.642567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891b705-21bd-47c0-8e85-7e8b65da237d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:48.642884 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891b705-21bd-47c0-8e85-7e8b65da237d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:48.644540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891b705-21bd-47c0-8e85-7e8b65da237d None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:48.648239 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:48.652352 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 407/801] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Jul 25 08:32:48 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:48.653785 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f03167-1474-4205-88ec-161a014a9577 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:48.654072 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f03167-1474-4205-88ec-161a014a9577 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:48.654411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f03167-1474-4205-88ec-161a014a9577 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:48.655798 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 408/802] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:48.656486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:48.661397 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f03167-1474-4205-88ec-161a014a9577 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:48.664381 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150a55c-7c89-41d1-92f4-43e76e747f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:48.665469 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150a55c-7c89-41d1-92f4-43e76e747f5f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:48.666910 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150a55c-7c89-41d1-92f4-43e76e747f5f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:48.667411 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150a55c-7c89-41d1-92f4-43e76e747f5f None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:48.668407 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150a55c-7c89-41d1-92f4-43e76e747f5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:48.668908 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150a55c-7c89-41d1-92f4-43e76e747f5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:48.670485 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150a55c-7c89-41d1-92f4-43e76e747f5f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:48.682458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 395/803] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:32:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:48.684489 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c72e8b-d4fe-46dd-a57c-6e9c0b987889 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:48.684982 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c72e8b-d4fe-46dd-a57c-6e9c0b987889 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:48.685425 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c72e8b-d4fe-46dd-a57c-6e9c0b987889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:48.711651 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-c5c72e8b-d4fe-46dd-a57c-6e9c0b987889 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:48.712437 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c5c72e8b-d4fe-46dd-a57c-6e9c0b987889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:48.793475 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f03167-1474-4205-88ec-161a014a9577 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:48.808562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 396/804] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:32:48.810114 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c72e8b-d4fe-46dd-a57c-6e9c0b987889 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:48.834949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92efa5-258e-48ec-8c6f-fd75e30eed5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:48.835684 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92efa5-258e-48ec-8c6f-fd75e30eed5b None admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:48.837142 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92efa5-258e-48ec-8c6f-fd75e30eed5b None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:48.837421 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92efa5-258e-48ec-8c6f-fd75e30eed5b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:48.838163 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92efa5-258e-48ec-8c6f-fd75e30eed5b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:48.839540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92efa5-258e-48ec-8c6f-fd75e30eed5b None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:48.932850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c72e8b-d4fe-46dd-a57c-6e9c0b987889 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:48.933047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 409/805] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:32:48 2022] POST /identity/v3/endpoints => generated 346 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:32:48.933836 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92efa5-258e-48ec-8c6f-fd75e30eed5b None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:48.965304 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:49.015764 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb090aa-884c-4cc3-b7bf-253a0f281f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:49.019091 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb090aa-884c-4cc3-b7bf-253a0f281f42 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:49.023029 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb090aa-884c-4cc3-b7bf-253a0f281f42 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:49.023576 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb090aa-884c-4cc3-b7bf-253a0f281f42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:49.043599 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb090aa-884c-4cc3-b7bf-253a0f281f42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:49.048266 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb090aa-884c-4cc3-b7bf-253a0f281f42 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:49.063915 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:49.078415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-afb090aa-884c-4cc3-b7bf-253a0f281f42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:49.078415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:49.078415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:49.078415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:49.078415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:49.078415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:49.078415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:49.078415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:49.078415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:49.078415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:49.078415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:49.078415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:49.078415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:49.078415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:49.078415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:49.079380 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:49.079380 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:49.079380 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:49.079380 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:49.079380 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:49.079380 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:49.079380 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:49.079380 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:49.079380 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:49.079380 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:49.079380 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:49.079380 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:49.079380 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:49.079380 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:49.079380 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:49.079380 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:49.079380 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:49.080302 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:49.080302 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:49.080302 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:49.080302 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:49.083989 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 397/806] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:49.090016 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb090aa-884c-4cc3-b7bf-253a0f281f42 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:49.139001 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92efa5-258e-48ec-8c6f-fd75e30eed5b None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:49.176544 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09853903-0295-43f5-a871-8288ddc86e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:49.177368 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09853903-0295-43f5-a871-8288ddc86e24 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:49.177651 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09853903-0295-43f5-a871-8288ddc86e24 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:49.177894 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09853903-0295-43f5-a871-8288ddc86e24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:49.190003 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09853903-0295-43f5-a871-8288ddc86e24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:49.198484 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-09853903-0295-43f5-a871-8288ddc86e24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:49.198484 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:49.198484 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:49.198484 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:49.198484 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:49.198484 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:49.198484 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:49.198484 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:49.198484 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:49.198484 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:49.198484 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:49.198484 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:49.198484 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:49.198484 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:49.198484 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:49.198484 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:49.199396 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:49.199396 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:49.199396 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:49.199396 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:49.199396 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:49.199396 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:49.199396 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:49.199396 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:49.199396 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:49.199396 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:49.199396 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:49.199396 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:49.199396 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:49.199396 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:49.199396 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:49.199396 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:49.200290 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:49.200290 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:49.200290 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:49.200290 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:49.200290 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:49.200290 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:49.200290 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:49.200290 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:49.200290 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:49.200290 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:49.200290 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:49.200290 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:49.204579 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 410/807] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 08:32:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:49.205807 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09853903-0295-43f5-a871-8288ddc86e24 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:49.238561 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb090aa-884c-4cc3-b7bf-253a0f281f42 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:49.324226 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09853903-0295-43f5-a871-8288ddc86e24 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:49.344118 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:49.371326 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02d23a-7b19-47f8-b9b3-a950c2bafd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:49.372290 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02d23a-7b19-47f8-b9b3-a950c2bafd70 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:49.372718 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02d23a-7b19-47f8-b9b3-a950c2bafd70 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:49.373164 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02d23a-7b19-47f8-b9b3-a950c2bafd70 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:49.374071 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02d23a-7b19-47f8-b9b3-a950c2bafd70 None admin] RBAC: Adding query filter params (name=service) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:49.375218 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02d23a-7b19-47f8-b9b3-a950c2bafd70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:49.376791 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02d23a-7b19-47f8-b9b3-a950c2bafd70 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:49.401182 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 411/808] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 08:32:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:32:49.402513 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02d23a-7b19-47f8-b9b3-a950c2bafd70 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:49.425033 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ac6be-f1c8-4125-aed0-2dead7f59e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:49.426727 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ac6be-f1c8-4125-aed0-2dead7f59e74 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:49.427378 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ac6be-f1c8-4125-aed0-2dead7f59e74 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:49.429130 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ac6be-f1c8-4125-aed0-2dead7f59e74 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:49.430158 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ac6be-f1c8-4125-aed0-2dead7f59e74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:49.430801 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ac6be-f1c8-4125-aed0-2dead7f59e74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:49.433226 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ac6be-f1c8-4125-aed0-2dead7f59e74 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:49.453675 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 398/809] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:49.460139 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ac6be-f1c8-4125-aed0-2dead7f59e74 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:49.492785 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:49.560342 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02d23a-7b19-47f8-b9b3-a950c2bafd70 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:49.579463 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ac6be-f1c8-4125-aed0-2dead7f59e74 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:49.599090 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df56c9-345e-41ee-a1de-0111bdcd008f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:49.600062 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df56c9-345e-41ee-a1de-0111bdcd008f None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:49.600413 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df56c9-345e-41ee-a1de-0111bdcd008f None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:49.600801 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df56c9-345e-41ee-a1de-0111bdcd008f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:49.612119 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df56c9-345e-41ee-a1de-0111bdcd008f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:49.621942 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df56c9-345e-41ee-a1de-0111bdcd008f None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:49.622536 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d3bc5-7039-4f6b-9e7c-79f260fdd732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:49.623639 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d3bc5-7039-4f6b-9e7c-79f260fdd732 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:49.623936 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d3bc5-7039-4f6b-9e7c-79f260fdd732 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:49.624295 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d3bc5-7039-4f6b-9e7c-79f260fdd732 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:49.632084 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-42df56c9-345e-41ee-a1de-0111bdcd008f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:49.632084 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:49.632084 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:49.632084 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:49.632084 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:49.632084 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:49.632084 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:49.632084 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:49.632084 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:49.632084 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:49.632084 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:49.632084 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:49.632084 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:49.632084 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:49.632084 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:49.633166 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:49.633166 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:49.633166 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:49.633166 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:49.633166 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:49.633166 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:49.633166 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:49.633166 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:49.633166 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:49.633166 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:49.633166 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:49.633166 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:49.633166 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:49.633166 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:49.633166 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:49.633166 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:49.633166 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:49.634188 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:49.634188 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:49.634188 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:49.634188 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:49.634524 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d3bc5-7039-4f6b-9e7c-79f260fdd732 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:49.634524 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d3bc5-7039-4f6b-9e7c-79f260fdd732 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:49.636331 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 412/810] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:49.637780 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b3bd5-ed3a-49ae-8dbe-689b210b0370 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:49.638233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b3bd5-ed3a-49ae-8dbe-689b210b0370 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:49.638656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b3bd5-ed3a-49ae-8dbe-689b210b0370 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:49.644794 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 413/811] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:49.645799 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b3bd5-ed3a-49ae-8dbe-689b210b0370 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:49.651005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-103d3bc5-7039-4f6b-9e7c-79f260fdd732 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:32:49.651005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:49.651005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:49.651005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:49.651005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:49.651005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:49.651005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:49.651005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:49.651005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:49.651005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:49.651005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:49.651005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:49.651005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:32:49.651005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:32:49.651005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:32:49.651005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:32:49.652181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:49.652181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:49.652181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:32:49.652181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:49.652181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:32:49.652181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:49.652181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:49.652181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:49.652181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:49.652181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:49.652181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:49.652181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:49.652181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:49.652181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:49.652181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:49.652181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:49.652181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:49.652181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:49.653181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:49.653181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:49.653181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:32:49.653181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:32:49.653181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:32:49.653181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:32:49.653181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:32:49.653181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:32:49.653181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:32:49.653181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:49.653181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 399/812] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Jul 25 08:32:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:32:49.653881 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89dcb0-1334-47f3-8699-cad93779b970 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:49.654168 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89dcb0-1334-47f3-8699-cad93779b970 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:49.654449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89dcb0-1334-47f3-8699-cad93779b970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:49.678130 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-1d89dcb0-1334-47f3-8699-cad93779b970 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:49.679125 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-1d89dcb0-1334-47f3-8699-cad93779b970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:49.683431 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:49.763634 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 400/813] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:32:49.763634 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89dcb0-1334-47f3-8699-cad93779b970 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:49.771342 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b3bd5-ed3a-49ae-8dbe-689b210b0370 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:49.775631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:49.820167 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6940527-a3b2-4ecd-9a5e-a5c16fe365a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:49.821137 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6940527-a3b2-4ecd-9a5e-a5c16fe365a0 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:49.821570 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6940527-a3b2-4ecd-9a5e-a5c16fe365a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:49.822038 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6940527-a3b2-4ecd-9a5e-a5c16fe365a0 None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:49.822969 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6940527-a3b2-4ecd-9a5e-a5c16fe365a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:49.823425 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6940527-a3b2-4ecd-9a5e-a5c16fe365a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:49.824961 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6940527-a3b2-4ecd-9a5e-a5c16fe365a0 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:49.837653 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 414/814] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:49.839077 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6940527-a3b2-4ecd-9a5e-a5c16fe365a0 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:49.879637 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89dcb0-1334-47f3-8699-cad93779b970 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:49.908454 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c768d-cc0a-4ed5-9d3c-64c5eef2c5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:49.909130 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c768d-cc0a-4ed5-9d3c-64c5eef2c5a2 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:49.909513 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c768d-cc0a-4ed5-9d3c-64c5eef2c5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:49.909796 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c768d-cc0a-4ed5-9d3c-64c5eef2c5a2 None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:49.910641 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c768d-cc0a-4ed5-9d3c-64c5eef2c5a2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:49.910948 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c768d-cc0a-4ed5-9d3c-64c5eef2c5a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:49.912509 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c768d-cc0a-4ed5-9d3c-64c5eef2c5a2 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:49.931597 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 401/815] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Jul 25 08:32:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:49.932483 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c768d-cc0a-4ed5-9d3c-64c5eef2c5a2 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:49.933674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:49.949180 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6940527-a3b2-4ecd-9a5e-a5c16fe365a0 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:49.986683 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb5fd6-7043-4be4-b5d5-64915414f792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:49.987501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb5fd6-7043-4be4-b5d5-64915414f792 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:49.987826 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb5fd6-7043-4be4-b5d5-64915414f792 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:49.988110 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb5fd6-7043-4be4-b5d5-64915414f792 None admin] PATH_INFO: `/v3/services/network` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:49.988772 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb5fd6-7043-4be4-b5d5-64915414f792 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:49.990139 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb5fd6-7043-4be4-b5d5-64915414f792 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:50.003424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-9ecb5fd6-7043-4be4-b5d5-64915414f792 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 08:32:50.003424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:50.003424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:32:50.003424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:32:50.003424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:32:50.003424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:32:50.003424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:32:50.003424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:32:50.003424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 08:32:50.003424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:50.003424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:32:50.003424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:50.003424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:50.003424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:50.003424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:50.003424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:50.003424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:50.004651 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:50.004651 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:50.004651 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:50.004651 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:50.004651 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:50.004651 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:50.004651 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:32:50.004651 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:32:50.004651 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:32:50.004651 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:32:50.004651 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:50.004651 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:50.004651 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:50.004651 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:50.004651 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:50.004651 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:50.005496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:50.005496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:50.005496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:50.005496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:50.005496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:50.005496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:50.005496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:50.005496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:50.005496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:50.005496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:50.005496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:32:50.005496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:32:50.005496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 08:32:50.005496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:50.005496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 415/816] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:32:49 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:50.006263 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb5fd6-7043-4be4-b5d5-64915414f792 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:50.013116 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:50.057906 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c768d-cc0a-4ed5-9d3c-64c5eef2c5a2 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:50.103213 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6d787-84e6-4ce6-a62f-ce15c40e248d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:50.104394 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6d787-84e6-4ce6-a62f-ce15c40e248d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:50.104775 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6d787-84e6-4ce6-a62f-ce15c40e248d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:50.105131 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6d787-84e6-4ce6-a62f-ce15c40e248d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:50.115122 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb5fd6-7043-4be4-b5d5-64915414f792 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:50.117214 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6d787-84e6-4ce6-a62f-ce15c40e248d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:50.119603 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6d787-84e6-4ce6-a62f-ce15c40e248d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:50.139827 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-b9d6d787-84e6-4ce6-a62f-ce15c40e248d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 08:32:50.139827 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:50.139827 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:50.139827 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:50.139827 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:50.139827 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:50.139827 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:50.139827 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:50.139827 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:50.139827 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:50.139827 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:50.139827 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:50.139827 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:32:50.139827 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:32:50.139827 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:32:50.139827 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:32:50.140839 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:50.140839 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:50.140839 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:32:50.140839 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:50.140839 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:32:50.140839 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:50.140839 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:50.140839 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:50.140839 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:50.140839 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:50.140839 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:50.140839 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:50.140839 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:50.140839 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:50.140839 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:50.140839 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:50.140839 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:50.140839 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:50.141772 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:50.141772 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:50.141772 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:32:50.141772 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:32:50.141772 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:32:50.141772 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:32:50.141772 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:32:50.141772 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:32:50.141772 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 08:32:50.141772 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:50.141772 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 402/817] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Jul 25 08:32:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:50.142853 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6d787-84e6-4ce6-a62f-ce15c40e248d None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:50.159036 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88798c-c986-4d64-9db6-71e5a3410829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:50.159713 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88798c-c986-4d64-9db6-71e5a3410829 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:50.160044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88798c-c986-4d64-9db6-71e5a3410829 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:50.160319 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88798c-c986-4d64-9db6-71e5a3410829 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:50.188332 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:50.236641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88798c-c986-4d64-9db6-71e5a3410829 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:50.237845 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88798c-c986-4d64-9db6-71e5a3410829 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:50.267912 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6d787-84e6-4ce6-a62f-ce15c40e248d None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:50.299589 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:50.304711 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee771e7-fcb0-4926-92b7-e313a83a0ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:50.305370 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee771e7-fcb0-4926-92b7-e313a83a0ad7 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:50.305652 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee771e7-fcb0-4926-92b7-e313a83a0ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:50.305929 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee771e7-fcb0-4926-92b7-e313a83a0ad7 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:50.306638 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee771e7-fcb0-4926-92b7-e313a83a0ad7 None admin] RBAC: Adding query filter params (name=network) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:50.306943 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee771e7-fcb0-4926-92b7-e313a83a0ad7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:50.308579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee771e7-fcb0-4926-92b7-e313a83a0ad7 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:50.318104 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 403/818] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jul 25 08:32:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:50.319182 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee771e7-fcb0-4926-92b7-e313a83a0ad7 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:50.373763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 416/819] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:32:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 08:32:50.375791 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88798c-c986-4d64-9db6-71e5a3410829 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:50.426363 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee771e7-fcb0-4926-92b7-e313a83a0ad7 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:50.450933 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:50.461944 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbe4e1-d02e-4605-914c-3f711102620d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:50.462613 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbe4e1-d02e-4605-914c-3f711102620d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:50.468525 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbe4e1-d02e-4605-914c-3f711102620d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:50.468525 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbe4e1-d02e-4605-914c-3f711102620d None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:50.468525 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbe4e1-d02e-4605-914c-3f711102620d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:50.468525 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbe4e1-d02e-4605-914c-3f711102620d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:50.468525 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbe4e1-d02e-4605-914c-3f711102620d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:50.490425 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 404/820] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Jul 25 08:32:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:50.491276 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbe4e1-d02e-4605-914c-3f711102620d None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:50.507407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88798c-c986-4d64-9db6-71e5a3410829 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:50.550096 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:50.553322 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaab348-a602-4415-9241-58e2551c2440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:50.554320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaab348-a602-4415-9241-58e2551c2440 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:50.555133 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaab348-a602-4415-9241-58e2551c2440 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:50.555864 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaab348-a602-4415-9241-58e2551c2440 None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:50.556877 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaab348-a602-4415-9241-58e2551c2440 None admin] RBAC: Adding query filter params (type=network) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:50.557644 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaab348-a602-4415-9241-58e2551c2440 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:50.559428 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaab348-a602-4415-9241-58e2551c2440 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:50.566710 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 417/821] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jul 25 08:32:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:50.567721 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaab348-a602-4415-9241-58e2551c2440 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:50.602704 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbe4e1-d02e-4605-914c-3f711102620d None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:50.639104 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a2a7e-5dd3-48de-a321-bbe59dcf0be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:50.640015 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a2a7e-5dd3-48de-a321-bbe59dcf0be2 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:50.640378 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a2a7e-5dd3-48de-a321-bbe59dcf0be2 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:50.640662 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a2a7e-5dd3-48de-a321-bbe59dcf0be2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:50.651629 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a2a7e-5dd3-48de-a321-bbe59dcf0be2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:50.653044 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a2a7e-5dd3-48de-a321-bbe59dcf0be2 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:50.677468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-6c7a2a7e-5dd3-48de-a321-bbe59dcf0be2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:50.677468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:50.677468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:50.677468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:50.677468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:50.677468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:50.677468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:50.677468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:50.677468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:50.677468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:50.677468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:50.677468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:50.677468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:50.677468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:50.677468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:50.678612 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:50.678612 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:50.678612 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:50.678612 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:50.678612 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:50.678612 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:50.678612 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:50.678612 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:50.678612 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:50.678612 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:50.678612 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:50.678612 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:50.678612 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:50.678612 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:50.678612 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:50.678612 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:50.678612 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:50.679692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:50.679692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:50.679692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:50.679692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:50.679692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 405/822] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:50.680096 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a2a7e-5dd3-48de-a321-bbe59dcf0be2 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:50.694838 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaab348-a602-4415-9241-58e2551c2440 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:50.717797 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:50.736545 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704bd6a-5361-4fd7-ac1b-b5ca02f3604d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:50.737487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704bd6a-5361-4fd7-ac1b-b5ca02f3604d None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:50.737772 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704bd6a-5361-4fd7-ac1b-b5ca02f3604d None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:50.738094 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704bd6a-5361-4fd7-ac1b-b5ca02f3604d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:50.749512 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704bd6a-5361-4fd7-ac1b-b5ca02f3604d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:50.750999 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704bd6a-5361-4fd7-ac1b-b5ca02f3604d None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:50.771371 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-0704bd6a-5361-4fd7-ac1b-b5ca02f3604d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:50.771371 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:50.771371 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:50.771371 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:50.771371 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:50.771371 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:50.771371 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:50.771371 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:50.771371 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:50.771371 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:50.771371 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:50.771371 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:50.771371 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:50.771371 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:50.771371 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:50.772525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:50.772525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:50.772525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:50.772525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:50.772525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:50.772525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:50.772525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:50.772525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:50.772525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:50.772525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:50.772525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:50.772525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:50.772525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:50.772525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:50.772525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:50.772525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:50.772525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:50.774032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:50.774032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:50.774032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:50.774032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:50.774032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 418/823] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:50.774032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704bd6a-5361-4fd7-ac1b-b5ca02f3604d None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:50.806161 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a2a7e-5dd3-48de-a321-bbe59dcf0be2 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:50.814089 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:50.842592 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5b3ac-6c22-4d35-b8f9-d180014be84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:50.844743 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5b3ac-6c22-4d35-b8f9-d180014be84d None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:50.845099 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5b3ac-6c22-4d35-b8f9-d180014be84d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:50.845449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5b3ac-6c22-4d35-b8f9-d180014be84d None admin] PATH_INFO: `/v3/endpoints` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:50.846612 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5b3ac-6c22-4d35-b8f9-d180014be84d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:50.848547 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5b3ac-6c22-4d35-b8f9-d180014be84d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:50.876306 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704bd6a-5361-4fd7-ac1b-b5ca02f3604d None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:50.910357 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37b155-a277-4fb8-84ac-67ccdf5e5509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:50.911020 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37b155-a277-4fb8-84ac-67ccdf5e5509 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:50.911300 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37b155-a277-4fb8-84ac-67ccdf5e5509 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:50.911575 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37b155-a277-4fb8-84ac-67ccdf5e5509 None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:50.912332 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37b155-a277-4fb8-84ac-67ccdf5e5509 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:50.912638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37b155-a277-4fb8-84ac-67ccdf5e5509 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:50.914003 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37b155-a277-4fb8-84ac-67ccdf5e5509 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:50.925663 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 419/824] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:50.927106 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9272a57-fd7d-4027-9b05-ae39c0910c6d None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:50.927493 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9272a57-fd7d-4027-9b05-ae39c0910c6d None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:50.927882 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9272a57-fd7d-4027-9b05-ae39c0910c6d None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:50.931284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 420/825] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:50.931284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9272a57-fd7d-4027-9b05-ae39c0910c6d None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:50.956095 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 406/826] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:32:50 2022] POST /identity/v3/endpoints => generated 327 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:32:50.957342 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5b3ac-6c22-4d35-b8f9-d180014be84d None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:50.966194 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:51.058166 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9272a57-fd7d-4027-9b05-ae39c0910c6d None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:51.109621 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c8e3c-17d2-48f7-a25f-2b280d5cd4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:51.110447 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c8e3c-17d2-48f7-a25f-2b280d5cd4b4 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:51.110739 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c8e3c-17d2-48f7-a25f-2b280d5cd4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:51.111344 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c8e3c-17d2-48f7-a25f-2b280d5cd4b4 None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:51.112118 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c8e3c-17d2-48f7-a25f-2b280d5cd4b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:51.112442 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c8e3c-17d2-48f7-a25f-2b280d5cd4b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:51.114125 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c8e3c-17d2-48f7-a25f-2b280d5cd4b4 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:51.115260 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5b3ac-6c22-4d35-b8f9-d180014be84d None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:51.129463 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 421/827] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:51.131118 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be2d27-40c0-4466-8ea7-8b9225f6d8f9 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:51.131422 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be2d27-40c0-4466-8ea7-8b9225f6d8f9 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:51.131740 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be2d27-40c0-4466-8ea7-8b9225f6d8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:51.154113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-c9be2d27-40c0-4466-8ea7-8b9225f6d8f9 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:51.155472 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-c9be2d27-40c0-4466-8ea7-8b9225f6d8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:51.156361 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a83acf-fb9d-4a3a-adab-a196881ed076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:51.157342 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a83acf-fb9d-4a3a-adab-a196881ed076 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:51.157929 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a83acf-fb9d-4a3a-adab-a196881ed076 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:51.158473 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a83acf-fb9d-4a3a-adab-a196881ed076 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:51.167488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a83acf-fb9d-4a3a-adab-a196881ed076 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:51.169357 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a83acf-fb9d-4a3a-adab-a196881ed076 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:51.190197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-92a83acf-fb9d-4a3a-adab-a196881ed076 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:51.190197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:51.190197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:51.190197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:51.190197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:51.190197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:51.190197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:51.190197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:51.190197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:51.190197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:51.190197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:51.190197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:51.190197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:32:51.190197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:32:51.190197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:32:51.191157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:32:51.191157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:51.191157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:51.191157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:51.191157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:51.191157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:51.191157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:51.191157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:51.191157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:51.191157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:51.191157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:51.191157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:51.191157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:51.191157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:51.191157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:51.191157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:51.191157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:51.192078 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:32:51.192078 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:32:51.192078 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:32:51.192078 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:32:51.192078 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:32:51.192078 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:32:51.192078 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:51.192078 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:51.195737 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 407/828] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:32:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:51.196730 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a83acf-fb9d-4a3a-adab-a196881ed076 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:51.224214 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:51.238728 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 422/829] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:32:51.239595 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be2d27-40c0-4466-8ea7-8b9225f6d8f9 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:51.257793 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:51.308076 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a83acf-fb9d-4a3a-adab-a196881ed076 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:51.344089 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77a957-3541-4d09-a29b-a311ba217c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:51.344797 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77a957-3541-4d09-a29b-a311ba217c18 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:51.345078 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77a957-3541-4d09-a29b-a311ba217c18 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:51.345353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77a957-3541-4d09-a29b-a311ba217c18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:51.348173 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be2d27-40c0-4466-8ea7-8b9225f6d8f9 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:51.351844 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c77a957-3541-4d09-a29b-a311ba217c18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:51.353258 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c77a957-3541-4d09-a29b-a311ba217c18 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:51.366931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-4c77a957-3541-4d09-a29b-a311ba217c18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:51.366931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:51.366931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:51.366931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:51.366931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:51.366931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:51.366931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:51.366931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:51.366931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:51.366931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:51.366931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:51.366931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:51.366931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:32:51.366931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:32:51.366931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:32:51.368024 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:32:51.368024 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:51.368024 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:51.368024 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:51.368024 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:51.368024 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:51.368024 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:51.368024 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:51.368024 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:51.368024 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:51.368024 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:51.368024 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:51.368024 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:51.368024 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:51.368024 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:51.368024 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:51.368024 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:51.369156 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:32:51.369156 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:32:51.369156 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:32:51.369156 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:32:51.369156 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:32:51.369156 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:32:51.369156 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:51.369156 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:51.369156 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 408/830] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:32:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:51.369156 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77a957-3541-4d09-a29b-a311ba217c18 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:51.385043 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5c392-dd6c-466c-a1bc-eae5841b1224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:51.385700 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5c392-dd6c-466c-a1bc-eae5841b1224 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:51.385979 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5c392-dd6c-466c-a1bc-eae5841b1224 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:51.386249 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5c392-dd6c-466c-a1bc-eae5841b1224 None admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:51.387033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b5c392-dd6c-466c-a1bc-eae5841b1224 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:51.387342 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b5c392-dd6c-466c-a1bc-eae5841b1224 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:51.388827 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b5c392-dd6c-466c-a1bc-eae5841b1224 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:51.400532 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 423/831] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:32:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:51.401801 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594aad70-0d1b-4132-9d9b-fde9b0bfc53d None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:51.402090 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594aad70-0d1b-4132-9d9b-fde9b0bfc53d None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:51.402365 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594aad70-0d1b-4132-9d9b-fde9b0bfc53d None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:51.403743 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 424/832] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:51.404331 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594aad70-0d1b-4132-9d9b-fde9b0bfc53d None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:51.455051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:51.473481 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77a957-3541-4d09-a29b-a311ba217c18 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:51.480597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:51.505052 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594aad70-0d1b-4132-9d9b-fde9b0bfc53d None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:51.508031 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0e77b-7f1f-4baf-9a0c-1059fa2d13ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:51.508815 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0e77b-7f1f-4baf-9a0c-1059fa2d13ac None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:51.509099 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0e77b-7f1f-4baf-9a0c-1059fa2d13ac None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:51.509376 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0e77b-7f1f-4baf-9a0c-1059fa2d13ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:51.522340 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0e77b-7f1f-4baf-9a0c-1059fa2d13ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:51.529931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-3eb0e77b-7f1f-4baf-9a0c-1059fa2d13ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:32:51.529931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:51.529931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:51.529931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:51.529931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:51.529931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:51.529931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:51.529931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:51.529931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:51.529931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:51.529931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:51.529931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:51.529931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:51.529931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:51.529931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:51.529931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:51.531112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:51.531112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:51.531112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:51.531112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:51.531112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:51.531112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:51.531112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:51.531112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:51.531112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:51.531112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:51.531112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:51.531112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:51.531112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:51.531112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:51.531112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:51.531112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:51.532115 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:51.532115 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:51.532115 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:51.532115 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:51.532115 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:51.532115 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:51.532115 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:51.532115 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:51.532115 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:51.532115 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:51.532115 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:32:51.532115 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:51.532115 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 409/833] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:32:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:51.532807 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0e77b-7f1f-4baf-9a0c-1059fa2d13ac None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:51.544179 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006fa0f6-4d49-4b0e-b9da-eaa64a777926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:51.544840 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fa0f6-4d49-4b0e-b9da-eaa64a777926 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:51.545125 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fa0f6-4d49-4b0e-b9da-eaa64a777926 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:51.545404 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fa0f6-4d49-4b0e-b9da-eaa64a777926 None admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:51.546725 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006fa0f6-4d49-4b0e-b9da-eaa64a777926 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:51.547092 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006fa0f6-4d49-4b0e-b9da-eaa64a777926 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:51.548569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006fa0f6-4d49-4b0e-b9da-eaa64a777926 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:51.560487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 425/834] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:32:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:51.561515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6f576-6ef3-469d-b9c2-e51150ea9085 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:51.561864 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6f576-6ef3-469d-b9c2-e51150ea9085 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:51.562146 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6f576-6ef3-469d-b9c2-e51150ea9085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:51.580556 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-67b6f576-6ef3-469d-b9c2-e51150ea9085 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:51.581829 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-67b6f576-6ef3-469d-b9c2-e51150ea9085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:51.636940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0e77b-7f1f-4baf-9a0c-1059fa2d13ac None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:51.647148 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 426/835] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:32:51.648102 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6f576-6ef3-469d-b9c2-e51150ea9085 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:51.673702 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54820414-7742-4916-8740-7aa2df91a9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:51.674356 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54820414-7742-4916-8740-7aa2df91a9bf None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:51.674660 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54820414-7742-4916-8740-7aa2df91a9bf None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:51.674918 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54820414-7742-4916-8740-7aa2df91a9bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:51.675793 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54820414-7742-4916-8740-7aa2df91a9bf None admin] RBAC: Adding query filter params (role.id=25b0f48c10474bf6b98aad8f093868ee, scope.project.id=be349194440449209f19f6b535ffd4f6, user.id=1c1a08d3a76643a9996dc0daa8714ac6) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:51.676108 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54820414-7742-4916-8740-7aa2df91a9bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:51.677519 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54820414-7742-4916-8740-7aa2df91a9bf None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:51.683177 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 410/836] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:32:51 2022] GET /identity/v3/role_assignments?user.id=1c1a08d3a76643a9996dc0daa8714ac6&scope.project.id=be349194440449209f19f6b535ffd4f6&role.id=25b0f48c10474bf6b98aad8f093868ee => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:51.684015 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54820414-7742-4916-8740-7aa2df91a9bf None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:51.699818 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:51.729275 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:51.771469 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6f576-6ef3-469d-b9c2-e51150ea9085 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:51.808264 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54820414-7742-4916-8740-7aa2df91a9bf None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:51.810845 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006fc46f-f3d8-4305-8c81-860e4c1b1395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:51.811534 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fc46f-f3d8-4305-8c81-860e4c1b1395 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:51.811886 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fc46f-f3d8-4305-8c81-860e4c1b1395 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:51.812162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fc46f-f3d8-4305-8c81-860e4c1b1395 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:51.812935 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006fc46f-f3d8-4305-8c81-860e4c1b1395 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:51.813246 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006fc46f-f3d8-4305-8c81-860e4c1b1395 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:51.814638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006fc46f-f3d8-4305-8c81-860e4c1b1395 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:51.829398 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 427/837] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:32:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:51.829398 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006fc46f-f3d8-4305-8c81-860e4c1b1395 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:51.856468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b649d8c-9a90-450b-af44-352b8bd03fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:51.858038 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b649d8c-9a90-450b-af44-352b8bd03fe6 None admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:51.858038 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b649d8c-9a90-450b-af44-352b8bd03fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:51.858038 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b649d8c-9a90-450b-af44-352b8bd03fe6 None admin] PATH_INFO: `/v3/projects/be349194440449209f19f6b535ffd4f6/users/b3c1d56bc0a64411a68f97a4417b0379/roles/a0a4f5f9b3264740a55056fed8fd7a33` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:51.875981 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b649d8c-9a90-450b-af44-352b8bd03fe6 None admin] RBAC: Authorizing `identity:create_grant(project_id=be349194440449209f19f6b535ffd4f6, user_id=b3c1d56bc0a64411a68f97a4417b0379, role_id=a0a4f5f9b3264740a55056fed8fd7a33)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:51.877708 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b649d8c-9a90-450b-af44-352b8bd03fe6 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:51.939490 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006fc46f-f3d8-4305-8c81-860e4c1b1395 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:51.964475 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 411/838] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 08:32:51 2022] PUT /identity/v3/projects/be349194440449209f19f6b535ffd4f6/users/b3c1d56bc0a64411a68f97a4417b0379/roles/a0a4f5f9b3264740a55056fed8fd7a33 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:32:51.964475 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b649d8c-9a90-450b-af44-352b8bd03fe6 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:51.967727 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:51.975253 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff420ac6-5083-4bf3-a1b5-775f82a54658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:51.976121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff420ac6-5083-4bf3-a1b5-775f82a54658 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:51.976406 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff420ac6-5083-4bf3-a1b5-775f82a54658 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:51.976684 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff420ac6-5083-4bf3-a1b5-775f82a54658 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:51.977352 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff420ac6-5083-4bf3-a1b5-775f82a54658 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:51.978877 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff420ac6-5083-4bf3-a1b5-775f82a54658 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:51.991726 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-ff420ac6-5083-4bf3-a1b5-775f82a54658 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 08:32:51.991726 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:51.991726 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:32:51.991726 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:32:51.991726 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:32:51.991726 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:32:51.991726 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:32:51.991726 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:32:51.991726 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 08:32:51.991726 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:51.991726 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:32:51.991726 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:51.991726 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:51.991726 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:51.991726 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:51.991726 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:51.991726 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:51.992834 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:51.992834 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:51.992834 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:51.992834 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:51.992834 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:51.992834 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:51.992834 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:32:51.992834 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:32:51.992834 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:32:51.992834 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:32:51.992834 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:51.992834 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:51.992834 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:51.992834 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:51.992834 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:51.992834 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:51.993752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:51.993752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:51.993752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:51.993752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:51.993752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:51.993752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:51.993752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:51.993752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:51.993752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:51.993752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:51.993752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:32:51.993752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:32:51.993752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 08:32:51.993752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:51.998453 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 428/839] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 08:32:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:52.000552 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff420ac6-5083-4bf3-a1b5-775f82a54658 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:52.052614 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:52.112134 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b649d8c-9a90-450b-af44-352b8bd03fe6 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:52.122302 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff420ac6-5083-4bf3-a1b5-775f82a54658 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:52.158686 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb99e07-da99-4788-b7cd-1216945a3cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:52.159532 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb99e07-da99-4788-b7cd-1216945a3cd5 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:52.159903 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb99e07-da99-4788-b7cd-1216945a3cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:52.160242 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb99e07-da99-4788-b7cd-1216945a3cd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:52.164496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b9781-a968-4c8e-a1f3-a2bbe81900eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:52.164496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b9781-a968-4c8e-a1f3-a2bbe81900eb None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:52.164714 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b9781-a968-4c8e-a1f3-a2bbe81900eb None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:52.164890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b9781-a968-4c8e-a1f3-a2bbe81900eb None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:52.165581 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b9781-a968-4c8e-a1f3-a2bbe81900eb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:52.165893 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b9781-a968-4c8e-a1f3-a2bbe81900eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:52.167881 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b9781-a968-4c8e-a1f3-a2bbe81900eb None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:52.172030 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb99e07-da99-4788-b7cd-1216945a3cd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:52.173485 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb99e07-da99-4788-b7cd-1216945a3cd5 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:52.174326 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 429/840] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 08:32:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:52.180601 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b9781-a968-4c8e-a1f3-a2bbe81900eb None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:52.193940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-bfb99e07-da99-4788-b7cd-1216945a3cd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:52.193940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:52.193940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:52.193940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:52.193940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:52.193940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:52.193940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:52.193940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:52.193940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:52.193940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:52.193940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:52.193940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:52.193940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:52.193940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:52.193940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:52.194940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:52.194940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:52.194940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:52.194940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:52.194940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:52.194940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:52.194940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:52.194940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:52.194940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:52.194940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:52.194940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:52.194940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:52.194940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:52.194940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:52.194940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:52.194940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:52.194940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:52.196166 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:52.196166 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:52.196166 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:52.196166 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:52.198009 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 412/841] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:52.207636 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb99e07-da99-4788-b7cd-1216945a3cd5 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:52.248856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:52.297882 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b9781-a968-4c8e-a1f3-a2bbe81900eb None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:52.315713 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb99e07-da99-4788-b7cd-1216945a3cd5 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:52.325842 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:52.336118 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0669d-1b4c-449e-a44b-bd25ba39a073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:52.341069 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0669d-1b4c-449e-a44b-bd25ba39a073 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:52.341069 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0669d-1b4c-449e-a44b-bd25ba39a073 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:52.341069 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0669d-1b4c-449e-a44b-bd25ba39a073 None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:52.341069 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0669d-1b4c-449e-a44b-bd25ba39a073 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:52.341069 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0669d-1b4c-449e-a44b-bd25ba39a073 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:52.341069 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0669d-1b4c-449e-a44b-bd25ba39a073 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:52.351788 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 430/842] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 08:32:52 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:52.352806 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56615c45-80d6-4d01-ac10-53f06e289b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:52.353501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56615c45-80d6-4d01-ac10-53f06e289b1b None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:52.353788 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56615c45-80d6-4d01-ac10-53f06e289b1b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:52.354166 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56615c45-80d6-4d01-ac10-53f06e289b1b None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:52.354925 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56615c45-80d6-4d01-ac10-53f06e289b1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:52.355239 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56615c45-80d6-4d01-ac10-53f06e289b1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:52.356713 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56615c45-80d6-4d01-ac10-53f06e289b1b None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:52.375776 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 413/843] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:52.378215 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0669d-1b4c-449e-a44b-bd25ba39a073 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:52.493453 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0669d-1b4c-449e-a44b-bd25ba39a073 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:52.516141 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:52.532217 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac934a7f-2a8e-4acc-9dee-1b9fc3d488e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:52.532610 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac934a7f-2a8e-4acc-9dee-1b9fc3d488e4 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:52.532903 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac934a7f-2a8e-4acc-9dee-1b9fc3d488e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:52.533436 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac934a7f-2a8e-4acc-9dee-1b9fc3d488e4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:52.542309 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac934a7f-2a8e-4acc-9dee-1b9fc3d488e4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:52.543822 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac934a7f-2a8e-4acc-9dee-1b9fc3d488e4 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:52.558734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-ac934a7f-2a8e-4acc-9dee-1b9fc3d488e4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 08:32:52.558734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:52.558734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:52.558734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:52.558734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:52.558734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:52.558734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:52.558734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:52.558734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:52.558734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:52.558734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:52.558734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:52.558734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:32:52.558734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:32:52.558734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:32:52.558734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:32:52.559773 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:52.559773 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:52.559773 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:32:52.559773 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:52.559773 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:32:52.559773 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:52.559773 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:52.559773 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:52.559773 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:52.559773 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:52.559773 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:52.559773 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:52.559773 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:52.559773 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:52.559773 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:52.559773 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:52.559773 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:52.559773 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:52.560722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:52.560722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:52.560722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:32:52.560722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:32:52.560722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:32:52.560722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:32:52.560722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:32:52.560722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:32:52.560722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 08:32:52.560722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:52.563716 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 431/844] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:32:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:52.566070 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56615c45-80d6-4d01-ac10-53f06e289b1b None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:52.676103 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56615c45-80d6-4d01-ac10-53f06e289b1b None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:52.715637 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274e993-ee6c-486e-aee3-cbc1136a109a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:52.715637 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274e993-ee6c-486e-aee3-cbc1136a109a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:52.715637 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274e993-ee6c-486e-aee3-cbc1136a109a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:52.715637 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274e993-ee6c-486e-aee3-cbc1136a109a None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:52.716001 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6274e993-ee6c-486e-aee3-cbc1136a109a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:52.716001 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6274e993-ee6c-486e-aee3-cbc1136a109a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:52.716808 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6274e993-ee6c-486e-aee3-cbc1136a109a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:52.740590 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 414/845] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Jul 25 08:32:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:52.746236 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac934a7f-2a8e-4acc-9dee-1b9fc3d488e4 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:52.856268 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac934a7f-2a8e-4acc-9dee-1b9fc3d488e4 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:52.894625 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2bc4ed-4934-4990-a9e9-721ec3134633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:52.895559 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bc4ed-4934-4990-a9e9-721ec3134633 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:52.896043 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bc4ed-4934-4990-a9e9-721ec3134633 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:52.896471 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bc4ed-4934-4990-a9e9-721ec3134633 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:52.952264 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:52.972595 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2bc4ed-4934-4990-a9e9-721ec3134633 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:52.976599 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2bc4ed-4934-4990-a9e9-721ec3134633 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:53.080975 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 432/846] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:32:52 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 08:32:53.084722 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274e993-ee6c-486e-aee3-cbc1136a109a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:53.113190 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:53.191112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274e993-ee6c-486e-aee3-cbc1136a109a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:53.228121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd40f5-d995-402b-8301-ecc97b058f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:53.228977 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd40f5-d995-402b-8301-ecc97b058f05 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:53.229264 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd40f5-d995-402b-8301-ecc97b058f05 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:53.229595 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd40f5-d995-402b-8301-ecc97b058f05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:53.240859 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd40f5-d995-402b-8301-ecc97b058f05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:53.242314 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd40f5-d995-402b-8301-ecc97b058f05 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:53.260882 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-cadd40f5-d995-402b-8301-ecc97b058f05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:53.260882 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:53.260882 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:53.260882 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:53.260882 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:53.260882 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:53.260882 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:53.260882 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:53.260882 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:53.260882 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:53.260882 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:53.260882 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:53.260882 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:53.260882 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:53.260882 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:53.261758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:53.261758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:53.261758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:53.261758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:53.261758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:53.261758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:53.261758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:53.261758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:53.261758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:53.261758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:53.261758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:53.261758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:53.261758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:53.261758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:53.261758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:53.261758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:53.261758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:53.262644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:53.262644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:53.262644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:53.262644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:53.266838 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 415/847] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:53.268237 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2bc4ed-4934-4990-a9e9-721ec3134633 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:53.351960 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:53.371485 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2bc4ed-4934-4990-a9e9-721ec3134633 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:53.407844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403b5ec-4f00-41f3-8bd5-88c9ee658396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:53.408866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403b5ec-4f00-41f3-8bd5-88c9ee658396 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:53.409164 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403b5ec-4f00-41f3-8bd5-88c9ee658396 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:53.409493 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403b5ec-4f00-41f3-8bd5-88c9ee658396 None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:53.410180 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403b5ec-4f00-41f3-8bd5-88c9ee658396 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:53.410493 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403b5ec-4f00-41f3-8bd5-88c9ee658396 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:53.411980 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403b5ec-4f00-41f3-8bd5-88c9ee658396 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:53.427722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 433/848] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:53.429552 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd40f5-d995-402b-8301-ecc97b058f05 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:53.511316 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:53.532985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd40f5-d995-402b-8301-ecc97b058f05 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:53.568151 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d15f6f-1235-489b-b9d3-58b25bd25fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:53.568926 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d15f6f-1235-489b-b9d3-58b25bd25fc3 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:53.569208 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d15f6f-1235-489b-b9d3-58b25bd25fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:53.569483 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d15f6f-1235-489b-b9d3-58b25bd25fc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:53.576400 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d15f6f-1235-489b-b9d3-58b25bd25fc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:53.578402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d15f6f-1235-489b-b9d3-58b25bd25fc3 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:53.592659 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-c4d15f6f-1235-489b-b9d3-58b25bd25fc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:53.592659 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:53.592659 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:53.592659 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:53.592659 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:53.592659 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:53.592659 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:53.592659 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:53.592659 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:53.592659 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:53.592659 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:53.592659 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:53.592659 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:32:53.592659 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:32:53.592659 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:32:53.597328 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:32:53.597328 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:53.597328 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:53.597328 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:53.597328 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:53.597328 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:53.597328 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:53.597328 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:53.597328 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:53.597328 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:53.597328 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:53.597328 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:53.597328 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:53.597328 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:53.597328 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:53.597328 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:53.597328 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:53.598212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:32:53.598212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:32:53.598212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:32:53.598212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:32:53.598212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:32:53.598212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:32:53.598212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:53.598212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:53.598212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 416/849] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:32:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:53.603787 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403b5ec-4f00-41f3-8bd5-88c9ee658396 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:53.713362 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403b5ec-4f00-41f3-8bd5-88c9ee658396 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:53.748472 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03535158-793e-4302-a02f-cce569b0662e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:53.750104 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03535158-793e-4302-a02f-cce569b0662e None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:53.750598 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03535158-793e-4302-a02f-cce569b0662e None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:53.751115 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03535158-793e-4302-a02f-cce569b0662e None admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:53.752135 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03535158-793e-4302-a02f-cce569b0662e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:53.752669 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03535158-793e-4302-a02f-cce569b0662e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:53.754321 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03535158-793e-4302-a02f-cce569b0662e None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:53.763853 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:53.769288 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97061a-696b-48b8-9600-c74fbbc8cd6b None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:53.769831 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97061a-696b-48b8-9600-c74fbbc8cd6b None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:53.770307 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97061a-696b-48b8-9600-c74fbbc8cd6b None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:53.772078 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 434/851] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:32:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:53.772293 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 417/851] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:53.774180 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03535158-793e-4302-a02f-cce569b0662e None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:53.776625 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231f6b6-d05b-48a3-910e-86bbb7451989 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:53.777223 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231f6b6-d05b-48a3-910e-86bbb7451989 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:53.777690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231f6b6-d05b-48a3-910e-86bbb7451989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:53.798025 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-6231f6b6-d05b-48a3-910e-86bbb7451989 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:53.799555 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6231f6b6-d05b-48a3-910e-86bbb7451989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:53.872430 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 418/852] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 08:32:53.883859 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03535158-793e-4302-a02f-cce569b0662e None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:53.893865 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231f6b6-d05b-48a3-910e-86bbb7451989 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:53.921723 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf434f6-996b-4178-b866-015033708fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:53.922510 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf434f6-996b-4178-b866-015033708fb9 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:53.922798 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf434f6-996b-4178-b866-015033708fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:53.923179 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf434f6-996b-4178-b866-015033708fb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:53.924050 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf434f6-996b-4178-b866-015033708fb9 None admin] RBAC: Adding query filter params (role.id=25b0f48c10474bf6b98aad8f093868ee, scope.project.id=be349194440449209f19f6b535ffd4f6, user.id=2763e540681547d3a6677567b3be86ea) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:53.924364 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf434f6-996b-4178-b866-015033708fb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:53.925913 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf434f6-996b-4178-b866-015033708fb9 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:53.939737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 435/853] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:32:53 2022] GET /identity/v3/role_assignments?user.id=2763e540681547d3a6677567b3be86ea&scope.project.id=be349194440449209f19f6b535ffd4f6&role.id=25b0f48c10474bf6b98aad8f093868ee => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:53.980076 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:54.017138 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231f6b6-d05b-48a3-910e-86bbb7451989 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:54.056594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396da340-b9c8-4bac-a717-f07bffecf989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:54.057422 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396da340-b9c8-4bac-a717-f07bffecf989 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:54.057705 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396da340-b9c8-4bac-a717-f07bffecf989 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:54.057980 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396da340-b9c8-4bac-a717-f07bffecf989 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:54.058652 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396da340-b9c8-4bac-a717-f07bffecf989 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:54.060209 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396da340-b9c8-4bac-a717-f07bffecf989 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:54.074275 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-396da340-b9c8-4bac-a717-f07bffecf989 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 08:32:54.074275 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:54.074275 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:32:54.074275 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:32:54.074275 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:32:54.074275 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:32:54.074275 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:32:54.074275 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:32:54.074275 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 08:32:54.074275 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:54.074275 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:32:54.074275 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:54.074275 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:54.074275 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:54.074275 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:54.074275 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:54.075292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:54.075292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:54.075292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:54.075292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:54.075292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:54.075292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:54.075292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:54.075292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:32:54.075292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:32:54.075292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:32:54.075292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:32:54.075292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:54.075292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:54.075292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:54.075292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:54.075292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:54.076833 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:54.076833 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:54.076833 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:54.076833 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:54.076833 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:54.076833 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:54.076833 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:54.076833 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:54.076833 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:54.076833 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:54.076833 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:54.076833 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:32:54.076833 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:32:54.076833 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 08:32:54.076833 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:54.076833 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 419/854] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Jul 25 08:32:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:32:54.081648 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf434f6-996b-4178-b866-015033708fb9 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:54.161083 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:54.182163 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0037919-42a6-49d4-a93d-1433692d67ff None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:54.182461 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0037919-42a6-49d4-a93d-1433692d67ff None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:54.182836 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0037919-42a6-49d4-a93d-1433692d67ff None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:54.184817 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 420/855] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:32:54.190627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a2512-6882-46e0-8964-e5c3aaddf445 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:54.190915 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a2512-6882-46e0-8964-e5c3aaddf445 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:54.191198 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a2512-6882-46e0-8964-e5c3aaddf445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:54.206243 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf434f6-996b-4178-b866-015033708fb9 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:54.210072 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-814a2512-6882-46e0-8964-e5c3aaddf445 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:54.211249 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-814a2512-6882-46e0-8964-e5c3aaddf445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:54.242923 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194f7da-e4af-469d-8856-2ca18a772793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:54.244125 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194f7da-e4af-469d-8856-2ca18a772793 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:54.244641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194f7da-e4af-469d-8856-2ca18a772793 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:54.245127 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194f7da-e4af-469d-8856-2ca18a772793 None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:54.246077 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194f7da-e4af-469d-8856-2ca18a772793 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:54.246598 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194f7da-e4af-469d-8856-2ca18a772793 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:54.248224 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194f7da-e4af-469d-8856-2ca18a772793 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:54.254323 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 436/856] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Jul 25 08:32:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:54.260513 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194f7da-e4af-469d-8856-2ca18a772793 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:54.283983 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 421/857] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 08:32:54.307161 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a2512-6882-46e0-8964-e5c3aaddf445 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:54.371793 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:54.381369 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194f7da-e4af-469d-8856-2ca18a772793 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:54.411406 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:54.411900 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a2512-6882-46e0-8964-e5c3aaddf445 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:54.421822 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7de79-ff58-479d-bd68-4da3de913702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:54.426044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7de79-ff58-479d-bd68-4da3de913702 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:54.426044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7de79-ff58-479d-bd68-4da3de913702 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:54.426044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7de79-ff58-479d-bd68-4da3de913702 None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:54.426044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7de79-ff58-479d-bd68-4da3de913702 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:54.426044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7de79-ff58-479d-bd68-4da3de913702 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:54.426611 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7de79-ff58-479d-bd68-4da3de913702 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:54.440073 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 437/858] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Jul 25 08:32:54 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:54.449749 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c65b81-cd14-422b-9927-64bb09f0857f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:54.450665 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c65b81-cd14-422b-9927-64bb09f0857f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:54.451015 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c65b81-cd14-422b-9927-64bb09f0857f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:54.451358 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c65b81-cd14-422b-9927-64bb09f0857f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:54.464512 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c65b81-cd14-422b-9927-64bb09f0857f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:54.473529 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-64c65b81-cd14-422b-9927-64bb09f0857f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:54.473529 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:54.473529 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:54.473529 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:54.473529 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:54.473529 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:54.473529 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:54.473529 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:54.473529 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:54.473529 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:54.473529 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:54.473529 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:54.473529 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:54.473529 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:54.473529 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:54.473529 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:54.474561 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:54.474561 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:54.474561 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:54.474561 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:54.474561 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:54.474561 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:54.474561 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:54.474561 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:54.474561 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:54.474561 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:54.474561 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:54.474561 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:54.474561 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:54.474561 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:54.474561 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:54.474561 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:54.475416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:54.475416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:54.475416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:54.475416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:54.475416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:54.475416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:54.475416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:54.475416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:54.475416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:54.475416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:54.475416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:32:54.475416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:54.475416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 422/859] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 08:32:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:32:54.480954 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7de79-ff58-479d-bd68-4da3de913702 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:54.582344 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc0d90-7222-4506-9561-76823ec2b77d None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:54.582650 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc0d90-7222-4506-9561-76823ec2b77d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:54.582939 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc0d90-7222-4506-9561-76823ec2b77d None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:54.584435 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 423/860] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:32:54.593797 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfaf111-12b6-4846-b034-38a1050d9371 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:54.593797 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfaf111-12b6-4846-b034-38a1050d9371 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:54.593797 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfaf111-12b6-4846-b034-38a1050d9371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:54.596073 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7de79-ff58-479d-bd68-4da3de913702 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:54.614991 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-9dfaf111-12b6-4846-b034-38a1050d9371 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:54.616633 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9dfaf111-12b6-4846-b034-38a1050d9371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:54.637440 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc063d6a-aa96-4739-abfa-f6dbec19108c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:54.638115 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc063d6a-aa96-4739-abfa-f6dbec19108c None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:54.638401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc063d6a-aa96-4739-abfa-f6dbec19108c None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:54.638677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc063d6a-aa96-4739-abfa-f6dbec19108c None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:54.639493 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc063d6a-aa96-4739-abfa-f6dbec19108c None admin] RBAC: Adding query filter params (name=service) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:54.640813 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc063d6a-aa96-4739-abfa-f6dbec19108c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:54.642228 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc063d6a-aa96-4739-abfa-f6dbec19108c None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:54.654063 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 438/861] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 08:32:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:54.659294 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc063d6a-aa96-4739-abfa-f6dbec19108c None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:54.720373 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 424/862] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:32:54.736865 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:54.743166 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfaf111-12b6-4846-b034-38a1050d9371 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:54.785744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc063d6a-aa96-4739-abfa-f6dbec19108c None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:54.802425 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:54.822222 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39301254-3dd0-428a-b3b0-69c11b16070e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:54.823378 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39301254-3dd0-428a-b3b0-69c11b16070e None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:54.823893 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39301254-3dd0-428a-b3b0-69c11b16070e None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:54.824343 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39301254-3dd0-428a-b3b0-69c11b16070e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:54.835896 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39301254-3dd0-428a-b3b0-69c11b16070e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:54.837649 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39301254-3dd0-428a-b3b0-69c11b16070e None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:54.855389 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-39301254-3dd0-428a-b3b0-69c11b16070e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:54.855389 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:54.855389 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:54.855389 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:54.855389 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:54.855389 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:54.855389 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:54.855389 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:54.855389 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:54.855389 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:54.855389 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:54.855389 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:54.855389 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:54.855389 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:54.855389 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:54.856320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:54.856320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:54.856320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:54.856320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:54.856320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:54.856320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:54.856320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:54.856320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:54.856320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:54.856320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:54.856320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:54.856320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:54.856320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:54.856320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:54.856320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:54.856320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:54.856320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:54.857190 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:54.857190 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:54.857190 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:54.857190 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:54.857403 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfaf111-12b6-4846-b034-38a1050d9371 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:54.864904 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 439/863] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:54.865972 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39301254-3dd0-428a-b3b0-69c11b16070e None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:54.895170 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0247f-89c6-448a-800a-fb8c082fb7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:54.895865 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0247f-89c6-448a-800a-fb8c082fb7d9 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:54.896150 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0247f-89c6-448a-800a-fb8c082fb7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:54.896427 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0247f-89c6-448a-800a-fb8c082fb7d9 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:54.897159 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0247f-89c6-448a-800a-fb8c082fb7d9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:54.898592 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0247f-89c6-448a-800a-fb8c082fb7d9 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:54.974271 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39301254-3dd0-428a-b3b0-69c11b16070e None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:54.987144 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:54.994986 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 425/864] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jul 25 08:32:54 2022] POST /identity/v3/services => generated 251 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:32:55.020187 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c397d-6f2c-410d-a87d-ea12edffa85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:55.020994 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c397d-6f2c-410d-a87d-ea12edffa85c None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:55.021237 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c397d-6f2c-410d-a87d-ea12edffa85c None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:55.021513 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c397d-6f2c-410d-a87d-ea12edffa85c None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:55.028150 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c397d-6f2c-410d-a87d-ea12edffa85c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:55.028150 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c397d-6f2c-410d-a87d-ea12edffa85c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:55.028150 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c397d-6f2c-410d-a87d-ea12edffa85c None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:55.040048 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 440/865] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:55.045917 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0247f-89c6-448a-800a-fb8c082fb7d9 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:55.163258 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0247f-89c6-448a-800a-fb8c082fb7d9 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:55.177106 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:55.198967 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f6dce-f4e7-4361-b554-309b32368d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:55.199902 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f6dce-f4e7-4361-b554-309b32368d3b None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:55.200319 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f6dce-f4e7-4361-b554-309b32368d3b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:55.200603 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f6dce-f4e7-4361-b554-309b32368d3b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:55.209773 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f6dce-f4e7-4361-b554-309b32368d3b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:55.211286 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f6dce-f4e7-4361-b554-309b32368d3b None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:55.228272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-c09f6dce-f4e7-4361-b554-309b32368d3b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 08:32:55.228272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:55.228272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:55.228272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:55.228272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:55.228272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:55.228272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:55.228272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:55.228272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:55.228272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:55.228272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:55.228272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:55.228272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:32:55.228272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:32:55.228272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:32:55.228272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:32:55.229221 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:55.229221 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:55.229221 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:32:55.229221 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:55.229221 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:32:55.229221 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:55.229221 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:55.229221 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:55.229221 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:55.229221 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:55.229221 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:55.229221 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:55.229221 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:55.229221 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:55.229221 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:55.229221 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:55.229221 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:55.229221 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:55.230141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:55.230141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:55.230141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:32:55.230141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:32:55.230141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:32:55.230141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:32:55.230141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:32:55.230141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:32:55.230141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 08:32:55.230141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:55.230141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 426/866] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Jul 25 08:32:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:55.234436 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c397d-6f2c-410d-a87d-ea12edffa85c None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:55.336926 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c397d-6f2c-410d-a87d-ea12edffa85c None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:55.371648 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4cfd6b-5c18-4de8-a981-e7516eab0140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:55.372322 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cfd6b-5c18-4de8-a981-e7516eab0140 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:55.372600 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cfd6b-5c18-4de8-a981-e7516eab0140 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:55.372872 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cfd6b-5c18-4de8-a981-e7516eab0140 None admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:55.373704 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4cfd6b-5c18-4de8-a981-e7516eab0140 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:55.374616 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4cfd6b-5c18-4de8-a981-e7516eab0140 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:55.376221 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4cfd6b-5c18-4de8-a981-e7516eab0140 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:55.393678 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 441/867] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Jul 25 08:32:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:55.399346 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f6dce-f4e7-4361-b554-309b32368d3b None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:55.502286 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f6dce-f4e7-4361-b554-309b32368d3b None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:55.537503 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8dbcf-4e0d-445a-bf95-5e64150b18d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:55.538149 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8dbcf-4e0d-445a-bf95-5e64150b18d4 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:55.538432 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8dbcf-4e0d-445a-bf95-5e64150b18d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:55.538708 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8dbcf-4e0d-445a-bf95-5e64150b18d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:55.580674 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:55.607722 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8dbcf-4e0d-445a-bf95-5e64150b18d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:55.609348 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8dbcf-4e0d-445a-bf95-5e64150b18d4 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:55.713541 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 427/868] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:32:55 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 08:32:55.719590 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4cfd6b-5c18-4de8-a981-e7516eab0140 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:55.748005 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:55.821188 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4cfd6b-5c18-4de8-a981-e7516eab0140 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:55.855639 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f535ed6-79b5-4078-9308-3d7fbcc90bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:55.856438 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f535ed6-79b5-4078-9308-3d7fbcc90bf7 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:55.856719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f535ed6-79b5-4078-9308-3d7fbcc90bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:55.856993 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f535ed6-79b5-4078-9308-3d7fbcc90bf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:55.866973 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f535ed6-79b5-4078-9308-3d7fbcc90bf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:55.868432 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f535ed6-79b5-4078-9308-3d7fbcc90bf7 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:55.886060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-7f535ed6-79b5-4078-9308-3d7fbcc90bf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:55.886060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:55.886060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:55.886060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:55.886060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:55.886060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:55.886060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:55.886060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:55.886060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:55.886060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:55.886060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:55.886060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:55.886060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:55.886060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:55.886060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:55.886940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:55.886940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:55.886940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:55.886940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:55.886940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:55.886940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:55.886940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:55.886940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:55.886940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:55.886940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:55.886940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:55.886940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:55.886940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:55.886940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:55.886940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:55.886940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:55.886940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:55.887866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:55.887866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:55.887866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:55.887866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:55.887866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 442/869] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:55.893086 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8dbcf-4e0d-445a-bf95-5e64150b18d4 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:55.972711 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:55.995134 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8dbcf-4e0d-445a-bf95-5e64150b18d4 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:56.031891 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae50376-5ed2-41e7-8d35-28609c94706a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:56.032910 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae50376-5ed2-41e7-8d35-28609c94706a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:56.033668 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae50376-5ed2-41e7-8d35-28609c94706a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:56.034143 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae50376-5ed2-41e7-8d35-28609c94706a None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:56.035100 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae50376-5ed2-41e7-8d35-28609c94706a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:56.035626 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae50376-5ed2-41e7-8d35-28609c94706a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:56.037183 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae50376-5ed2-41e7-8d35-28609c94706a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:56.049919 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 428/870] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:56.057763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f535ed6-79b5-4078-9308-3d7fbcc90bf7 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:56.062275 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38f7ea-2057-4d55-aea4-d7e94efa7219 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:56.062814 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38f7ea-2057-4d55-aea4-d7e94efa7219 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:56.063294 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38f7ea-2057-4d55-aea4-d7e94efa7219 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:56.065255 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 429/871] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:32:56.069966 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ce0f2-a8fe-4e5c-bb1a-fb4872fdfc6e None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:56.070477 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ce0f2-a8fe-4e5c-bb1a-fb4872fdfc6e None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:56.071086 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ce0f2-a8fe-4e5c-bb1a-fb4872fdfc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:56.091111 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-b87ce0f2-a8fe-4e5c-bb1a-fb4872fdfc6e None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:56.092649 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b87ce0f2-a8fe-4e5c-bb1a-fb4872fdfc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:56.129185 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:56.174252 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f535ed6-79b5-4078-9308-3d7fbcc90bf7 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:56.175591 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 430/872] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:56 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 08:32:56.197321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ce0f2-a8fe-4e5c-bb1a-fb4872fdfc6e None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:56.212874 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fedfd-3073-4dff-84a9-1a8a4b94d43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:56.213686 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fedfd-3073-4dff-84a9-1a8a4b94d43e None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:56.213970 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fedfd-3073-4dff-84a9-1a8a4b94d43e None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:56.214252 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fedfd-3073-4dff-84a9-1a8a4b94d43e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:56.225006 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1fedfd-3073-4dff-84a9-1a8a4b94d43e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:56.226991 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1fedfd-3073-4dff-84a9-1a8a4b94d43e None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:56.244294 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-ea1fedfd-3073-4dff-84a9-1a8a4b94d43e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:56.244294 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:56.244294 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:56.244294 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:56.244294 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:56.244294 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:56.244294 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:56.244294 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:56.244294 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:56.244294 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:56.244294 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:56.244294 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:56.244294 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:32:56.244294 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:32:56.244294 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:32:56.245681 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:32:56.245681 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:56.245681 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:56.245681 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:56.245681 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:56.245681 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:56.245681 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:56.245681 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:56.245681 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:56.245681 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:56.245681 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:56.245681 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:56.245681 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:56.245681 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:56.245681 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:56.245681 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:56.245681 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:56.246554 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:32:56.246554 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:32:56.246554 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:32:56.246554 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:32:56.246554 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:32:56.246554 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:32:56.246554 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:32:56.246554 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:56.249103 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 443/873] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:32:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:56.257226 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fedfd-3073-4dff-84a9-1a8a4b94d43e None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:56.280073 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:56.332055 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ce0f2-a8fe-4e5c-bb1a-fb4872fdfc6e None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:56.370868 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f6af3-c117-4561-bf18-ad92210d0770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:56.371710 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fedfd-3073-4dff-84a9-1a8a4b94d43e None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:56.372385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f6af3-c117-4561-bf18-ad92210d0770 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:56.372887 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f6af3-c117-4561-bf18-ad92210d0770 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:56.373453 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f6af3-c117-4561-bf18-ad92210d0770 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:56.374665 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f6af3-c117-4561-bf18-ad92210d0770 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:56.376266 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f6af3-c117-4561-bf18-ad92210d0770 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:56.390629 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-b62f6af3-c117-4561-bf18-ad92210d0770 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 08:32:56.390629 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:56.390629 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:32:56.390629 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:32:56.390629 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:32:56.390629 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:32:56.390629 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:32:56.390629 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:32:56.390629 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 08:32:56.390629 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:56.390629 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:32:56.390629 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:56.390629 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:56.390629 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:56.390629 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:56.390629 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:56.390629 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:56.391740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:56.391740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:56.391740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:56.391740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:56.391740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:56.391740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:56.391740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:32:56.391740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:32:56.391740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:32:56.391740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:32:56.391740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:56.391740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:56.391740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:56.391740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:56.391740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:56.391740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:56.392582 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:56.392582 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:56.392582 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:56.392582 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:56.392582 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:56.392582 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:56.392582 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:56.392582 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:56.392582 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:56.392582 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:56.392582 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:32:56.392582 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:32:56.392582 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 08:32:56.392582 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:56.395554 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 431/874] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Jul 25 08:32:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:32:56.401215 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f6af3-c117-4561-bf18-ad92210d0770 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:56.405697 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:56.412898 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97fa45-e40d-44dd-9e54-1d5ba3533179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:56.413765 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97fa45-e40d-44dd-9e54-1d5ba3533179 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:56.414204 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97fa45-e40d-44dd-9e54-1d5ba3533179 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:56.421792 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97fa45-e40d-44dd-9e54-1d5ba3533179 None admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:56.421792 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97fa45-e40d-44dd-9e54-1d5ba3533179 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:56.421792 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97fa45-e40d-44dd-9e54-1d5ba3533179 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:56.421792 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97fa45-e40d-44dd-9e54-1d5ba3533179 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:56.436305 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 444/875] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:32:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:32:56.442359 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97fa45-e40d-44dd-9e54-1d5ba3533179 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:56.533376 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f6af3-c117-4561-bf18-ad92210d0770 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:56.564174 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97fa45-e40d-44dd-9e54-1d5ba3533179 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:56.572511 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:56.584064 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24aec5e-d439-440c-a61f-0dd3528db6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:56.584732 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24aec5e-d439-440c-a61f-0dd3528db6ad None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:56.585021 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24aec5e-d439-440c-a61f-0dd3528db6ad None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:56.585299 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24aec5e-d439-440c-a61f-0dd3528db6ad None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:56.586443 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24aec5e-d439-440c-a61f-0dd3528db6ad None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:56.587040 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24aec5e-d439-440c-a61f-0dd3528db6ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:56.588607 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24aec5e-d439-440c-a61f-0dd3528db6ad None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:56.595768 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 432/876] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Jul 25 08:32:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:56.597045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fc581-2cab-4b38-99a4-f55d0ca8fbf2 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:56.597337 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fc581-2cab-4b38-99a4-f55d0ca8fbf2 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:56.597612 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fc581-2cab-4b38-99a4-f55d0ca8fbf2 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:56.599039 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 433/877] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:56.603928 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fc581-2cab-4b38-99a4-f55d0ca8fbf2 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:56.607227 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ea566-989d-4035-807a-ce5b7fe37592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:56.608982 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ea566-989d-4035-807a-ce5b7fe37592 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:56.609271 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ea566-989d-4035-807a-ce5b7fe37592 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:56.609551 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ea566-989d-4035-807a-ce5b7fe37592 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:56.610398 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ea566-989d-4035-807a-ce5b7fe37592 None admin] RBAC: Adding query filter params (role.id=a0a4f5f9b3264740a55056fed8fd7a33, scope.project.id=be349194440449209f19f6b535ffd4f6, user.id=b3c1d56bc0a64411a68f97a4417b0379) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:56.610714 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ea566-989d-4035-807a-ce5b7fe37592 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:56.612190 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ea566-989d-4035-807a-ce5b7fe37592 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:56.627723 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 445/878] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:32:56 2022] GET /identity/v3/role_assignments?user.id=b3c1d56bc0a64411a68f97a4417b0379&scope.project.id=be349194440449209f19f6b535ffd4f6&role.id=a0a4f5f9b3264740a55056fed8fd7a33 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:32:56.627723 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e17dab-16f4-4f0b-ab41-334c443e6f14 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:56.627723 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e17dab-16f4-4f0b-ab41-334c443e6f14 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:56.627723 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e17dab-16f4-4f0b-ab41-334c443e6f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:56.642489 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-15e17dab-16f4-4f0b-ab41-334c443e6f14 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:56.643836 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-15e17dab-16f4-4f0b-ab41-334c443e6f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:56.716734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:56.736031 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 446/879] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:56 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:32:56.763437 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e17dab-16f4-4f0b-ab41-334c443e6f14 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:56.773652 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fc581-2cab-4b38-99a4-f55d0ca8fbf2 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:56.819000 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c695ce-46d7-4be7-9499-5d1511b21f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:56.820097 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c695ce-46d7-4be7-9499-5d1511b21f44 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:56.820589 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c695ce-46d7-4be7-9499-5d1511b21f44 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:56.821088 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c695ce-46d7-4be7-9499-5d1511b21f44 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:56.822005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c695ce-46d7-4be7-9499-5d1511b21f44 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:56.822529 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c695ce-46d7-4be7-9499-5d1511b21f44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:56.824850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c695ce-46d7-4be7-9499-5d1511b21f44 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:56.831568 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 434/880] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Jul 25 08:32:56 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:56.887454 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e17dab-16f4-4f0b-ab41-334c443e6f14 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:56.930431 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57255961-bd21-4d4c-94cb-465243e326bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:56.931120 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57255961-bd21-4d4c-94cb-465243e326bc None admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:56.931474 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57255961-bd21-4d4c-94cb-465243e326bc None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:56.931789 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57255961-bd21-4d4c-94cb-465243e326bc None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:56.932596 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57255961-bd21-4d4c-94cb-465243e326bc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:56.934066 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57255961-bd21-4d4c-94cb-465243e326bc None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:57.044500 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 447/881] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jul 25 08:32:56 2022] POST /identity/v3/services => generated 269 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:32:57.167199 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e563af-bcf9-4c06-bb89-855597f98c6e None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:57.167398 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e563af-bcf9-4c06-bb89-855597f98c6e None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:57.167752 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e563af-bcf9-4c06-bb89-855597f98c6e None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:57.169428 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 435/882] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:57.175288 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b60ea-9fff-4894-8604-27eb5abd6695 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:57.175578 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b60ea-9fff-4894-8604-27eb5abd6695 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:57.175886 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b60ea-9fff-4894-8604-27eb5abd6695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:57.197185 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-af0b60ea-9fff-4894-8604-27eb5abd6695 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:57.198387 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-af0b60ea-9fff-4894-8604-27eb5abd6695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:57.245687 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:57.277604 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 448/883] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:32:57.301810 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e563af-bcf9-4c06-bb89-855597f98c6e None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:57.363496 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:57.412815 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e563af-bcf9-4c06-bb89-855597f98c6e None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:57.448210 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbaf6a-ff54-4be0-b120-b69878858a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:57.448928 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbaf6a-ff54-4be0-b120-b69878858a0b None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:57.449216 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbaf6a-ff54-4be0-b120-b69878858a0b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:57.449496 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbaf6a-ff54-4be0-b120-b69878858a0b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:57.450158 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fbaf6a-ff54-4be0-b120-b69878858a0b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:57.451514 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fbaf6a-ff54-4be0-b120-b69878858a0b None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:57.464229 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-d2fbaf6a-ff54-4be0-b120-b69878858a0b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 08:32:57.464229 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:57.464229 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:32:57.464229 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:32:57.464229 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:32:57.464229 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:32:57.464229 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:32:57.464229 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:32:57.464229 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 08:32:57.464229 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:57.464229 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:32:57.464229 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:57.464229 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:57.464229 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:57.464229 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:57.464229 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:57.464229 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:57.465475 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:57.465475 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:57.465475 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:57.465475 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:57.465475 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:57.465475 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:57.465475 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:32:57.465475 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:32:57.465475 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:32:57.465475 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:32:57.465475 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:57.465475 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:57.465475 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:57.465475 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:57.465475 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:57.465475 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:57.466591 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:57.466591 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:57.466591 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:57.466591 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:57.466591 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:57.466591 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:57.466591 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:57.466591 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:57.466591 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:57.466591 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:57.466591 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:32:57.466591 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:32:57.466591 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 08:32:57.466591 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:57.466591 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 436/884] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 08:32:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:57.472711 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b60ea-9fff-4894-8604-27eb5abd6695 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:57.584299 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b60ea-9fff-4894-8604-27eb5abd6695 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:57.621389 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd52143-ceb4-42ad-92ca-6240cf4845eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:57.622307 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd52143-ceb4-42ad-92ca-6240cf4845eb None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:57.622779 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd52143-ceb4-42ad-92ca-6240cf4845eb None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:57.623206 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd52143-ceb4-42ad-92ca-6240cf4845eb None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:57.624576 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd52143-ceb4-42ad-92ca-6240cf4845eb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:57.625045 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd52143-ceb4-42ad-92ca-6240cf4845eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:57.626584 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd52143-ceb4-42ad-92ca-6240cf4845eb None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:57.632021 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 449/885] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 08:32:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:57.638151 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbaf6a-ff54-4be0-b120-b69878858a0b None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:57.744794 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbaf6a-ff54-4be0-b120-b69878858a0b None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:57.762473 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:57.779947 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca28fe-1ea6-46f3-bb67-84ac48969cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:57.780712 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca28fe-1ea6-46f3-bb67-84ac48969cc1 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:57.781003 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca28fe-1ea6-46f3-bb67-84ac48969cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:57.781281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca28fe-1ea6-46f3-bb67-84ac48969cc1 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:57.781997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca28fe-1ea6-46f3-bb67-84ac48969cc1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:57.782311 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca28fe-1ea6-46f3-bb67-84ac48969cc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:57.784007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca28fe-1ea6-46f3-bb67-84ac48969cc1 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:57.789541 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 437/886] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 08:32:57 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:57.795409 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd52143-ceb4-42ad-92ca-6240cf4845eb None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:57.833690 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:57.904418 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd52143-ceb4-42ad-92ca-6240cf4845eb None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:57.941437 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc2a20-6114-42d6-aa6a-afdcb4b7495f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:57.942109 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc2a20-6114-42d6-aa6a-afdcb4b7495f None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:57.942395 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc2a20-6114-42d6-aa6a-afdcb4b7495f None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:57.942674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc2a20-6114-42d6-aa6a-afdcb4b7495f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:57.943473 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc2a20-6114-42d6-aa6a-afdcb4b7495f None admin] RBAC: Adding query filter params (interface=public, service_id=d8d2573948af48c881f491ca4307f625, region_id=RegionOne) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:57.943817 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc2a20-6114-42d6-aa6a-afdcb4b7495f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:57.945192 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc2a20-6114-42d6-aa6a-afdcb4b7495f None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:57.950798 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 450/887] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Jul 25 08:32:57 2022] GET /identity/v3/endpoints?service_id=d8d2573948af48c881f491ca4307f625&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:57.956361 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca28fe-1ea6-46f3-bb67-84ac48969cc1 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:58.061800 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca28fe-1ea6-46f3-bb67-84ac48969cc1 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:58.096153 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffa1c7-3db4-40d6-8814-b6956a50e4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:58.097152 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffa1c7-3db4-40d6-8814-b6956a50e4e7 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:58.097642 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffa1c7-3db4-40d6-8814-b6956a50e4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:58.098121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffa1c7-3db4-40d6-8814-b6956a50e4e7 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:58.099003 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ffa1c7-3db4-40d6-8814-b6956a50e4e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:58.100592 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ffa1c7-3db4-40d6-8814-b6956a50e4e7 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:58.106874 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 438/888] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Jul 25 08:32:57 2022] GET /identity/v3/services => generated 1268 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:32:58.814562 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee884d-7913-44d5-8a57-17053c34c69f None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:58.815078 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee884d-7913-44d5-8a57-17053c34c69f None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:58.815190 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee884d-7913-44d5-8a57-17053c34c69f None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:58.816759 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 451/889] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:58.822000 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca0637-0c03-46e1-96ac-c2f3f32b0286 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:58.822418 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca0637-0c03-46e1-96ac-c2f3f32b0286 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:58.822609 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca0637-0c03-46e1-96ac-c2f3f32b0286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:58.841492 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-78ca0637-0c03-46e1-96ac-c2f3f32b0286 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:58.843209 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-78ca0637-0c03-46e1-96ac-c2f3f32b0286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:58.890826 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:58.903415 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00190c-3274-4333-be21-81e93124b532 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:58.903746 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00190c-3274-4333-be21-81e93124b532 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:58.904031 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00190c-3274-4333-be21-81e93124b532 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:58.906242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 452/890] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:32:58.911385 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178cdbb-a7fc-4120-84ae-81ef1b3b7db4 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:58.911712 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178cdbb-a7fc-4120-84ae-81ef1b3b7db4 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:58.912000 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178cdbb-a7fc-4120-84ae-81ef1b3b7db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:58.917005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 439/891] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:32:58.935097 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-0178cdbb-a7fc-4120-84ae-81ef1b3b7db4 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:58.936319 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-0178cdbb-a7fc-4120-84ae-81ef1b3b7db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:58.940563 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca0637-0c03-46e1-96ac-c2f3f32b0286 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:59.013409 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 453/892] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 08:32:59.037387 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178cdbb-a7fc-4120-84ae-81ef1b3b7db4 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:59.049435 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca0637-0c03-46e1-96ac-c2f3f32b0286 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:59.067225 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:59.091946 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace792b7-a158-4bae-b631-39aceefc90ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:59.093944 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace792b7-a158-4bae-b631-39aceefc90ff None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:59.094466 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace792b7-a158-4bae-b631-39aceefc90ff None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:59.094958 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace792b7-a158-4bae-b631-39aceefc90ff None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:59.109040 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace792b7-a158-4bae-b631-39aceefc90ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:32:59.120036 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-ace792b7-a158-4bae-b631-39aceefc90ff None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 08:32:59.120036 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:59.120036 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:59.120036 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:59.120036 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:59.120036 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:59.120036 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:59.120036 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:59.120036 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:59.120036 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:59.120036 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:59.120036 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:59.120036 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:32:59.120036 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:32:59.120036 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:32:59.120036 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:32:59.120997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:32:59.120997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:32:59.120997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:32:59.120997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:32:59.120997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:59.120997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:59.120997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:59.120997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:59.120997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:59.120997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:59.120997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:59.120997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:59.120997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:59.120997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:59.120997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:59.120997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:59.121824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:59.121824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:59.121824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:59.121824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:59.121824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:32:59.121824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:32:59.121824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:32:59.121824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:32:59.121824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:32:59.121824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:32:59.121824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 08:32:59.121824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:59.129568 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 440/893] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Jul 25 08:32:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:32:59.131197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace792b7-a158-4bae-b631-39aceefc90ff None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:59.154531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178cdbb-a7fc-4120-84ae-81ef1b3b7db4 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:59.169851 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:59.193110 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b349553-d99d-4513-ae16-f71f0a2020da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:59.193734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b349553-d99d-4513-ae16-f71f0a2020da None admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:59.194015 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b349553-d99d-4513-ae16-f71f0a2020da None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:59.194289 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b349553-d99d-4513-ae16-f71f0a2020da None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:59.195008 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b349553-d99d-4513-ae16-f71f0a2020da None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:59.196387 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b349553-d99d-4513-ae16-f71f0a2020da None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:59.235344 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace792b7-a158-4bae-b631-39aceefc90ff None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:59.268722 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006e8a0-8df2-4112-b9d4-6f148edb3d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:59.269326 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006e8a0-8df2-4112-b9d4-6f148edb3d3c None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:59.269611 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006e8a0-8df2-4112-b9d4-6f148edb3d3c None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:59.269893 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006e8a0-8df2-4112-b9d4-6f148edb3d3c None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:59.270662 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2006e8a0-8df2-4112-b9d4-6f148edb3d3c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:59.270976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2006e8a0-8df2-4112-b9d4-6f148edb3d3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:59.272423 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2006e8a0-8df2-4112-b9d4-6f148edb3d3c None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:59.273745 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 454/894] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jul 25 08:32:59 2022] POST /identity/v3/services => generated 241 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:32:59.275323 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509dffc-1891-4d34-93ea-676c405074ad None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:59.275631 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509dffc-1891-4d34-93ea-676c405074ad None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:59.275942 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509dffc-1891-4d34-93ea-676c405074ad None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:59.277499 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 455/895] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:32:59.284556 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b9e2b-fd34-4319-92d8-43247c494b31 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:59.284869 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b9e2b-fd34-4319-92d8-43247c494b31 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:59.285121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b9e2b-fd34-4319-92d8-43247c494b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:59.292511 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 441/896] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Jul 25 08:32:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:32:59.300850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006e8a0-8df2-4112-b9d4-6f148edb3d3c None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:59.311893 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-435b9e2b-fd34-4319-92d8-43247c494b31 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:32:59.313590 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-435b9e2b-fd34-4319-92d8-43247c494b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:32:59.416081 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 456/897] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:32:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:32:59.418136 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006e8a0-8df2-4112-b9d4-6f148edb3d3c None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:59.420161 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:59.435357 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b9e2b-fd34-4319-92d8-43247c494b31 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:59.456398 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:59.457676 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac07be9-6569-49e0-8904-51c98be86c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:59.458486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac07be9-6569-49e0-8904-51c98be86c21 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:59.458750 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac07be9-6569-49e0-8904-51c98be86c21 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:59.459025 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac07be9-6569-49e0-8904-51c98be86c21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:59.472714 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac07be9-6569-49e0-8904-51c98be86c21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:59.474439 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac07be9-6569-49e0-8904-51c98be86c21 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:59.494432 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-cac07be9-6569-49e0-8904-51c98be86c21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:59.494432 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:59.494432 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:59.494432 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:59.494432 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:59.494432 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:59.494432 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:59.494432 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:59.494432 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:59.494432 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:59.494432 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:59.494432 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:59.494432 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:32:59.494432 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:32:59.494432 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:32:59.495355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:32:59.495355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:59.495355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:59.495355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:59.495355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:59.495355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:59.495355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:59.495355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:59.495355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:59.495355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:59.495355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:59.495355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:59.495355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:59.495355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:59.495355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:59.495355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:59.495355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:59.496683 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:32:59.496683 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:32:59.496683 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:32:59.496683 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:59.496683 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 442/898] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:32:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:59.502264 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac07be9-6569-49e0-8904-51c98be86c21 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:59.561238 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b9e2b-fd34-4319-92d8-43247c494b31 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:59.597766 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469dc08-9642-499c-9d8d-fa0b21d7d5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:59.598927 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469dc08-9642-499c-9d8d-fa0b21d7d5b3 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:59.599387 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469dc08-9642-499c-9d8d-fa0b21d7d5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:59.599867 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469dc08-9642-499c-9d8d-fa0b21d7d5b3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:59.600697 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469dc08-9642-499c-9d8d-fa0b21d7d5b3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:59.602252 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469dc08-9642-499c-9d8d-fa0b21d7d5b3 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:59.615656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-4469dc08-9642-499c-9d8d-fa0b21d7d5b3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 08:32:59.615656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:59.615656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:32:59.615656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:32:59.615656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:32:59.615656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:32:59.615656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:32:59.615656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:32:59.615656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 08:32:59.615656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:59.615656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:32:59.615656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:59.615656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:59.615656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:59.615656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:59.615656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:59.616597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:59.616597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:59.616597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:59.616597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:59.616597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:59.616597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:59.616597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:59.616597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:32:59.616597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:32:59.616597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:32:59.616597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:32:59.616597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:59.616597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:59.616597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:59.616597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:59.616597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:59.617416 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:59.617416 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:59.617416 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:59.617416 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:59.617416 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:59.617416 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:59.617416 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:59.617416 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:59.617416 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:59.617416 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:59.617416 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:59.617416 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:32:59.617416 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:32:59.617416 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 08:32:59.617416 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:32:59.623867 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 457/899] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Jul 25 08:32:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:59.626303 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469dc08-9642-499c-9d8d-fa0b21d7d5b3 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:59.634061 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac07be9-6569-49e0-8904-51c98be86c21 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:59.683058 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb31c8-13c5-4ce3-bdb3-1fa240a4cb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:59.683758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb31c8-13c5-4ce3-bdb3-1fa240a4cb44 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:59.684048 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb31c8-13c5-4ce3-bdb3-1fa240a4cb44 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:59.684327 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb31c8-13c5-4ce3-bdb3-1fa240a4cb44 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:59.685585 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb31c8-13c5-4ce3-bdb3-1fa240a4cb44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:59.685904 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb31c8-13c5-4ce3-bdb3-1fa240a4cb44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:59.687637 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb31c8-13c5-4ce3-bdb3-1fa240a4cb44 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:59.709319 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 443/900] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:59.716250 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb31c8-13c5-4ce3-bdb3-1fa240a4cb44 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:59.731506 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:59.735822 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:32:59.752792 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469dc08-9642-499c-9d8d-fa0b21d7d5b3 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:59.790810 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67a99d-675c-4b38-a08a-11efa1e7e5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:59.791890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67a99d-675c-4b38-a08a-11efa1e7e5d0 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:59.792179 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67a99d-675c-4b38-a08a-11efa1e7e5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:59.792456 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67a99d-675c-4b38-a08a-11efa1e7e5d0 None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:59.793227 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67a99d-675c-4b38-a08a-11efa1e7e5d0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:59.793536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67a99d-675c-4b38-a08a-11efa1e7e5d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:59.794956 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67a99d-675c-4b38-a08a-11efa1e7e5d0 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:59.805618 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 458/901] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Jul 25 08:32:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:32:59.806920 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67a99d-675c-4b38-a08a-11efa1e7e5d0 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:59.857358 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb31c8-13c5-4ce3-bdb3-1fa240a4cb44 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:59.900684 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aad507-d3ab-4d87-bdc9-582e19823d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:59.901955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aad507-d3ab-4d87-bdc9-582e19823d7f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:59.902492 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aad507-d3ab-4d87-bdc9-582e19823d7f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:59.902968 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aad507-d3ab-4d87-bdc9-582e19823d7f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:59.911450 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aad507-d3ab-4d87-bdc9-582e19823d7f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:59.913296 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aad507-d3ab-4d87-bdc9-582e19823d7f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:59.921872 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67a99d-675c-4b38-a08a-11efa1e7e5d0 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:32:59.929202 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-e6aad507-d3ab-4d87-bdc9-582e19823d7f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 08:32:59.929202 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:32:59.929202 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:32:59.929202 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:32:59.929202 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:32:59.929202 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:32:59.929202 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:32:59.929202 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:32:59.929202 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:32:59.929202 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:32:59.929202 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:32:59.929202 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:32:59.929202 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:32:59.929202 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:32:59.929202 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:32:59.929202 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:32:59.930104 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:32:59.930104 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:32:59.930104 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:32:59.930104 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:59.930104 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:32:59.930104 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:32:59.930104 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:32:59.930104 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:32:59.930104 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:32:59.930104 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:32:59.930104 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:32:59.930104 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:32:59.930104 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:32:59.930104 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:32:59.930104 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:32:59.930104 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:32:59.930104 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:32:59.930104 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:32:59.931032 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:32:59.931032 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:32:59.931032 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:32:59.931032 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:32:59.931032 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:32:59.931032 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:32:59.931032 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:32:59.931032 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:32:59.931032 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 08:32:59.931032 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:32:59.938074 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 444/902] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Jul 25 08:32:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:32:59.939188 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aad507-d3ab-4d87-bdc9-582e19823d7f None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:59.961774 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427d1cf-a867-47fb-91cd-5f1e3f01c4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:32:59.962449 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427d1cf-a867-47fb-91cd-5f1e3f01c4a6 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:32:59.962736 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427d1cf-a867-47fb-91cd-5f1e3f01c4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:32:59.963014 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427d1cf-a867-47fb-91cd-5f1e3f01c4a6 None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:32:59.964039 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427d1cf-a867-47fb-91cd-5f1e3f01c4a6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:32:59.964353 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427d1cf-a867-47fb-91cd-5f1e3f01c4a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:32:59.966033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427d1cf-a867-47fb-91cd-5f1e3f01c4a6 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:32:59.974962 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 459/903] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Jul 25 08:32:59 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:32:59.980423 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427d1cf-a867-47fb-91cd-5f1e3f01c4a6 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:32:59.996353 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:00.018197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:00.050691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aad507-d3ab-4d87-bdc9-582e19823d7f None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:00.089484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1cfd8-13c1-46dc-bd3a-d07b25a7bfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:00.090973 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1cfd8-13c1-46dc-bd3a-d07b25a7bfad None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:00.091705 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1cfd8-13c1-46dc-bd3a-d07b25a7bfad None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:00.092187 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1cfd8-13c1-46dc-bd3a-d07b25a7bfad None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:00.093344 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e1cfd8-13c1-46dc-bd3a-d07b25a7bfad None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:00.093869 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e1cfd8-13c1-46dc-bd3a-d07b25a7bfad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:00.095570 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e1cfd8-13c1-46dc-bd3a-d07b25a7bfad None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:00.114834 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 445/904] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Jul 25 08:32:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:00.120528 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1cfd8-13c1-46dc-bd3a-d07b25a7bfad None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:00.121809 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427d1cf-a867-47fb-91cd-5f1e3f01c4a6 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:00.159021 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a3007-19e2-4898-b2a9-ea2510f21c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:00.159873 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a3007-19e2-4898-b2a9-ea2510f21c5a None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:00.160160 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a3007-19e2-4898-b2a9-ea2510f21c5a None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:00.160436 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a3007-19e2-4898-b2a9-ea2510f21c5a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:00.161563 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a3007-19e2-4898-b2a9-ea2510f21c5a None admin] RBAC: Adding query filter params (interface=public, service_id=3f0b616059814a3ba92bdf56ea8cb82e, region_id=RegionOne) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:00.162030 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a3007-19e2-4898-b2a9-ea2510f21c5a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:00.163529 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a3007-19e2-4898-b2a9-ea2510f21c5a None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:00.169911 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 460/905] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Jul 25 08:32:59 2022] GET /identity/v3/endpoints?service_id=3f0b616059814a3ba92bdf56ea8cb82e&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:00.176788 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a3007-19e2-4898-b2a9-ea2510f21c5a None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:00.239409 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1cfd8-13c1-46dc-bd3a-d07b25a7bfad None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:00.258331 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:00.267831 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:00.277092 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3eff39-fbe9-4886-9cf5-1c94a43728dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:00.278205 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3eff39-fbe9-4886-9cf5-1c94a43728dc None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:00.278643 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3eff39-fbe9-4886-9cf5-1c94a43728dc None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:00.279213 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3eff39-fbe9-4886-9cf5-1c94a43728dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:00.289532 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a3007-19e2-4898-b2a9-ea2510f21c5a None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:00.325184 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca3ade-0f30-48f7-bb2c-9ba13c482bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:00.325847 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca3ade-0f30-48f7-bb2c-9ba13c482bda None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:00.326135 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca3ade-0f30-48f7-bb2c-9ba13c482bda None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:00.326409 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca3ade-0f30-48f7-bb2c-9ba13c482bda None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:00.327198 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca3ade-0f30-48f7-bb2c-9ba13c482bda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:00.328762 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca3ade-0f30-48f7-bb2c-9ba13c482bda None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:00.335769 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 461/906] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Jul 25 08:33:00 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:33:00.336830 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e742a3c-f52d-4f6e-a573-e4d925934f0b None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:00.337123 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e742a3c-f52d-4f6e-a573-e4d925934f0b None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:00.337406 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e742a3c-f52d-4f6e-a573-e4d925934f0b None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:00.338786 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 462/907] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:00.351658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab706a52-6978-4782-982e-0a8a48e2b275 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:00.351658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab706a52-6978-4782-982e-0a8a48e2b275 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:00.351658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab706a52-6978-4782-982e-0a8a48e2b275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:00.361977 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3eff39-fbe9-4886-9cf5-1c94a43728dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:00.363492 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3eff39-fbe9-4886-9cf5-1c94a43728dc None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:00.373901 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-ab706a52-6978-4782-982e-0a8a48e2b275 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:00.376054 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-ab706a52-6978-4782-982e-0a8a48e2b275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:00.480092 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 463/908] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 08:33:00.494801 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 446/909] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:33:00 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 08:33:00.500928 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab706a52-6978-4782-982e-0a8a48e2b275 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:00.502090 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3eff39-fbe9-4886-9cf5-1c94a43728dc None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:00.534200 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:00.587187 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:00.621244 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3eff39-fbe9-4886-9cf5-1c94a43728dc None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:00.631158 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab706a52-6978-4782-982e-0a8a48e2b275 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:00.669276 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052585e9-c198-4257-bf0a-ac61562597c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:00.670076 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052585e9-c198-4257-bf0a-ac61562597c4 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:00.670364 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052585e9-c198-4257-bf0a-ac61562597c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:00.670680 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052585e9-c198-4257-bf0a-ac61562597c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:00.671862 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24179e53-fdba-47db-b1d6-e8f808ae4a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:00.672650 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24179e53-fdba-47db-b1d6-e8f808ae4a1b None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:00.672930 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24179e53-fdba-47db-b1d6-e8f808ae4a1b None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:00.673202 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24179e53-fdba-47db-b1d6-e8f808ae4a1b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:00.673856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24179e53-fdba-47db-b1d6-e8f808ae4a1b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:00.675229 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24179e53-fdba-47db-b1d6-e8f808ae4a1b None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:00.686591 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052585e9-c198-4257-bf0a-ac61562597c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:00.688066 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052585e9-c198-4257-bf0a-ac61562597c4 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:00.692683 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-24179e53-fdba-47db-b1d6-e8f808ae4a1b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 08:33:00.692683 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:00.692683 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:33:00.692683 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:33:00.692683 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:33:00.692683 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:33:00.692683 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:33:00.692683 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:33:00.692683 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 08:33:00.692683 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:00.692683 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:33:00.692683 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:00.692683 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:00.692683 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:00.692683 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:00.692683 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:00.692683 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:00.693676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:00.693676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:00.693676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:00.693676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:00.693676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:00.693676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:00.693676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:33:00.693676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:33:00.693676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:33:00.693676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:33:00.693676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:00.693676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:00.693676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:00.693676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:00.693676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:00.693676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:00.694531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:00.694531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:00.694531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:00.694531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:00.694531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:00.694531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:00.694531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:00.694531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:00.694531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:00.694531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:00.694531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:33:00.694531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:33:00.694531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 08:33:00.694531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:00.697419 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 464/910] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 08:33:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:00.704594 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24179e53-fdba-47db-b1d6-e8f808ae4a1b None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:00.715719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-052585e9-c198-4257-bf0a-ac61562597c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:00.715719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:00.715719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:00.715719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:00.715719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:00.715719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:00.715719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:00.715719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:00.715719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:00.715719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:00.715719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:00.715719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:00.715719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:33:00.715719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:33:00.715719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:33:00.716661 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:33:00.716661 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:00.716661 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:00.716661 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:00.716661 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:00.716661 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:00.716661 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:00.716661 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:00.716661 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:00.716661 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:00.716661 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:00.716661 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:00.716661 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:00.716661 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:00.716661 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:00.716661 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:00.716661 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:00.718428 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:33:00.718428 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:33:00.718428 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:00.718428 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:00.726061 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 447/911] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:33:00.727476 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052585e9-c198-4257-bf0a-ac61562597c4 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:00.820208 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:00.840671 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24179e53-fdba-47db-b1d6-e8f808ae4a1b None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:00.842091 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052585e9-c198-4257-bf0a-ac61562597c4 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:00.878942 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:00.880739 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05e336-22fd-4ea3-a9f0-5d091ab052ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:00.882147 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05e336-22fd-4ea3-a9f0-5d091ab052ec None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:00.882655 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05e336-22fd-4ea3-a9f0-5d091ab052ec None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:00.883133 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05e336-22fd-4ea3-a9f0-5d091ab052ec None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:00.884356 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05e336-22fd-4ea3-a9f0-5d091ab052ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:00.884975 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05e336-22fd-4ea3-a9f0-5d091ab052ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:00.885373 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895a691-6cfb-4532-9806-5504db4d9d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:00.886041 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895a691-6cfb-4532-9806-5504db4d9d7a None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:00.886325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895a691-6cfb-4532-9806-5504db4d9d7a None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:00.886603 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895a691-6cfb-4532-9806-5504db4d9d7a None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:00.887318 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895a691-6cfb-4532-9806-5504db4d9d7a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:00.887571 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05e336-22fd-4ea3-a9f0-5d091ab052ec None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:00.887694 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895a691-6cfb-4532-9806-5504db4d9d7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:00.894007 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895a691-6cfb-4532-9806-5504db4d9d7a None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:00.899427 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 465/912] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 08:33:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:00.902249 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895a691-6cfb-4532-9806-5504db4d9d7a None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:00.910353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 448/913] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:00.915944 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05e336-22fd-4ea3-a9f0-5d091ab052ec None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:01.021227 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895a691-6cfb-4532-9806-5504db4d9d7a None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:01.043289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05e336-22fd-4ea3-a9f0-5d091ab052ec None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:01.068805 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352ddfc-5f42-4769-a03b-337daed81596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:01.070027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352ddfc-5f42-4769-a03b-337daed81596 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:01.070463 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352ddfc-5f42-4769-a03b-337daed81596 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:01.071133 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352ddfc-5f42-4769-a03b-337daed81596 None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:01.072427 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352ddfc-5f42-4769-a03b-337daed81596 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:01.073150 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352ddfc-5f42-4769-a03b-337daed81596 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:01.075346 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352ddfc-5f42-4769-a03b-337daed81596 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:01.080259 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df796f01-4671-4f5d-bd1f-904e112d0f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:01.081188 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df796f01-4671-4f5d-bd1f-904e112d0f56 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:01.081577 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df796f01-4671-4f5d-bd1f-904e112d0f56 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:01.081954 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df796f01-4671-4f5d-bd1f-904e112d0f56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:01.082974 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 466/914] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 08:33:00 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:01.088200 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352ddfc-5f42-4769-a03b-337daed81596 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:01.091385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df796f01-4671-4f5d-bd1f-904e112d0f56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:01.093960 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df796f01-4671-4f5d-bd1f-904e112d0f56 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:01.096949 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:01.110976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-df796f01-4671-4f5d-bd1f-904e112d0f56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:33:01.110976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:01.110976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:01.110976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:01.110976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:01.110976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:01.110976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:01.110976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:01.110976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:01.110976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:01.110976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:01.110976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:01.110976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:33:01.110976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:33:01.110976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:33:01.113160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:33:01.113160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:01.113160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:01.113160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:01.113160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:01.113160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:01.113160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:01.113160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:01.113160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:01.113160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:01.113160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:01.113160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:01.113160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:01.113160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:01.113160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:01.113160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:01.113160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:01.114160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:33:01.114160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:33:01.114160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:33:01.114160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:33:01.114160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:33:01.114160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:33:01.114160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:33:01.114160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:01.118695 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 449/915] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:33:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:01.119696 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df796f01-4671-4f5d-bd1f-904e112d0f56 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:01.172317 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:01.229442 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352ddfc-5f42-4769-a03b-337daed81596 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:01.234746 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df796f01-4671-4f5d-bd1f-904e112d0f56 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:01.274609 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da9ee4-574b-4b09-8452-dc168dc65bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:01.275423 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da9ee4-574b-4b09-8452-dc168dc65bbb None admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:01.275646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d159550-e552-4e68-bd1f-6a2d6ab34e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:01.275939 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da9ee4-574b-4b09-8452-dc168dc65bbb None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:01.276334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da9ee4-574b-4b09-8452-dc168dc65bbb None admin] PATH_INFO: `/v3/endpoints` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:01.276773 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d159550-e552-4e68-bd1f-6a2d6ab34e84 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:01.277220 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d159550-e552-4e68-bd1f-6a2d6ab34e84 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:01.277439 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da9ee4-574b-4b09-8452-dc168dc65bbb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:01.277800 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d159550-e552-4e68-bd1f-6a2d6ab34e84 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:01.278740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d159550-e552-4e68-bd1f-6a2d6ab34e84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:01.279165 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da9ee4-574b-4b09-8452-dc168dc65bbb None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:01.279356 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d159550-e552-4e68-bd1f-6a2d6ab34e84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:01.281469 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d159550-e552-4e68-bd1f-6a2d6ab34e84 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:01.297133 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 450/916] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:33:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:01.303132 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d159550-e552-4e68-bd1f-6a2d6ab34e84 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:01.356228 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 467/917] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:33:01 2022] POST /identity/v3/endpoints => generated 346 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:33:01.373035 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:01.417026 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbd536-39e8-4730-b578-0372adb813de None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:01.417351 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbd536-39e8-4730-b578-0372adb813de None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:01.417596 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbd536-39e8-4730-b578-0372adb813de None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:01.419158 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 468/918] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:01.425548 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8128259-4ee5-4a5c-a979-4e2f6c6a21c1 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:01.426173 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8128259-4ee5-4a5c-a979-4e2f6c6a21c1 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:01.426656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8128259-4ee5-4a5c-a979-4e2f6c6a21c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:01.432029 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d159550-e552-4e68-bd1f-6a2d6ab34e84 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:01.453656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-a8128259-4ee5-4a5c-a979-4e2f6c6a21c1 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:01.454894 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-a8128259-4ee5-4a5c-a979-4e2f6c6a21c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:01.495818 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa6927-d279-4c94-a9aa-29f63098b7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:01.497629 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa6927-d279-4c94-a9aa-29f63098b7c8 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:01.498273 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa6927-d279-4c94-a9aa-29f63098b7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:01.498754 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa6927-d279-4c94-a9aa-29f63098b7c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:01.500774 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa6927-d279-4c94-a9aa-29f63098b7c8 None admin] RBAC: Adding query filter params (role.id=285ea04d109c48018a60d5bbe255a9bd, scope.project.id=be349194440449209f19f6b535ffd4f6, user.id=b3c1d56bc0a64411a68f97a4417b0379) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:01.501814 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa6927-d279-4c94-a9aa-29f63098b7c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:01.503873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa6927-d279-4c94-a9aa-29f63098b7c8 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:01.512866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 451/919] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:33:01 2022] GET /identity/v3/role_assignments?user.id=b3c1d56bc0a64411a68f97a4417b0379&scope.project.id=be349194440449209f19f6b535ffd4f6&role.id=285ea04d109c48018a60d5bbe255a9bd => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:01.557699 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 469/920] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:01.581742 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa6927-d279-4c94-a9aa-29f63098b7c8 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:01.695469 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa6927-d279-4c94-a9aa-29f63098b7c8 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:01.720005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:01.731743 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d950d9c-d349-4b1f-b041-7aa2222f99d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:01.732642 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d950d9c-d349-4b1f-b041-7aa2222f99d4 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:01.733902 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d950d9c-d349-4b1f-b041-7aa2222f99d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:01.733902 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d950d9c-d349-4b1f-b041-7aa2222f99d4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:01.734231 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d950d9c-d349-4b1f-b041-7aa2222f99d4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:01.735602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d950d9c-d349-4b1f-b041-7aa2222f99d4 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:01.747769 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-6d950d9c-d349-4b1f-b041-7aa2222f99d4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 08:33:01.747769 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:01.747769 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:33:01.747769 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:33:01.747769 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:33:01.747769 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:33:01.747769 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:33:01.747769 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:33:01.747769 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 08:33:01.747769 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:01.747769 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:33:01.747769 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:01.747769 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:01.747769 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:01.747769 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:01.747769 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:01.747769 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:01.749677 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:01.749677 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:01.749677 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:01.749677 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:01.749677 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:01.749677 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:01.749677 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:33:01.749677 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:33:01.749677 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:33:01.749677 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:33:01.749677 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:01.749677 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:01.749677 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:01.749677 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:01.749677 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:01.749677 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:01.750931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:01.750931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:01.750931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:01.750931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:01.750931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:01.750931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:01.750931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:01.750931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:01.750931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:01.750931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:01.750931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:33:01.750931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:33:01.750931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 08:33:01.750931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:01.750931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 452/921] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Jul 25 08:33:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:01.755928 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8128259-4ee5-4a5c-a979-4e2f6c6a21c1 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:01.802660 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:01.860817 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8128259-4ee5-4a5c-a979-4e2f6c6a21c1 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:01.900870 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9800b14-7b83-4bdb-a325-87f62d184311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:01.901787 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9800b14-7b83-4bdb-a325-87f62d184311 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:01.902220 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9800b14-7b83-4bdb-a325-87f62d184311 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:01.902643 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9800b14-7b83-4bdb-a325-87f62d184311 None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:01.903525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9800b14-7b83-4bdb-a325-87f62d184311 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:01.903998 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9800b14-7b83-4bdb-a325-87f62d184311 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:01.906227 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9800b14-7b83-4bdb-a325-87f62d184311 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:01.912119 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 470/922] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Jul 25 08:33:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:01.917950 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d950d9c-d349-4b1f-b041-7aa2222f99d4 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:02.025852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d950d9c-d349-4b1f-b041-7aa2222f99d4 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:02.062252 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f687c-888f-4867-9e61-9f1302e77320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:02.063170 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f687c-888f-4867-9e61-9f1302e77320 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:02.063604 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f687c-888f-4867-9e61-9f1302e77320 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:02.064061 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f687c-888f-4867-9e61-9f1302e77320 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:02.064944 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f687c-888f-4867-9e61-9f1302e77320 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:02.065397 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f687c-888f-4867-9e61-9f1302e77320 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:02.066908 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f687c-888f-4867-9e61-9f1302e77320 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:02.072796 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 453/923] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Jul 25 08:33:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:02.079360 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9800b14-7b83-4bdb-a325-87f62d184311 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:02.185505 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9800b14-7b83-4bdb-a325-87f62d184311 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:02.195551 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:02.222531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68870508-4417-4579-baef-bfdec41d9b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:02.223205 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68870508-4417-4579-baef-bfdec41d9b05 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:02.223492 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68870508-4417-4579-baef-bfdec41d9b05 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:02.223796 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68870508-4417-4579-baef-bfdec41d9b05 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:02.224600 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68870508-4417-4579-baef-bfdec41d9b05 None admin] RBAC: Adding query filter params (interface=public, service_id=598ee9e6378248fe839e4dcd971d5c9e, region_id=RegionOne) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:02.224917 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68870508-4417-4579-baef-bfdec41d9b05 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:02.226401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68870508-4417-4579-baef-bfdec41d9b05 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:02.232044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 471/924] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Jul 25 08:33:02 2022] GET /identity/v3/endpoints?service_id=598ee9e6378248fe839e4dcd971d5c9e&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:02.237439 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f687c-888f-4867-9e61-9f1302e77320 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:02.295521 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:02.348449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f687c-888f-4867-9e61-9f1302e77320 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:02.383719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f243d55-165d-4df8-a72f-a3a89f76bd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:02.384383 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f243d55-165d-4df8-a72f-a3a89f76bd2a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:02.384717 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f243d55-165d-4df8-a72f-a3a89f76bd2a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:02.385002 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f243d55-165d-4df8-a72f-a3a89f76bd2a None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:02.385690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f243d55-165d-4df8-a72f-a3a89f76bd2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:02.387051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f243d55-165d-4df8-a72f-a3a89f76bd2a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:02.394049 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 454/925] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Jul 25 08:33:02 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:33:02.424511 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa1142-9aa5-489b-8ccd-1f2ae19360ad None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:02.424855 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa1142-9aa5-489b-8ccd-1f2ae19360ad None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:02.425080 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa1142-9aa5-489b-8ccd-1f2ae19360ad None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:02.426492 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 472/926] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:02.432257 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9ce85-c312-4a71-9141-a2eaf7128ee1 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:02.432572 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9ce85-c312-4a71-9141-a2eaf7128ee1 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:02.432825 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9ce85-c312-4a71-9141-a2eaf7128ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:02.452656 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-1df9ce85-c312-4a71-9141-a2eaf7128ee1 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:02.453899 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-1df9ce85-c312-4a71-9141-a2eaf7128ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:02.531048 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 455/927] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:02.553890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa1142-9aa5-489b-8ccd-1f2ae19360ad None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:02.665850 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa1142-9aa5-489b-8ccd-1f2ae19360ad None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:02.703940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f9686-01ab-449e-a465-f89b8d626984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:02.705111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f9686-01ab-449e-a465-f89b8d626984 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:02.705603 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f9686-01ab-449e-a465-f89b8d626984 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:02.706107 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f9686-01ab-449e-a465-f89b8d626984 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:02.706995 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f9686-01ab-449e-a465-f89b8d626984 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:02.708624 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f9686-01ab-449e-a465-f89b8d626984 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:02.726034 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-831f9686-01ab-449e-a465-f89b8d626984 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 08:33:02.726034 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:02.726034 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:33:02.726034 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:33:02.726034 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:33:02.726034 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:33:02.726034 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:33:02.726034 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:33:02.726034 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 08:33:02.726034 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:02.726034 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:33:02.726034 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:02.726034 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:02.726034 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:02.726034 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:02.726034 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:02.726989 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:02.726989 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:02.726989 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:02.726989 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:02.726989 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:02.726989 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:02.726989 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:02.726989 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:33:02.726989 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:33:02.726989 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:33:02.726989 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:33:02.726989 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:02.726989 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:02.726989 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:02.726989 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:02.726989 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:02.728233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:02.728233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:02.728233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:02.728233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:02.728233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:02.728233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:02.728233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:02.728233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:02.728233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:02.728233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:02.728233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:02.728233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:33:02.728233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:33:02.728233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 08:33:02.728233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:02.728233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 473/928] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Jul 25 08:33:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:02.734277 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9ce85-c312-4a71-9141-a2eaf7128ee1 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:02.781035 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:02.839630 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9ce85-c312-4a71-9141-a2eaf7128ee1 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:02.874614 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c30f1-d6c4-4c95-88b5-821a7ddaddeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:02.875283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c30f1-d6c4-4c95-88b5-821a7ddaddeb None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:02.875569 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c30f1-d6c4-4c95-88b5-821a7ddaddeb None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:02.875880 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c30f1-d6c4-4c95-88b5-821a7ddaddeb None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:02.876592 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c30f1-d6c4-4c95-88b5-821a7ddaddeb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:02.876900 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c30f1-d6c4-4c95-88b5-821a7ddaddeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:02.878265 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c30f1-d6c4-4c95-88b5-821a7ddaddeb None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:02.883400 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 456/929] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Jul 25 08:33:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:02.889105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f9686-01ab-449e-a465-f89b8d626984 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:02.928786 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:02.995770 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f9686-01ab-449e-a465-f89b8d626984 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:03.030733 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0097a68-01c6-411d-aa86-a7e7389a4422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:03.031409 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0097a68-01c6-411d-aa86-a7e7389a4422 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:03.031719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0097a68-01c6-411d-aa86-a7e7389a4422 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:03.031995 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0097a68-01c6-411d-aa86-a7e7389a4422 None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:03.032708 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0097a68-01c6-411d-aa86-a7e7389a4422 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:03.033269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0097a68-01c6-411d-aa86-a7e7389a4422 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:03.034696 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0097a68-01c6-411d-aa86-a7e7389a4422 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:03.040159 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 474/930] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Jul 25 08:33:02 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:03.049823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c30f1-d6c4-4c95-88b5-821a7ddaddeb None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:03.155724 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c30f1-d6c4-4c95-88b5-821a7ddaddeb None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:03.163865 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:03.192778 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e455d39-cff4-4787-a0bd-af5f3c6aac1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:03.193768 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e455d39-cff4-4787-a0bd-af5f3c6aac1f None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:03.194229 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e455d39-cff4-4787-a0bd-af5f3c6aac1f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:03.194681 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e455d39-cff4-4787-a0bd-af5f3c6aac1f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:03.195603 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e455d39-cff4-4787-a0bd-af5f3c6aac1f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:03.197224 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e455d39-cff4-4787-a0bd-af5f3c6aac1f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:03.297692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 457/931] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:33:03 2022] POST /identity/v3/endpoints => generated 347 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:33:03.517363 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e632199-8d2e-4ea6-8e14-24720326522e None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:03.517979 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e632199-8d2e-4ea6-8e14-24720326522e None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:03.517979 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e632199-8d2e-4ea6-8e14-24720326522e None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:03.519511 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 475/932] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:03.525001 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2116f-ace7-4908-9bb1-b07671d08d29 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:03.525293 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2116f-ace7-4908-9bb1-b07671d08d29 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:03.525626 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2116f-ace7-4908-9bb1-b07671d08d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:03.544596 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-97c2116f-ace7-4908-9bb1-b07671d08d29 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:03.546526 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-97c2116f-ace7-4908-9bb1-b07671d08d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:03.632298 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 458/933] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:03.655761 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e632199-8d2e-4ea6-8e14-24720326522e None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:03.758351 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561b2bb-2dae-46a7-ad39-c4c8d4c4d8a1 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:03.758695 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561b2bb-2dae-46a7-ad39-c4c8d4c4d8a1 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:03.758922 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561b2bb-2dae-46a7-ad39-c4c8d4c4d8a1 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:03.760526 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 459/934] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:03.760926 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:03.766030 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e632199-8d2e-4ea6-8e14-24720326522e None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:03.766501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124cf83-987d-4ca7-b421-86a07103f607 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:03.766788 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124cf83-987d-4ca7-b421-86a07103f607 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:03.767067 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124cf83-987d-4ca7-b421-86a07103f607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:03.785952 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-3124cf83-987d-4ca7-b421-86a07103f607 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:03.787347 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-3124cf83-987d-4ca7-b421-86a07103f607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:03.816070 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7decee-0011-479e-ada5-a744c3500c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:03.817591 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7decee-0011-479e-ada5-a744c3500c1e None admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:03.818048 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7decee-0011-479e-ada5-a744c3500c1e None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:03.818472 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7decee-0011-479e-ada5-a744c3500c1e None admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:03.819989 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7decee-0011-479e-ada5-a744c3500c1e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:03.821841 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7decee-0011-479e-ada5-a744c3500c1e None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:03.824905 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: WARNING keystone.server.flask.common [None req-9f7decee-0011-479e-ada5-a744c3500c1e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 25 08:33:03.863653 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 460/935] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 08:33:03.871656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.sql.core [None req-9f7decee-0011-479e-ada5-a744c3500c1e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 08:33:03.871656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 08:33:03.871656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [parameters: {'id': 'b08d585c416e4a93afa4ddaa5b5f8a2a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 08:33:03.871656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86941) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 08:33:03.878662 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-9f7decee-0011-479e-ada5-a744c3500c1e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b08d585c416e4a93afa4ddaa5b5f8a2a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b08d585c416e4a93afa4ddaa5b5f8a2a. Jul 25 08:33:03.878662 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:03.878662 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 08:33:03.878662 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 08:33:03.878662 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 08:33:03.878662 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 08:33:03.878662 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 08:33:03.878662 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 08:33:03.878662 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 08:33:03.878662 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application conn.query(q) Jul 25 08:33:03.878662 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 08:33:03.878662 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 08:33:03.878662 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 08:33:03.879531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application result.read() Jul 25 08:33:03.879531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 08:33:03.879531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 08:33:03.879531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 08:33:03.879531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 08:33:03.879531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 08:33:03.879531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 08:33:03.879531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 08:33:03.879531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 08:33:03.879531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 08:33:03.879531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:03.879531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 08:33:03.879531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:03.879531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:03.879531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 08:33:03.879531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 08:33:03.879531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 25 08:33:03.879531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 25 08:33:03.880567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 08:33:03.880567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application next(self.gen) Jul 25 08:33:03.880567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 08:33:03.880567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application yield resource Jul 25 08:33:03.880567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 08:33:03.880567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application next(self.gen) Jul 25 08:33:03.880567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 08:33:03.880567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 08:33:03.880567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 08:33:03.880567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 08:33:03.880567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 08:33:03.880567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise self.value Jul 25 08:33:03.880567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 08:33:03.880567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 08:33:03.880567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 08:33:03.880567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application session.commit() Jul 25 08:33:03.880567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 08:33:03.881459 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 08:33:03.881459 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 08:33:03.881459 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 08:33:03.881459 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 08:33:03.881459 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self.session.flush() Jul 25 08:33:03.881459 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 08:33:03.881459 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 08:33:03.881459 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 08:33:03.881459 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 08:33:03.881459 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 08:33:03.881459 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application compat.raise_( Jul 25 08:33:03.881459 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 08:33:03.881459 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception Jul 25 08:33:03.881459 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 08:33:03.881459 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 08:33:03.881459 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 08:33:03.881459 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 08:33:03.882424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 08:33:03.882424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 08:33:03.882424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 08:33:03.882424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 08:33:03.882424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 25 08:33:03.882424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 25 08:33:03.882424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 08:33:03.882424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 08:33:03.882424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 08:33:03.882424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 08:33:03.882424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 08:33:03.882424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 08:33:03.882424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 08:33:03.882424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 08:33:03.882424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 08:33:03.883238 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 08:33:03.883238 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 08:33:03.883238 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception Jul 25 08:33:03.883238 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 08:33:03.883238 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 08:33:03.883238 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 08:33:03.883238 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 08:33:03.883238 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 08:33:03.883238 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 08:33:03.883238 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 08:33:03.883238 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application conn.query(q) Jul 25 08:33:03.883238 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 08:33:03.883238 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 08:33:03.883238 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 08:33:03.883238 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application result.read() Jul 25 08:33:03.883238 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 08:33:03.883238 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 08:33:03.884157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 08:33:03.884157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 08:33:03.884157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 08:33:03.884157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 08:33:03.884157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 08:33:03.884157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 08:33:03.884157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 08:33:03.884157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 08:33:03.884157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [parameters: {'id': 'b08d585c416e4a93afa4ddaa5b5f8a2a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 08:33:03.884157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 08:33:03.884157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:03.884157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:33:03.884157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:03.884157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:03.884157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 25 08:33:03.884984 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 25 08:33:03.884984 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 08:33:03.884984 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 08:33:03.884984 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 25 08:33:03.884984 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:03.884984 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:33:03.884984 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:03.884984 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:03.884984 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:03.884984 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:03.884984 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:03.884984 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:03.884984 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:03.884984 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:03.884984 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:03.884984 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:03.884984 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:03.885974 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:03.885974 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 25 08:33:03.885974 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 25 08:33:03.885974 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:03.885974 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:03.885974 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 25 08:33:03.885974 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 25 08:33:03.885974 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b08d585c416e4a93afa4ddaa5b5f8a2a. Jul 25 08:33:03.885974 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:03.885974 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 476/936] 10.222.0.18 () {60 vars in 1140 bytes} [Mon Jul 25 08:33:03 2022] POST /identity/v3/projects => generated 262 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:03.888567 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124cf83-987d-4ca7-b421-86a07103f607 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:03.893489 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7decee-0011-479e-ada5-a744c3500c1e None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:03.912502 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:04.017584 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124cf83-987d-4ca7-b421-86a07103f607 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:04.018040 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7decee-0011-479e-ada5-a744c3500c1e None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:04.053949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1faa26c-c11f-42ec-a7f1-a91248e53476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:04.054853 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1faa26c-c11f-42ec-a7f1-a91248e53476 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:04.055236 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1faa26c-c11f-42ec-a7f1-a91248e53476 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:04.055639 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1faa26c-c11f-42ec-a7f1-a91248e53476 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:04.056135 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40145804-2c2b-4cc0-be52-61da9dc983b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:04.057447 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40145804-2c2b-4cc0-be52-61da9dc983b6 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:04.057953 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40145804-2c2b-4cc0-be52-61da9dc983b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:04.058388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40145804-2c2b-4cc0-be52-61da9dc983b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:04.066813 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40145804-2c2b-4cc0-be52-61da9dc983b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:04.067686 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1faa26c-c11f-42ec-a7f1-a91248e53476 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:33:04.068734 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40145804-2c2b-4cc0-be52-61da9dc983b6 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:04.076151 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-f1faa26c-c11f-42ec-a7f1-a91248e53476 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 08:33:04.076151 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:04.076151 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:04.076151 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:04.076151 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:04.076151 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:04.076151 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:04.076151 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:04.076151 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:04.076151 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:04.076151 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:04.076151 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:04.076151 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:33:04.076151 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:33:04.076151 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:33:04.076151 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:33:04.077600 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:33:04.077600 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:33:04.077600 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:33:04.077600 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:33:04.077600 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:04.077600 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:04.077600 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:04.077600 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:04.077600 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:04.077600 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:04.077600 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:04.077600 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:04.077600 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:04.077600 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:04.077600 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:04.077600 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:04.078579 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:04.078579 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:04.078579 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:04.078579 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:04.078579 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:33:04.078579 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:33:04.078579 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:33:04.078579 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:33:04.078579 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:33:04.078579 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:33:04.078579 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 08:33:04.078579 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:04.083149 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 477/937] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Jul 25 08:33:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:04.084140 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1faa26c-c11f-42ec-a7f1-a91248e53476 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:04.087762 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-40145804-2c2b-4cc0-be52-61da9dc983b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:33:04.087762 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:04.087762 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:04.087762 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:04.087762 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:04.087762 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:04.087762 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:04.087762 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:04.087762 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:04.087762 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:04.087762 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:04.087762 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:04.087762 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:33:04.087762 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:33:04.087762 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:33:04.088652 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:33:04.088652 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:04.088652 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:04.088652 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:04.088652 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:04.088652 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:04.088652 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:04.088652 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:04.088652 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:04.088652 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:04.088652 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:04.088652 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:04.088652 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:04.088652 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:04.088652 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:04.088652 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:04.088652 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:04.089552 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:33:04.089552 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:33:04.089552 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:33:04.089552 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:33:04.089552 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:33:04.089552 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:33:04.089552 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:33:04.089552 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:04.097329 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 461/938] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:33:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:04.098484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40145804-2c2b-4cc0-be52-61da9dc983b6 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:04.105434 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:04.186127 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:04.199834 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1faa26c-c11f-42ec-a7f1-a91248e53476 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:04.213620 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40145804-2c2b-4cc0-be52-61da9dc983b6 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:04.238857 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524cded-8705-4f37-9602-e24fcbaf24f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:04.239533 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524cded-8705-4f37-9602-e24fcbaf24f7 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:04.240047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524cded-8705-4f37-9602-e24fcbaf24f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:04.240335 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524cded-8705-4f37-9602-e24fcbaf24f7 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:04.241093 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524cded-8705-4f37-9602-e24fcbaf24f7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:04.241403 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524cded-8705-4f37-9602-e24fcbaf24f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:04.243205 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524cded-8705-4f37-9602-e24fcbaf24f7 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:04.254587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea792c-adde-4b3a-ae4e-5b9ec20e95cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:04.255494 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea792c-adde-4b3a-ae4e-5b9ec20e95cb None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:04.256038 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea792c-adde-4b3a-ae4e-5b9ec20e95cb None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:04.256535 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea792c-adde-4b3a-ae4e-5b9ec20e95cb None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:04.257559 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea792c-adde-4b3a-ae4e-5b9ec20e95cb None admin] RBAC: Adding query filter params (name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:04.258116 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea792c-adde-4b3a-ae4e-5b9ec20e95cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:04.259761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea792c-adde-4b3a-ae4e-5b9ec20e95cb None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:04.260007 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 478/939] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Jul 25 08:33:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:04.261441 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524cded-8705-4f37-9602-e24fcbaf24f7 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:04.279602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 462/940] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jul 25 08:33:04 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:04.353152 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:04.377615 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524cded-8705-4f37-9602-e24fcbaf24f7 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:04.416718 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8d2b2-46b5-4052-a075-7843d1d4442d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:04.417535 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8d2b2-46b5-4052-a075-7843d1d4442d None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:04.417820 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8d2b2-46b5-4052-a075-7843d1d4442d None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:04.418100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8d2b2-46b5-4052-a075-7843d1d4442d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:04.430911 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8d2b2-46b5-4052-a075-7843d1d4442d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:04.432413 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8d2b2-46b5-4052-a075-7843d1d4442d None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:04.451758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-34b8d2b2-46b5-4052-a075-7843d1d4442d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:04.451758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:04.451758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:04.451758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:04.451758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:04.451758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:04.451758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:04.451758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:04.451758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:04.451758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:04.451758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:04.451758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:04.451758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:33:04.451758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:33:04.451758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:33:04.453242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:33:04.453242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:04.453242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:04.453242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:04.453242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:04.453242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:04.453242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:04.453242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:04.453242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:04.453242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:04.453242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:04.453242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:04.453242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:04.453242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:04.453242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:04.453242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:04.453242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:04.454141 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:33:04.454141 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:33:04.454141 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:04.454141 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:04.454141 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 479/941] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:33:04.459455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea792c-adde-4b3a-ae4e-5b9ec20e95cb None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:04.562987 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806063f-14ec-4d62-af5e-94334cf3c5d5 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:04.563558 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806063f-14ec-4d62-af5e-94334cf3c5d5 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:04.563558 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806063f-14ec-4d62-af5e-94334cf3c5d5 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:04.566203 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 480/942] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:33:04.569970 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea792c-adde-4b3a-ae4e-5b9ec20e95cb None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:04.570326 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d529ac4-c615-478b-a38c-75ed467a9cda None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:04.570611 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d529ac4-c615-478b-a38c-75ed467a9cda None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:04.570891 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d529ac4-c615-478b-a38c-75ed467a9cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:04.590724 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-0d529ac4-c615-478b-a38c-75ed467a9cda None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:04.593990 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-0d529ac4-c615-478b-a38c-75ed467a9cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:04.612989 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c9c1b-3d0d-4185-9f2e-5fc0531c8c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:04.613579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c9c1b-3d0d-4185-9f2e-5fc0531c8c33 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:04.613865 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c9c1b-3d0d-4185-9f2e-5fc0531c8c33 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:04.614406 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c9c1b-3d0d-4185-9f2e-5fc0531c8c33 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:04.615022 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c9c1b-3d0d-4185-9f2e-5fc0531c8c33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:04.615340 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c9c1b-3d0d-4185-9f2e-5fc0531c8c33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:04.616736 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c9c1b-3d0d-4185-9f2e-5fc0531c8c33 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:04.624875 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:04.631111 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 463/943] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:04.642010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c9c1b-3d0d-4185-9f2e-5fc0531c8c33 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:04.675147 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 481/944] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 08:33:04.697967 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d529ac4-c615-478b-a38c-75ed467a9cda None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:04.762700 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:04.767275 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c9c1b-3d0d-4185-9f2e-5fc0531c8c33 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:04.803317 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6df3b-f605-42ed-9c9d-b3f5d1bc1e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:04.804691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6df3b-f605-42ed-9c9d-b3f5d1bc1e7c None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:04.805041 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6df3b-f605-42ed-9c9d-b3f5d1bc1e7c None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:04.805430 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6df3b-f605-42ed-9c9d-b3f5d1bc1e7c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:04.807551 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d529ac4-c615-478b-a38c-75ed467a9cda None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:04.815652 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf6df3b-f605-42ed-9c9d-b3f5d1bc1e7c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:04.817295 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf6df3b-f605-42ed-9c9d-b3f5d1bc1e7c None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:04.834562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-faf6df3b-f605-42ed-9c9d-b3f5d1bc1e7c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 08:33:04.834562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:04.834562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:04.834562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:04.834562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:04.834562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:04.834562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:04.834562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:04.834562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:04.834562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:04.834562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:04.834562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:04.834562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:33:04.834562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:33:04.834562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:33:04.834562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:33:04.835560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:04.835560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:04.835560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:33:04.835560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:33:04.835560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:33:04.835560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:33:04.835560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:04.835560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:04.835560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:04.835560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:04.835560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:04.835560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:04.835560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:04.835560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:04.835560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:04.835560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:04.835560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:04.835560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:04.836550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:04.836550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:04.836550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:33:04.836550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:33:04.836550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:33:04.836550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:33:04.836550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:33:04.836550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:33:04.836550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 08:33:04.836550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:04.836550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 464/945] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Jul 25 08:33:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:04.843379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6df3b-f605-42ed-9c9d-b3f5d1bc1e7c None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:04.853821 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39441d24-0835-483d-b53f-d6953e84970c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:04.854925 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39441d24-0835-483d-b53f-d6953e84970c None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:04.855392 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39441d24-0835-483d-b53f-d6953e84970c None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:04.855889 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39441d24-0835-483d-b53f-d6953e84970c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:04.856724 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39441d24-0835-483d-b53f-d6953e84970c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:04.858347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39441d24-0835-483d-b53f-d6953e84970c None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:04.871065 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-39441d24-0835-483d-b53f-d6953e84970c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 08:33:04.871065 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:04.871065 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:33:04.871065 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:33:04.871065 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:33:04.871065 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:33:04.871065 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:33:04.871065 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:33:04.871065 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 08:33:04.871065 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:04.871065 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:33:04.871065 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:04.871065 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:04.871065 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:04.871065 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:04.871065 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:04.871065 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:04.872113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:04.872113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:04.872113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:04.872113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:04.872113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:04.872113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:04.872113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:33:04.872113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:33:04.872113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:33:04.872113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:33:04.872113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:04.872113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:04.872113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:04.872113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:04.872113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:04.872113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:04.872951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:04.872951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:04.872951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:04.872951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:04.872951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:04.872951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:04.872951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:04.872951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:04.872951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:04.872951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:04.872951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:33:04.872951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:33:04.872951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 08:33:04.872951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:04.876423 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 482/946] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Jul 25 08:33:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:33:04.882164 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39441d24-0835-483d-b53f-d6953e84970c None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:04.911058 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:04.960253 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6df3b-f605-42ed-9c9d-b3f5d1bc1e7c None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:04.998849 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84bbb1-e63e-4ff3-9dcb-f7631deb9424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:04.999737 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84bbb1-e63e-4ff3-9dcb-f7631deb9424 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:05.000031 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84bbb1-e63e-4ff3-9dcb-f7631deb9424 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:05.000311 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84bbb1-e63e-4ff3-9dcb-f7631deb9424 None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:05.001158 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84bbb1-e63e-4ff3-9dcb-f7631deb9424 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:05.001470 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84bbb1-e63e-4ff3-9dcb-f7631deb9424 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:05.002898 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84bbb1-e63e-4ff3-9dcb-f7631deb9424 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:05.015035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39441d24-0835-483d-b53f-d6953e84970c None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:05.021823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 465/947] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Jul 25 08:33:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:05.026987 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84bbb1-e63e-4ff3-9dcb-f7631deb9424 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:05.044224 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:05.056115 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59acfb0c-d924-4e73-a07f-acc25b61e130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:05.059046 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acfb0c-d924-4e73-a07f-acc25b61e130 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:05.059046 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acfb0c-d924-4e73-a07f-acc25b61e130 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:05.059046 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acfb0c-d924-4e73-a07f-acc25b61e130 None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:05.059046 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59acfb0c-d924-4e73-a07f-acc25b61e130 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:05.059046 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59acfb0c-d924-4e73-a07f-acc25b61e130 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:05.060607 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59acfb0c-d924-4e73-a07f-acc25b61e130 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:05.066420 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 483/948] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Jul 25 08:33:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:05.073236 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59acfb0c-d924-4e73-a07f-acc25b61e130 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:05.160503 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84bbb1-e63e-4ff3-9dcb-f7631deb9424 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:05.182854 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:05.193534 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59acfb0c-d924-4e73-a07f-acc25b61e130 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:05.210059 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598e776-3287-446e-a528-44a53c3676f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:05.211228 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598e776-3287-446e-a528-44a53c3676f3 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:05.211962 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598e776-3287-446e-a528-44a53c3676f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:05.212862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598e776-3287-446e-a528-44a53c3676f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:05.228159 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598e776-3287-446e-a528-44a53c3676f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:05.229608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598e776-3287-446e-a528-44a53c3676f3 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:05.234100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c63ec-e206-4d7d-bc6c-0a983e930da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:05.235025 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c63ec-e206-4d7d-bc6c-0a983e930da4 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:05.235503 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c63ec-e206-4d7d-bc6c-0a983e930da4 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:05.236022 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c63ec-e206-4d7d-bc6c-0a983e930da4 None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:05.237051 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c63ec-e206-4d7d-bc6c-0a983e930da4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:05.238497 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c63ec-e206-4d7d-bc6c-0a983e930da4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:05.240929 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c63ec-e206-4d7d-bc6c-0a983e930da4 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:05.251353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-e598e776-3287-446e-a528-44a53c3676f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:05.251353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:05.251353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:05.251353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:05.251353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:05.251353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:05.251353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:05.251353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:05.251353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:05.251353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:05.251353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:05.251353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:05.251353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:33:05.251353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:33:05.251353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:33:05.252563 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:33:05.252563 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:05.252563 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:05.252563 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:05.252563 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:05.252563 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:05.252563 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:05.252563 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:05.252563 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:05.252563 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:05.252563 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:05.252563 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:05.252563 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:05.252563 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:05.252563 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:05.252563 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:05.252563 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:05.253427 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:33:05.253427 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:33:05.253427 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:05.253427 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:05.254020 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 484/950] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Jul 25 08:33:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:05.255517 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 466/950] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:05.256032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c63ec-e206-4d7d-bc6c-0a983e930da4 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:05.258220 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598e776-3287-446e-a528-44a53c3676f3 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:05.313516 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:05.364531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c63ec-e206-4d7d-bc6c-0a983e930da4 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:05.367135 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598e776-3287-446e-a528-44a53c3676f3 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:05.404082 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08509324-e80b-40f0-b232-76ec8117cd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:05.404801 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08509324-e80b-40f0-b232-76ec8117cd09 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:05.405759 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08509324-e80b-40f0-b232-76ec8117cd09 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:05.406044 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08509324-e80b-40f0-b232-76ec8117cd09 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:05.406890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08509324-e80b-40f0-b232-76ec8117cd09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:05.407284 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08509324-e80b-40f0-b232-76ec8117cd09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:05.409069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08509324-e80b-40f0-b232-76ec8117cd09 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:05.410419 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d734f-59e8-48e7-8337-6065dd07c995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:05.411361 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d734f-59e8-48e7-8337-6065dd07c995 None admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:05.411882 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d734f-59e8-48e7-8337-6065dd07c995 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:05.412353 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d734f-59e8-48e7-8337-6065dd07c995 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:05.413365 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d734f-59e8-48e7-8337-6065dd07c995 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:05.415076 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d734f-59e8-48e7-8337-6065dd07c995 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:05.423664 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 467/951] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:05.423826 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424053b-aeea-4d2b-9227-d5ddac713609 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:05.424060 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424053b-aeea-4d2b-9227-d5ddac713609 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:05.424398 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424053b-aeea-4d2b-9227-d5ddac713609 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:05.425807 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 468/952] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:05.428078 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424053b-aeea-4d2b-9227-d5ddac713609 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:05.456572 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:05.512056 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 485/953] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:33:05 2022] POST /identity/v3/endpoints => generated 349 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:33:05.513590 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649eb559-77e3-4c32-aaf6-6cb0c97a9473 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:05.513888 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649eb559-77e3-4c32-aaf6-6cb0c97a9473 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:05.514174 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649eb559-77e3-4c32-aaf6-6cb0c97a9473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:05.542009 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424053b-aeea-4d2b-9227-d5ddac713609 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:05.555438 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-649eb559-77e3-4c32-aaf6-6cb0c97a9473 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:05.557622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-649eb559-77e3-4c32-aaf6-6cb0c97a9473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:05.591849 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8cb78f-84c6-43fb-af77-9511a9c9aedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:05.594383 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cb78f-84c6-43fb-af77-9511a9c9aedf None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:05.594766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cb78f-84c6-43fb-af77-9511a9c9aedf None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:05.595140 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cb78f-84c6-43fb-af77-9511a9c9aedf None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:05.605339 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8cb78f-84c6-43fb-af77-9511a9c9aedf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:05.606926 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8cb78f-84c6-43fb-af77-9511a9c9aedf None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:05.626942 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-7f8cb78f-84c6-43fb-af77-9511a9c9aedf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:33:05.626942 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:05.626942 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:05.626942 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:05.626942 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:05.626942 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:05.626942 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:05.626942 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:05.626942 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:05.626942 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:05.626942 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:05.626942 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:05.626942 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:33:05.626942 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:33:05.626942 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:33:05.633174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:33:05.633174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:05.633174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:05.633174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:05.633174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:05.633174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:05.633174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:05.633174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:05.633174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:05.633174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:05.633174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:05.633174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:05.633174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:05.633174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:05.633174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:05.633174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:05.633174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:05.634803 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:33:05.634803 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:33:05.634803 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:33:05.634803 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:33:05.634803 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:33:05.634803 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:33:05.634803 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:33:05.634803 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:05.634803 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 469/954] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:33:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:05.635383 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8cb78f-84c6-43fb-af77-9511a9c9aedf None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:05.648035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 486/955] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:05.674645 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649eb559-77e3-4c32-aaf6-6cb0c97a9473 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:05.725772 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:05.751813 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:05.769905 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8cb78f-84c6-43fb-af77-9511a9c9aedf None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:05.812393 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649eb559-77e3-4c32-aaf6-6cb0c97a9473 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:05.818772 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe5881-5aa8-4707-8b9a-bd4a18eb2261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:05.819732 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe5881-5aa8-4707-8b9a-bd4a18eb2261 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:05.821173 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe5881-5aa8-4707-8b9a-bd4a18eb2261 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:05.821657 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe5881-5aa8-4707-8b9a-bd4a18eb2261 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:05.823493 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe5881-5aa8-4707-8b9a-bd4a18eb2261 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:05.824018 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe5881-5aa8-4707-8b9a-bd4a18eb2261 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:05.826354 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe5881-5aa8-4707-8b9a-bd4a18eb2261 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:05.849853 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 470/956] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:33:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:05.850942 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe5881-5aa8-4707-8b9a-bd4a18eb2261 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:05.856109 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07085f89-ff34-46cd-b5ec-388d2335ecd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:05.856690 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07085f89-ff34-46cd-b5ec-388d2335ecd0 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:05.856974 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07085f89-ff34-46cd-b5ec-388d2335ecd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:05.857251 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07085f89-ff34-46cd-b5ec-388d2335ecd0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:05.857911 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07085f89-ff34-46cd-b5ec-388d2335ecd0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:05.859876 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07085f89-ff34-46cd-b5ec-388d2335ecd0 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:05.872334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-07085f89-ff34-46cd-b5ec-388d2335ecd0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 08:33:05.872334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:05.872334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:33:05.872334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:33:05.872334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:33:05.872334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:33:05.872334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:33:05.872334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:33:05.872334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 08:33:05.872334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:05.872334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:33:05.872334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:05.872334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:05.872334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:05.872334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:05.872334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:05.872334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:05.873486 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:05.873486 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:05.873486 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:05.873486 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:05.873486 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:05.873486 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:05.873486 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:33:05.873486 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:33:05.873486 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:33:05.873486 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:33:05.873486 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:05.873486 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:05.873486 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:05.873486 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:05.873486 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:05.873486 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:05.874550 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:05.874550 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:05.874550 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:05.874550 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:05.874550 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:05.874550 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:05.874550 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:05.874550 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:05.874550 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:05.874550 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:05.874550 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:33:05.874550 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:33:05.874550 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 08:33:05.874550 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:05.879018 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 487/957] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:33:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:33:05.879910 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07085f89-ff34-46cd-b5ec-388d2335ecd0 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:05.968730 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe5881-5aa8-4707-8b9a-bd4a18eb2261 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:06.006560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e788c-ed33-453a-a415-b981c6dfb56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:06.007362 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07085f89-ff34-46cd-b5ec-388d2335ecd0 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:06.008111 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e788c-ed33-453a-a415-b981c6dfb56d None admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:06.008604 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e788c-ed33-453a-a415-b981c6dfb56d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:06.009034 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:06.009541 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e788c-ed33-453a-a415-b981c6dfb56d None admin] PATH_INFO: `/v3/projects/be349194440449209f19f6b535ffd4f6/users/b3c1d56bc0a64411a68f97a4417b0379/roles/285ea04d109c48018a60d5bbe255a9bd` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:06.012428 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e788c-ed33-453a-a415-b981c6dfb56d None admin] RBAC: Authorizing `identity:create_grant(project_id=be349194440449209f19f6b535ffd4f6, user_id=b3c1d56bc0a64411a68f97a4417b0379, role_id=285ea04d109c48018a60d5bbe255a9bd)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:06.014108 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e788c-ed33-453a-a415-b981c6dfb56d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:06.046204 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a90c66-bd29-49c3-bbcd-6f77aa46698d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:06.046900 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a90c66-bd29-49c3-bbcd-6f77aa46698d None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:06.047166 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a90c66-bd29-49c3-bbcd-6f77aa46698d None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:06.047438 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a90c66-bd29-49c3-bbcd-6f77aa46698d None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:06.048186 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a90c66-bd29-49c3-bbcd-6f77aa46698d None admin] RBAC: Adding query filter params (name=compute) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:06.048483 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a90c66-bd29-49c3-bbcd-6f77aa46698d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:06.049911 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a90c66-bd29-49c3-bbcd-6f77aa46698d None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:06.055280 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 488/958] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jul 25 08:33:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:06.060625 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a90c66-bd29-49c3-bbcd-6f77aa46698d None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:06.087635 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 471/959] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 08:33:05 2022] PUT /identity/v3/projects/be349194440449209f19f6b535ffd4f6/users/b3c1d56bc0a64411a68f97a4417b0379/roles/285ea04d109c48018a60d5bbe255a9bd => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:33:06.184696 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a90c66-bd29-49c3-bbcd-6f77aa46698d None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:06.222788 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23d723-794f-4bc0-956c-c580ca6c0a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:06.223452 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23d723-794f-4bc0-956c-c580ca6c0a6a None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:06.223763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23d723-794f-4bc0-956c-c580ca6c0a6a None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:06.224145 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23d723-794f-4bc0-956c-c580ca6c0a6a None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:06.224872 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23d723-794f-4bc0-956c-c580ca6c0a6a None admin] RBAC: Adding query filter params (type=compute) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:06.225241 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23d723-794f-4bc0-956c-c580ca6c0a6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:06.226786 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23d723-794f-4bc0-956c-c580ca6c0a6a None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:06.232565 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 489/960] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jul 25 08:33:06 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:06.479082 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92107d6-643f-48aa-b6a4-87bbea3ac135 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:06.479567 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92107d6-643f-48aa-b6a4-87bbea3ac135 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:06.479567 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92107d6-643f-48aa-b6a4-87bbea3ac135 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:06.481181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 472/961] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:06.486729 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a2db6-50d6-4ac0-99e0-b8948ba229c1 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:06.487018 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a2db6-50d6-4ac0-99e0-b8948ba229c1 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:06.487291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a2db6-50d6-4ac0-99e0-b8948ba229c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:06.506241 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-f96a2db6-50d6-4ac0-99e0-b8948ba229c1 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:06.507420 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-f96a2db6-50d6-4ac0-99e0-b8948ba229c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:06.534539 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:06.582336 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 490/962] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:06.607351 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92107d6-643f-48aa-b6a4-87bbea3ac135 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:06.612276 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:06.721456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92107d6-643f-48aa-b6a4-87bbea3ac135 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:06.758642 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83524da2-e785-4de9-b0c0-06faa779d6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:06.759237 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83524da2-e785-4de9-b0c0-06faa779d6c5 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:06.759524 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83524da2-e785-4de9-b0c0-06faa779d6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:06.759835 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83524da2-e785-4de9-b0c0-06faa779d6c5 None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:06.760559 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83524da2-e785-4de9-b0c0-06faa779d6c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:06.761987 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83524da2-e785-4de9-b0c0-06faa779d6c5 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:06.765120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: WARNING keystone.server.flask.common [None req-83524da2-e785-4de9-b0c0-06faa779d6c5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 25 08:33:06.803551 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.sql.core [None req-83524da2-e785-4de9-b0c0-06faa779d6c5 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 08:33:06.803551 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 08:33:06.803551 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [parameters: {'user_id': '4085e93436e94a70b6bea4c90285f03e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 08:33:06.803551 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86942) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 08:33:06.820761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-83524da2-e785-4de9-b0c0-06faa779d6c5 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 08:33:06.820761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:06.820761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 08:33:06.820761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 08:33:06.820761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 08:33:06.820761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 08:33:06.820761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 08:33:06.820761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 08:33:06.820761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 08:33:06.820761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application conn.query(q) Jul 25 08:33:06.820761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 08:33:06.820761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 08:33:06.820761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 08:33:06.820761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application result.read() Jul 25 08:33:06.820761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 08:33:06.821909 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 08:33:06.821909 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 08:33:06.821909 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 08:33:06.821909 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 08:33:06.821909 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 08:33:06.821909 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 08:33:06.821909 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 08:33:06.821909 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 08:33:06.821909 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:06.821909 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 08:33:06.821909 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:06.821909 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:06.821909 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 08:33:06.821909 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 08:33:06.821909 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 25 08:33:06.821909 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 25 08:33:06.821909 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 08:33:06.821909 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application next(self.gen) Jul 25 08:33:06.823606 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 08:33:06.823606 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application yield resource Jul 25 08:33:06.823606 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 08:33:06.823606 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application next(self.gen) Jul 25 08:33:06.823606 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 08:33:06.823606 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 08:33:06.823606 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 08:33:06.823606 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 08:33:06.823606 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 08:33:06.823606 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise self.value Jul 25 08:33:06.823606 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 08:33:06.823606 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 08:33:06.823606 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 08:33:06.823606 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application session.commit() Jul 25 08:33:06.823606 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 08:33:06.823606 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 08:33:06.823606 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 08:33:06.824801 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 08:33:06.824801 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 08:33:06.824801 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self.session.flush() Jul 25 08:33:06.824801 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 08:33:06.824801 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 08:33:06.824801 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 08:33:06.824801 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 08:33:06.824801 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 08:33:06.824801 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application compat.raise_( Jul 25 08:33:06.824801 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 08:33:06.824801 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception Jul 25 08:33:06.824801 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 08:33:06.824801 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 08:33:06.824801 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 08:33:06.824801 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 08:33:06.824801 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 08:33:06.824801 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 08:33:06.826009 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 08:33:06.826009 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 08:33:06.826009 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 25 08:33:06.826009 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 25 08:33:06.826009 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 08:33:06.826009 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 08:33:06.826009 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 08:33:06.826009 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 08:33:06.826009 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 08:33:06.826009 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 08:33:06.826009 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 08:33:06.826009 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 08:33:06.826009 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 08:33:06.826009 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 08:33:06.826009 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 08:33:06.826009 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception Jul 25 08:33:06.828267 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 08:33:06.828267 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 08:33:06.828267 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 08:33:06.828267 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 08:33:06.828267 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 08:33:06.828267 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 08:33:06.828267 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 08:33:06.828267 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application conn.query(q) Jul 25 08:33:06.828267 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 08:33:06.828267 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 08:33:06.828267 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 08:33:06.828267 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application result.read() Jul 25 08:33:06.828267 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 08:33:06.828267 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 08:33:06.828267 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 08:33:06.828267 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 08:33:06.830272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 08:33:06.830272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 08:33:06.830272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 08:33:06.830272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 08:33:06.830272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 08:33:06.830272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 08:33:06.830272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [parameters: {'user_id': '4085e93436e94a70b6bea4c90285f03e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 08:33:06.830272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 08:33:06.830272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:06.830272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:33:06.830272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:06.830272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:06.830272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:06.830272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:06.830272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:06.836956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:06.836956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:06.836956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:06.836956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:06.836956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:06.836956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:06.836956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:06.836956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 25 08:33:06.836956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 25 08:33:06.836956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:06.836956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:06.836956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:33:06.836956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:33:06.836956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:33:06.836956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:33:06.836956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 25 08:33:06.836956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 25 08:33:06.839363 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 25 08:33:06.839363 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 25 08:33:06.839363 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 08:33:06.839363 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 08:33:06.839363 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 08:33:06.839363 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:06.839363 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 473/963] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Jul 25 08:33:06 2022] POST /identity/v3/users => generated 160 bytes in 215 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:06.840393 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a2db6-50d6-4ac0-99e0-b8948ba229c1 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:06.932759 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a2db6-50d6-4ac0-99e0-b8948ba229c1 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:06.971541 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95cddb0-94f1-47c9-b7d3-f7e159096840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:06.972363 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cddb0-94f1-47c9-b7d3-f7e159096840 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:06.972643 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cddb0-94f1-47c9-b7d3-f7e159096840 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:06.972912 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cddb0-94f1-47c9-b7d3-f7e159096840 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:06.980074 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95cddb0-94f1-47c9-b7d3-f7e159096840 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:06.981514 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95cddb0-94f1-47c9-b7d3-f7e159096840 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:06.995971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-b95cddb0-94f1-47c9-b7d3-f7e159096840 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 08:33:06.995971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:06.995971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:06.995971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:06.995971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:06.995971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:06.995971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:06.995971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:06.995971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:06.995971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:06.995971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:06.995971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:06.995971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:33:06.995971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:33:06.995971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:33:06.995971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:33:06.997111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:06.997111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:06.997111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:33:06.997111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:33:06.997111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:33:06.997111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:33:06.997111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:06.997111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:06.997111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:06.997111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:06.997111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:06.997111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:06.997111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:06.997111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:06.997111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:06.997111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:06.997111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:06.997111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:06.998265 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:06.998265 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:06.998265 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:33:06.998265 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:33:06.998265 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:33:06.998265 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:33:06.998265 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:33:06.998265 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:33:06.998265 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 08:33:06.998265 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:06.998265 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 491/964] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:33:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:33:07.004050 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83524da2-e785-4de9-b0c0-06faa779d6c5 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:07.072170 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:07.109476 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83524da2-e785-4de9-b0c0-06faa779d6c5 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:07.144343 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35efdbab-b7ba-41e1-844d-198648cd927e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:07.145102 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efdbab-b7ba-41e1-844d-198648cd927e None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:07.145457 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efdbab-b7ba-41e1-844d-198648cd927e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:07.145806 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efdbab-b7ba-41e1-844d-198648cd927e None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:07.146743 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35efdbab-b7ba-41e1-844d-198648cd927e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:07.147124 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35efdbab-b7ba-41e1-844d-198648cd927e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:07.148913 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35efdbab-b7ba-41e1-844d-198648cd927e None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:07.188916 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 474/965] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 08:33:07 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:07.706255 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754529ac-2341-419f-8520-6e89f86d2824 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:07.706590 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754529ac-2341-419f-8520-6e89f86d2824 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:07.706819 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754529ac-2341-419f-8520-6e89f86d2824 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:07.710070 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 492/966] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:07.714233 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217c8f2-3fd7-40b1-a5a6-56b5e2f7a146 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:07.714654 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217c8f2-3fd7-40b1-a5a6-56b5e2f7a146 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:07.714823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217c8f2-3fd7-40b1-a5a6-56b5e2f7a146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:07.734976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-d217c8f2-3fd7-40b1-a5a6-56b5e2f7a146 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:07.736560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d217c8f2-3fd7-40b1-a5a6-56b5e2f7a146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:07.806583 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 475/967] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:07.830160 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754529ac-2341-419f-8520-6e89f86d2824 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:07.852200 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:07.936822 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754529ac-2341-419f-8520-6e89f86d2824 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:07.971076 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36dee5-007d-4951-a45e-7822f372f177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:07.971909 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36dee5-007d-4951-a45e-7822f372f177 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:07.972193 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36dee5-007d-4951-a45e-7822f372f177 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:07.972468 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36dee5-007d-4951-a45e-7822f372f177 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:07.973116 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36dee5-007d-4951-a45e-7822f372f177 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:07.974535 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36dee5-007d-4951-a45e-7822f372f177 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:07.988121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-3b36dee5-007d-4951-a45e-7822f372f177 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 08:33:07.988121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:07.988121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:33:07.988121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:33:07.988121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:33:07.988121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:33:07.988121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:33:07.988121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:33:07.988121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 08:33:07.988121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:07.988121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:33:07.988121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:07.988121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:07.988121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:07.988121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:07.988121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:07.988121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:07.989174 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:07.989174 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:07.989174 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:07.989174 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:07.989174 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:07.989174 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:07.989174 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:33:07.989174 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:33:07.989174 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:33:07.989174 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:33:07.989174 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:07.989174 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:07.989174 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:07.989174 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:07.989174 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:07.989174 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:07.990005 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:07.990005 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:07.990005 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:07.990005 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:07.990005 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:07.990005 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:07.990005 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:07.990005 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:07.990005 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:07.990005 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:07.990005 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:33:07.990005 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:33:07.990005 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 08:33:07.990005 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:07.991876 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 493/968] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Jul 25 08:33:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:07.996166 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217c8f2-3fd7-40b1-a5a6-56b5e2f7a146 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:08.052618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:08.099021 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217c8f2-3fd7-40b1-a5a6-56b5e2f7a146 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:08.132639 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a2851-bb21-4406-94ea-ad4bb8a05c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:08.133329 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a2851-bb21-4406-94ea-ad4bb8a05c28 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:08.133611 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a2851-bb21-4406-94ea-ad4bb8a05c28 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:08.133885 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a2851-bb21-4406-94ea-ad4bb8a05c28 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:08.134591 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a2851-bb21-4406-94ea-ad4bb8a05c28 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:08.134894 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a2851-bb21-4406-94ea-ad4bb8a05c28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:08.136272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a2851-bb21-4406-94ea-ad4bb8a05c28 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:08.143818 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 476/969] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Jul 25 08:33:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:08.147570 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36dee5-007d-4951-a45e-7822f372f177 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:08.208076 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401293b-bf09-440a-aa54-c66e8e2feeb6 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:08.208364 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401293b-bf09-440a-aa54-c66e8e2feeb6 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:08.208647 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401293b-bf09-440a-aa54-c66e8e2feeb6 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:08.210009 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 477/970] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:33:08.214885 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc68932-3877-4cc7-8814-7ca5e7dfb35b None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:08.215169 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc68932-3877-4cc7-8814-7ca5e7dfb35b None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:08.215446 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc68932-3877-4cc7-8814-7ca5e7dfb35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:08.239497 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:08.239966 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-9cc68932-3877-4cc7-8814-7ca5e7dfb35b None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:08.241503 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9cc68932-3877-4cc7-8814-7ca5e7dfb35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:08.261012 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36dee5-007d-4951-a45e-7822f372f177 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:08.301047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedd82c-ce4d-41c5-9bc3-cac3476459bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:08.301702 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedd82c-ce4d-41c5-9bc3-cac3476459bc None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:08.301981 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedd82c-ce4d-41c5-9bc3-cac3476459bc None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:08.302261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedd82c-ce4d-41c5-9bc3-cac3476459bc None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:08.302959 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfedd82c-ce4d-41c5-9bc3-cac3476459bc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:08.303263 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfedd82c-ce4d-41c5-9bc3-cac3476459bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:08.304653 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfedd82c-ce4d-41c5-9bc3-cac3476459bc None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:08.314401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 494/971] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Jul 25 08:33:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:08.314401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9256b4-51e7-454c-b0aa-6779b98d1483 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:08.314401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9256b4-51e7-454c-b0aa-6779b98d1483 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:08.314401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9256b4-51e7-454c-b0aa-6779b98d1483 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:08.314401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 495/972] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:08.314800 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 478/973] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 08:33:08.315185 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9256b4-51e7-454c-b0aa-6779b98d1483 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:08.318945 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5b932-d707-482c-b4db-f505984c5441 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:08.319238 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5b932-d707-482c-b4db-f505984c5441 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:08.319518 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5b932-d707-482c-b4db-f505984c5441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:08.337916 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-17b5b932-d707-482c-b4db-f505984c5441 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:08.339107 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-17b5b932-d707-482c-b4db-f505984c5441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:08.382422 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:08.406446 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 479/974] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:08.407312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5b932-d707-482c-b4db-f505984c5441 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:08.419239 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9256b4-51e7-454c-b0aa-6779b98d1483 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:08.455915 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb9155-5522-42de-b04f-d23bd4d348af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:08.456569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb9155-5522-42de-b04f-d23bd4d348af None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:08.456853 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb9155-5522-42de-b04f-d23bd4d348af None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:08.457129 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb9155-5522-42de-b04f-d23bd4d348af None admin] PATH_INFO: `/v3/endpoints` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:08.457922 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb9155-5522-42de-b04f-d23bd4d348af None admin] RBAC: Adding query filter params (interface=admin, service_id=598ee9e6378248fe839e4dcd971d5c9e, region_id=RegionOne) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:08.458236 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb9155-5522-42de-b04f-d23bd4d348af None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:08.459600 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb9155-5522-42de-b04f-d23bd4d348af None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:08.464539 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 496/975] 10.222.0.18 () {56 vars in 1249 bytes} [Mon Jul 25 08:33:08 2022] GET /identity/v3/endpoints?service_id=598ee9e6378248fe839e4dcd971d5c9e&interface=admin®ion_id=RegionOne => generated 193 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:08.465283 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb9155-5522-42de-b04f-d23bd4d348af None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:08.479791 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:08.510431 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5b932-d707-482c-b4db-f505984c5441 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:08.545824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23befd66-5beb-4671-a745-78098f58d68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:08.546626 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23befd66-5beb-4671-a745-78098f58d68b None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:08.546909 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23befd66-5beb-4671-a745-78098f58d68b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:08.547188 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23befd66-5beb-4671-a745-78098f58d68b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:08.557097 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23befd66-5beb-4671-a745-78098f58d68b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:33:08.563588 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb9155-5522-42de-b04f-d23bd4d348af None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:08.565852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-23befd66-5beb-4671-a745-78098f58d68b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 08:33:08.565852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:08.565852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:08.565852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:08.565852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:08.565852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:08.565852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:08.565852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:08.565852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:08.565852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:08.565852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:08.565852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:08.565852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:33:08.565852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:33:08.565852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:33:08.565852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:33:08.566866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:33:08.566866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:33:08.566866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:33:08.566866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:33:08.566866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:08.566866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:08.566866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:08.566866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:08.566866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:08.566866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:08.566866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:08.566866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:08.566866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:08.566866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:08.566866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:08.566866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:08.567747 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:08.567747 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:08.567747 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:08.567747 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:08.567747 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:33:08.567747 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:33:08.567747 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:33:08.567747 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:33:08.567747 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:33:08.567747 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:33:08.567747 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 08:33:08.567747 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:08.567747 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 480/976] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Jul 25 08:33:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:08.568494 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23befd66-5beb-4671-a745-78098f58d68b None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:08.599418 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a3a29-20f4-4134-9e3f-24b8a6fa5426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:08.600105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a3a29-20f4-4134-9e3f-24b8a6fa5426 None admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:08.600393 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a3a29-20f4-4134-9e3f-24b8a6fa5426 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:08.600663 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a3a29-20f4-4134-9e3f-24b8a6fa5426 None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:08.601374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a3a29-20f4-4134-9e3f-24b8a6fa5426 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:08.602747 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a3a29-20f4-4134-9e3f-24b8a6fa5426 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:08.608277 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:08.667472 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23befd66-5beb-4671-a745-78098f58d68b None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:08.673818 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 497/977] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jul 25 08:33:08 2022] POST /identity/v3/services => generated 242 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:33:08.677568 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a3a29-20f4-4134-9e3f-24b8a6fa5426 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:08.717362 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b4546-4d5d-45d7-812e-e279c92a0790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:08.718453 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b4546-4d5d-45d7-812e-e279c92a0790 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:08.718453 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b4546-4d5d-45d7-812e-e279c92a0790 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:08.718619 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b4546-4d5d-45d7-812e-e279c92a0790 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:08.719270 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b4546-4d5d-45d7-812e-e279c92a0790 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:08.721252 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b4546-4d5d-45d7-812e-e279c92a0790 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:08.739675 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 481/978] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Jul 25 08:33:08 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:33:08.779274 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:08.817809 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a3a29-20f4-4134-9e3f-24b8a6fa5426 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:08.861198 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092d0b9-3f6c-49b9-b70c-7bf4d6946689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:08.861837 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092d0b9-3f6c-49b9-b70c-7bf4d6946689 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:08.861837 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092d0b9-3f6c-49b9-b70c-7bf4d6946689 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:08.861837 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092d0b9-3f6c-49b9-b70c-7bf4d6946689 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:08.862557 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092d0b9-3f6c-49b9-b70c-7bf4d6946689 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:08.862867 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092d0b9-3f6c-49b9-b70c-7bf4d6946689 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:08.864316 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092d0b9-3f6c-49b9-b70c-7bf4d6946689 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:08.874520 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 498/979] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Jul 25 08:33:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:08.880102 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b4546-4d5d-45d7-812e-e279c92a0790 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:08.984944 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:08.988829 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b4546-4d5d-45d7-812e-e279c92a0790 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:09.023137 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473fd6ef-7d53-4638-adef-7a82a64c1371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:09.023960 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473fd6ef-7d53-4638-adef-7a82a64c1371 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:09.024252 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473fd6ef-7d53-4638-adef-7a82a64c1371 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:09.024532 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473fd6ef-7d53-4638-adef-7a82a64c1371 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:09.036420 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473fd6ef-7d53-4638-adef-7a82a64c1371 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:09.037917 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473fd6ef-7d53-4638-adef-7a82a64c1371 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:09.055761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-473fd6ef-7d53-4638-adef-7a82a64c1371 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:09.055761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:09.055761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:09.055761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:09.055761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:09.055761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:09.055761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:09.055761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:09.055761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:09.055761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:09.055761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:09.055761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:09.055761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:33:09.055761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:33:09.055761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:33:09.056693 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:33:09.056693 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:09.056693 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:09.056693 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:09.056693 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:09.056693 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:09.056693 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:09.056693 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:09.056693 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:09.056693 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:09.056693 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:09.056693 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:09.056693 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:09.056693 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:09.056693 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:09.056693 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:09.056693 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:09.057616 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:33:09.057616 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:33:09.057616 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:09.057616 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:09.057616 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 482/980] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:09.063473 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092d0b9-3f6c-49b9-b70c-7bf4d6946689 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:09.164067 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092d0b9-3f6c-49b9-b70c-7bf4d6946689 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:09.199094 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c93861-a9c6-433d-9da4-02f4ab642c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:09.199789 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c93861-a9c6-433d-9da4-02f4ab642c53 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:09.200077 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c93861-a9c6-433d-9da4-02f4ab642c53 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:09.200354 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c93861-a9c6-433d-9da4-02f4ab642c53 None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:09.201076 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c93861-a9c6-433d-9da4-02f4ab642c53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:09.201386 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c93861-a9c6-433d-9da4-02f4ab642c53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:09.202817 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c93861-a9c6-433d-9da4-02f4ab642c53 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:09.204439 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:09.215859 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 499/981] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:09.221873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473fd6ef-7d53-4638-adef-7a82a64c1371 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:09.326266 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473fd6ef-7d53-4638-adef-7a82a64c1371 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:09.364134 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544faa0-14ad-4f3b-8f26-09f8d76fee38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:09.364944 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544faa0-14ad-4f3b-8f26-09f8d76fee38 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:09.365231 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544faa0-14ad-4f3b-8f26-09f8d76fee38 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:09.365508 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544faa0-14ad-4f3b-8f26-09f8d76fee38 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:09.373069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0544faa0-14ad-4f3b-8f26-09f8d76fee38 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:09.374539 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0544faa0-14ad-4f3b-8f26-09f8d76fee38 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:09.388830 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-0544faa0-14ad-4f3b-8f26-09f8d76fee38 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 08:33:09.388830 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:09.388830 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:09.388830 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:09.388830 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:09.388830 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:09.388830 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:09.388830 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:09.388830 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:09.388830 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:09.388830 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:09.388830 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:09.388830 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:33:09.388830 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:33:09.388830 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:33:09.388830 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:33:09.390141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:09.390141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:09.390141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:33:09.390141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:33:09.390141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:33:09.390141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:33:09.390141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:09.390141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:09.390141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:09.390141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:09.390141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:09.390141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:09.390141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:09.390141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:09.390141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:09.390141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:09.390141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:09.390141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:09.391128 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:09.391128 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:09.391128 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:33:09.391128 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:33:09.391128 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:33:09.391128 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:33:09.391128 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:33:09.391128 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:33:09.391128 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 08:33:09.391128 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:09.395655 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 483/982] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Jul 25 08:33:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:09.396004 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c93861-a9c6-433d-9da4-02f4ab642c53 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:09.501484 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c93861-a9c6-433d-9da4-02f4ab642c53 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:09.535818 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c062ee1-8be5-4cc2-b238-bee8e7969095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:09.536499 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c062ee1-8be5-4cc2-b238-bee8e7969095 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:09.536786 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c062ee1-8be5-4cc2-b238-bee8e7969095 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:09.537066 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c062ee1-8be5-4cc2-b238-bee8e7969095 None admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:09.537907 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c062ee1-8be5-4cc2-b238-bee8e7969095 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:09.538217 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c062ee1-8be5-4cc2-b238-bee8e7969095 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:09.539673 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c062ee1-8be5-4cc2-b238-bee8e7969095 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:09.562201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 500/983] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Jul 25 08:33:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:09.563533 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544faa0-14ad-4f3b-8f26-09f8d76fee38 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:09.576575 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:09.666804 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544faa0-14ad-4f3b-8f26-09f8d76fee38 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:09.705521 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912b685-bb42-420a-bcdb-00a93a47d6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:09.706356 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912b685-bb42-420a-bcdb-00a93a47d6cf None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:09.706462 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912b685-bb42-420a-bcdb-00a93a47d6cf None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:09.709377 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912b685-bb42-420a-bcdb-00a93a47d6cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:09.779658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912b685-bb42-420a-bcdb-00a93a47d6cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:09.781784 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912b685-bb42-420a-bcdb-00a93a47d6cf None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:09.793139 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:09.886144 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 484/984] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:33:09 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 08:33:09.892528 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c062ee1-8be5-4cc2-b238-bee8e7969095 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:09.948533 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:09.995594 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c062ee1-8be5-4cc2-b238-bee8e7969095 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:10.029451 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1dcc8-100f-448e-addd-31e294f7680d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:10.030952 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1dcc8-100f-448e-addd-31e294f7680d None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:10.031279 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1dcc8-100f-448e-addd-31e294f7680d None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:10.031560 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1dcc8-100f-448e-addd-31e294f7680d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:10.041720 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1dcc8-100f-448e-addd-31e294f7680d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:10.043168 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1dcc8-100f-448e-addd-31e294f7680d None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:10.061158 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-c0e1dcc8-100f-448e-addd-31e294f7680d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:10.061158 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:10.061158 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:10.061158 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:10.061158 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:10.061158 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:10.061158 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:10.061158 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:10.061158 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:10.061158 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:10.061158 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:10.061158 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:10.061158 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:33:10.061158 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:33:10.061158 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:33:10.062037 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:33:10.062037 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:10.062037 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:10.062037 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:10.062037 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:10.062037 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:10.062037 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:10.062037 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:10.062037 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:10.062037 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:10.062037 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:10.062037 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:10.062037 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:10.062037 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:10.062037 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:10.062037 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:10.062037 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:10.063107 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:33:10.063107 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:33:10.063107 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:10.063107 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:10.063107 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 501/985] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:10.068131 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912b685-bb42-420a-bcdb-00a93a47d6cf None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:10.166614 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912b685-bb42-420a-bcdb-00a93a47d6cf None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:10.178293 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:10.201308 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74711f1-27b3-4210-b2be-10320b1dac7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:10.202091 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74711f1-27b3-4210-b2be-10320b1dac7e None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:10.202407 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74711f1-27b3-4210-b2be-10320b1dac7e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:10.202691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74711f1-27b3-4210-b2be-10320b1dac7e None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:10.203835 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74711f1-27b3-4210-b2be-10320b1dac7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:10.204507 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74711f1-27b3-4210-b2be-10320b1dac7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:10.206316 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74711f1-27b3-4210-b2be-10320b1dac7e None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:10.218895 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 485/986] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:10.224322 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1dcc8-100f-448e-addd-31e294f7680d None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:10.330722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1dcc8-100f-448e-addd-31e294f7680d None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:10.333053 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:10.365663 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57228d40-821b-42c3-b310-f5b7e19297c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:10.366549 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57228d40-821b-42c3-b310-f5b7e19297c5 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:10.366902 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57228d40-821b-42c3-b310-f5b7e19297c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:10.367247 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57228d40-821b-42c3-b310-f5b7e19297c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:10.374191 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57228d40-821b-42c3-b310-f5b7e19297c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:10.375728 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57228d40-821b-42c3-b310-f5b7e19297c5 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:10.389949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-57228d40-821b-42c3-b310-f5b7e19297c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:33:10.389949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:10.389949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:10.389949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:10.389949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:10.389949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:10.389949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:10.389949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:10.389949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:10.389949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:10.389949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:10.389949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:10.389949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:33:10.389949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:33:10.389949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:33:10.391023 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:33:10.391023 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:10.391023 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:10.391023 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:10.391023 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:10.391023 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:10.391023 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:10.391023 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:10.391023 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:10.391023 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:10.391023 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:10.391023 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:10.391023 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:10.391023 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:10.391023 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:10.391023 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:10.391023 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:10.392156 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:33:10.392156 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:33:10.392156 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:33:10.392156 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:33:10.392156 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:33:10.392156 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:33:10.392156 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:33:10.392156 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:10.397754 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 502/987] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:33:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:33:10.399182 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74711f1-27b3-4210-b2be-10320b1dac7e None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:10.499912 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74711f1-27b3-4210-b2be-10320b1dac7e None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:10.534846 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5f776-349b-46e8-80b4-8f558fb39675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:10.535503 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5f776-349b-46e8-80b4-8f558fb39675 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:10.535815 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5f776-349b-46e8-80b4-8f558fb39675 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:10.536091 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5f776-349b-46e8-80b4-8f558fb39675 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:10.536874 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5f776-349b-46e8-80b4-8f558fb39675 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:10.537179 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5f776-349b-46e8-80b4-8f558fb39675 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:10.538603 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5f776-349b-46e8-80b4-8f558fb39675 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:10.550964 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 486/988] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:33:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:10.557023 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57228d40-821b-42c3-b310-f5b7e19297c5 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:10.659454 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57228d40-821b-42c3-b310-f5b7e19297c5 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:10.693317 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d4f45-9358-4eb3-962a-d35afe90eb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:10.697380 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d4f45-9358-4eb3-962a-d35afe90eb25 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:10.697380 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d4f45-9358-4eb3-962a-d35afe90eb25 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:10.697380 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d4f45-9358-4eb3-962a-d35afe90eb25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:10.697380 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d4f45-9358-4eb3-962a-d35afe90eb25 None admin] RBAC: Adding query filter params (role.id=285ea04d109c48018a60d5bbe255a9bd, scope.project.id=be349194440449209f19f6b535ffd4f6, user.id=b3c1d56bc0a64411a68f97a4417b0379) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:10.697380 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d4f45-9358-4eb3-962a-d35afe90eb25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:10.697380 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d4f45-9358-4eb3-962a-d35afe90eb25 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:10.711644 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 503/989] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:33:10 2022] GET /identity/v3/role_assignments?user.id=b3c1d56bc0a64411a68f97a4417b0379&scope.project.id=be349194440449209f19f6b535ffd4f6&role.id=285ea04d109c48018a60d5bbe255a9bd => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:10.758892 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8618c-4ff7-4f35-bfdf-5d71dd811f8b None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:10.759112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8618c-4ff7-4f35-bfdf-5d71dd811f8b None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:10.759399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8618c-4ff7-4f35-bfdf-5d71dd811f8b None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:10.760838 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 487/990] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:10.767363 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b629ef-fd68-457f-a117-895fdebcbe6f None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:10.767737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b629ef-fd68-457f-a117-895fdebcbe6f None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:10.767967 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b629ef-fd68-457f-a117-895fdebcbe6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:10.787751 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-99b629ef-fd68-457f-a117-895fdebcbe6f None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:10.789019 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-99b629ef-fd68-457f-a117-895fdebcbe6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:10.808980 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f896b1b-01d9-41e7-b41e-6d01d797c0c2 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:10.809508 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f896b1b-01d9-41e7-b41e-6d01d797c0c2 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:10.809508 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f896b1b-01d9-41e7-b41e-6d01d797c0c2 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:10.811639 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 488/991] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:33:10.815802 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:10.817432 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397b6fa-8eba-415f-9646-318ab8e5f832 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:10.817720 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397b6fa-8eba-415f-9646-318ab8e5f832 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:10.817998 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397b6fa-8eba-415f-9646-318ab8e5f832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:10.837169 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-f397b6fa-8eba-415f-9646-318ab8e5f832 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:10.838399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f397b6fa-8eba-415f-9646-318ab8e5f832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:10.865049 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:10.865507 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 504/992] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:10 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:10.888180 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b629ef-fd68-457f-a117-895fdebcbe6f None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:10.922140 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 489/993] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:10 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:10.944761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397b6fa-8eba-415f-9646-318ab8e5f832 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:10.997399 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b629ef-fd68-457f-a117-895fdebcbe6f None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:11.034869 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1f0dc-8c2d-443c-a8b8-a4e1f8389346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:11.035586 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1f0dc-8c2d-443c-a8b8-a4e1f8389346 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:11.035907 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1f0dc-8c2d-443c-a8b8-a4e1f8389346 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:11.036186 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1f0dc-8c2d-443c-a8b8-a4e1f8389346 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:11.036840 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1f0dc-8c2d-443c-a8b8-a4e1f8389346 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:11.038362 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1f0dc-8c2d-443c-a8b8-a4e1f8389346 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:11.049034 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397b6fa-8eba-415f-9646-318ab8e5f832 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:11.051401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-72c1f0dc-8c2d-443c-a8b8-a4e1f8389346 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 08:33:11.051401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:11.051401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:33:11.051401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:33:11.051401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:33:11.051401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:33:11.051401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:33:11.051401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:33:11.051401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 08:33:11.051401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:11.051401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:33:11.051401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:11.051401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:11.051401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:11.051401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:11.051401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:11.051401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:11.052437 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:11.052437 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:11.052437 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:11.052437 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:11.052437 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:11.052437 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:11.052437 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:33:11.052437 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:33:11.052437 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:33:11.052437 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:33:11.052437 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:11.052437 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:11.052437 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:11.052437 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:11.052437 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:11.052437 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:11.053263 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:11.053263 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:11.053263 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:11.053263 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:11.053263 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:11.053263 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:11.053263 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:11.053263 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:11.053263 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:11.053263 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:11.053263 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:33:11.053263 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:33:11.053263 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 08:33:11.053263 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:11.053263 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 505/994] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:33:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:33:11.058444 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1f0dc-8c2d-443c-a8b8-a4e1f8389346 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:11.085669 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:11.088698 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743e43c-1720-4916-8b60-3ed234e4041a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:11.089512 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743e43c-1720-4916-8b60-3ed234e4041a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:11.089799 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743e43c-1720-4916-8b60-3ed234e4041a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:11.090079 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743e43c-1720-4916-8b60-3ed234e4041a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:11.090795 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743e43c-1720-4916-8b60-3ed234e4041a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:11.092290 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743e43c-1720-4916-8b60-3ed234e4041a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:11.104435 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-3743e43c-1720-4916-8b60-3ed234e4041a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 08:33:11.104435 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:11.104435 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:33:11.104435 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:33:11.104435 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:33:11.104435 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:33:11.104435 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:33:11.104435 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:33:11.104435 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 08:33:11.104435 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:11.104435 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:33:11.104435 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:11.104435 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:11.104435 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:11.104435 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:11.104435 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:11.104435 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:11.105433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:11.105433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:11.105433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:11.105433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:11.105433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:11.105433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:11.105433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:33:11.105433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:33:11.105433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:33:11.105433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:33:11.105433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:11.105433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:11.105433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:11.105433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:11.105433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:11.105433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:11.106289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:11.106289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:11.106289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:11.106289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:11.106289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:11.106289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:11.106289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:11.106289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:11.106289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:11.106289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:11.106289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:33:11.106289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:33:11.106289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 08:33:11.106289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:11.106289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 490/995] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Jul 25 08:33:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:33:11.112239 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743e43c-1720-4916-8b60-3ed234e4041a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:11.138456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:11.167852 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1f0dc-8c2d-443c-a8b8-a4e1f8389346 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:11.204591 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fcad58-a6b4-4d25-b64e-e3ab48e5b94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:11.206653 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcad58-a6b4-4d25-b64e-e3ab48e5b94e None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:11.206653 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcad58-a6b4-4d25-b64e-e3ab48e5b94e None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:11.206653 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcad58-a6b4-4d25-b64e-e3ab48e5b94e None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:11.206653 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fcad58-a6b4-4d25-b64e-e3ab48e5b94e None admin] RBAC: Adding query filter params (name=compute) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:11.206983 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fcad58-a6b4-4d25-b64e-e3ab48e5b94e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:11.208203 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fcad58-a6b4-4d25-b64e-e3ab48e5b94e None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:11.213470 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 506/996] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jul 25 08:33:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:11.219111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fcad58-a6b4-4d25-b64e-e3ab48e5b94e None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:11.222641 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743e43c-1720-4916-8b60-3ed234e4041a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:11.257739 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958199a-c1c8-4234-8149-b9b44dd0e4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:11.258405 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958199a-c1c8-4234-8149-b9b44dd0e4f8 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:11.258693 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958199a-c1c8-4234-8149-b9b44dd0e4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:11.258979 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958199a-c1c8-4234-8149-b9b44dd0e4f8 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:11.259718 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b958199a-c1c8-4234-8149-b9b44dd0e4f8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:11.260031 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b958199a-c1c8-4234-8149-b9b44dd0e4f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:11.261438 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b958199a-c1c8-4234-8149-b9b44dd0e4f8 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:11.271641 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 491/997] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Jul 25 08:33:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:11.273173 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958199a-c1c8-4234-8149-b9b44dd0e4f8 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:11.307765 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:11.322738 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fcad58-a6b4-4d25-b64e-e3ab48e5b94e None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:11.358158 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8da22-28c5-4cac-8934-34cdcbecab77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:11.359058 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8da22-28c5-4cac-8934-34cdcbecab77 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:11.359344 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8da22-28c5-4cac-8934-34cdcbecab77 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:11.359647 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8da22-28c5-4cac-8934-34cdcbecab77 None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:11.360349 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8da22-28c5-4cac-8934-34cdcbecab77 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:11.360658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8da22-28c5-4cac-8934-34cdcbecab77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:11.362025 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8da22-28c5-4cac-8934-34cdcbecab77 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:11.367200 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 507/998] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jul 25 08:33:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:11.372922 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8da22-28c5-4cac-8934-34cdcbecab77 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:11.375744 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:11.390329 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958199a-c1c8-4234-8149-b9b44dd0e4f8 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:11.428706 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28d13b-9ed1-4522-b590-431f86b305bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:11.429370 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28d13b-9ed1-4522-b590-431f86b305bc None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:11.429654 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28d13b-9ed1-4522-b590-431f86b305bc None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:11.429934 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28d13b-9ed1-4522-b590-431f86b305bc None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:11.430655 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28d13b-9ed1-4522-b590-431f86b305bc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:11.430968 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28d13b-9ed1-4522-b590-431f86b305bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:11.432382 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28d13b-9ed1-4522-b590-431f86b305bc None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:11.443179 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 492/999] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Jul 25 08:33:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:11.443941 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28d13b-9ed1-4522-b590-431f86b305bc None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:11.483281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8da22-28c5-4cac-8934-34cdcbecab77 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:11.520205 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06156ccf-b3db-44f7-98c8-5f43dd467925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:11.520906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06156ccf-b3db-44f7-98c8-5f43dd467925 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:11.521198 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06156ccf-b3db-44f7-98c8-5f43dd467925 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:11.521475 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06156ccf-b3db-44f7-98c8-5f43dd467925 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:11.522262 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06156ccf-b3db-44f7-98c8-5f43dd467925 None admin] RBAC: Adding query filter params (interface=public, service_id=90d61169c51b452f8614550e76410631, region_id=RegionOne) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:11.522578 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06156ccf-b3db-44f7-98c8-5f43dd467925 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:11.523992 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06156ccf-b3db-44f7-98c8-5f43dd467925 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:11.529644 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 508/1000] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Jul 25 08:33:11 2022] GET /identity/v3/endpoints?service_id=90d61169c51b452f8614550e76410631&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:11.535575 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06156ccf-b3db-44f7-98c8-5f43dd467925 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:11.552858 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:11.554945 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28d13b-9ed1-4522-b590-431f86b305bc None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:11.592013 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afdacf7-9d77-4f45-aa21-f4e767071328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:11.592690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdacf7-9d77-4f45-aa21-f4e767071328 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:11.592978 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdacf7-9d77-4f45-aa21-f4e767071328 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:11.593692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdacf7-9d77-4f45-aa21-f4e767071328 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:11.594451 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afdacf7-9d77-4f45-aa21-f4e767071328 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:11.596042 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afdacf7-9d77-4f45-aa21-f4e767071328 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:11.642698 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06156ccf-b3db-44f7-98c8-5f43dd467925 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:11.677885 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 493/1001] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:33:11 2022] POST /identity/v3/endpoints => generated 325 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:33:11.691596 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbc067-1b47-45a9-a390-5d4aa82857b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:11.692308 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbc067-1b47-45a9-a390-5d4aa82857b5 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:11.692590 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbc067-1b47-45a9-a390-5d4aa82857b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:11.692865 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbc067-1b47-45a9-a390-5d4aa82857b5 None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:11.693554 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fbc067-1b47-45a9-a390-5d4aa82857b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:11.695763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fbc067-1b47-45a9-a390-5d4aa82857b5 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:11.711655 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 509/1002] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Jul 25 08:33:11 2022] GET /identity/v3/services => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:33:12.788219 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46b187-b714-4741-a912-df63b808d7b7 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:12.788747 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46b187-b714-4741-a912-df63b808d7b7 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:12.788747 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46b187-b714-4741-a912-df63b808d7b7 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:12.790152 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 494/1003] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:12.795247 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57371c-eb0b-4388-80d6-9c929a1c7359 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:12.795765 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57371c-eb0b-4388-80d6-9c929a1c7359 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:12.796139 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57371c-eb0b-4388-80d6-9c929a1c7359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:12.815712 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-fc57371c-eb0b-4388-80d6-9c929a1c7359 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:12.816947 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-fc57371c-eb0b-4388-80d6-9c929a1c7359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:12.895772 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 510/1004] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:12 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:12.911149 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46b187-b714-4741-a912-df63b808d7b7 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:12.927220 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:13.015662 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46b187-b714-4741-a912-df63b808d7b7 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:13.049282 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02d1bf-1cc1-43d2-a76e-d98147f54a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:13.050058 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02d1bf-1cc1-43d2-a76e-d98147f54a93 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:13.050342 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02d1bf-1cc1-43d2-a76e-d98147f54a93 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:13.050668 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02d1bf-1cc1-43d2-a76e-d98147f54a93 None admin] PATH_INFO: `/v3/services/image` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:13.051312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc02d1bf-1cc1-43d2-a76e-d98147f54a93 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:13.052749 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc02d1bf-1cc1-43d2-a76e-d98147f54a93 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:13.064483 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-cc02d1bf-1cc1-43d2-a76e-d98147f54a93 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 08:33:13.064483 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:13.064483 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:33:13.064483 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:33:13.064483 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:33:13.064483 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:33:13.064483 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:33:13.064483 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:33:13.064483 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 08:33:13.064483 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:13.064483 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:33:13.064483 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:13.064483 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:13.064483 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:13.064483 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:13.064483 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:13.064483 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:13.065459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:13.065459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:13.065459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:13.065459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:13.065459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:13.065459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:13.065459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:33:13.065459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:33:13.065459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:33:13.065459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:33:13.065459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:13.065459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:13.065459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:13.065459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:13.065459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:13.065459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:13.071146 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:13.071146 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:13.071146 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:13.071146 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:13.071146 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:13.071146 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:13.071146 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:13.071146 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:13.071146 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:13.071146 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:13.071146 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:33:13.071146 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:33:13.071146 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 08:33:13.071146 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:13.071146 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 495/1005] 10.222.0.18 () {56 vars in 1105 bytes} [Mon Jul 25 08:33:12 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:13.072358 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57371c-eb0b-4388-80d6-9c929a1c7359 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:13.074558 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:13.171633 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57371c-eb0b-4388-80d6-9c929a1c7359 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:13.205908 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d698e-8e19-429e-a607-2e8b2c233407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:13.206625 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d698e-8e19-429e-a607-2e8b2c233407 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:13.206911 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d698e-8e19-429e-a607-2e8b2c233407 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:13.207191 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d698e-8e19-429e-a607-2e8b2c233407 None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:13.207920 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d698e-8e19-429e-a607-2e8b2c233407 None admin] RBAC: Adding query filter params (name=image) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:13.208227 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d698e-8e19-429e-a607-2e8b2c233407 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:13.209651 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d698e-8e19-429e-a607-2e8b2c233407 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:13.219706 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 511/1006] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:13.220862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02d1bf-1cc1-43d2-a76e-d98147f54a93 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:13.300605 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:13.326067 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02d1bf-1cc1-43d2-a76e-d98147f54a93 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:13.362788 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc38f36-bd15-4e74-861e-4f714f482b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:13.363452 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc38f36-bd15-4e74-861e-4f714f482b80 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:13.363777 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc38f36-bd15-4e74-861e-4f714f482b80 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:13.364061 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc38f36-bd15-4e74-861e-4f714f482b80 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:13.364776 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc38f36-bd15-4e74-861e-4f714f482b80 None admin] RBAC: Adding query filter params (type=image) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:13.365092 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc38f36-bd15-4e74-861e-4f714f482b80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:13.366456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc38f36-bd15-4e74-861e-4f714f482b80 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:13.371179 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 496/1007] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:13 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:13.716998 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10476b7c-37cc-4d1f-a019-7b3c41691999 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:13.717945 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10476b7c-37cc-4d1f-a019-7b3c41691999 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:13.718343 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10476b7c-37cc-4d1f-a019-7b3c41691999 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:13.719878 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 512/1008] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:13.725017 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1c3d7-ec5f-4760-b7e5-8672aadb72d9 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:13.725315 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1c3d7-ec5f-4760-b7e5-8672aadb72d9 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:13.725596 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1c3d7-ec5f-4760-b7e5-8672aadb72d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:13.744374 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-e0b1c3d7-ec5f-4760-b7e5-8672aadb72d9 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:13.745556 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-e0b1c3d7-ec5f-4760-b7e5-8672aadb72d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:13.767311 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018119d-d800-4509-8a48-4428cfd5c409 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:13.767644 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018119d-d800-4509-8a48-4428cfd5c409 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:13.767914 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018119d-d800-4509-8a48-4428cfd5c409 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:13.769404 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 513/1009] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:33:13.774056 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c1a34-dd09-4fac-b2f0-e5a2091bd9a7 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:13.774344 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c1a34-dd09-4fac-b2f0-e5a2091bd9a7 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:13.774626 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c1a34-dd09-4fac-b2f0-e5a2091bd9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:13.796573 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-505c1a34-dd09-4fac-b2f0-e5a2091bd9a7 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:13.797773 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-505c1a34-dd09-4fac-b2f0-e5a2091bd9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:13.815070 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 497/1010] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:13 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:13.837566 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1c3d7-ec5f-4760-b7e5-8672aadb72d9 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:13.862031 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:13.875777 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 514/1011] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:13 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 08:33:13.890487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c1a34-dd09-4fac-b2f0-e5a2091bd9a7 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:13.911422 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:13.947944 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1c3d7-ec5f-4760-b7e5-8672aadb72d9 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:13.985259 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7e791-48d2-4481-bb4c-f0b05e56df9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:13.986130 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7e791-48d2-4481-bb4c-f0b05e56df9d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:13.986515 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7e791-48d2-4481-bb4c-f0b05e56df9d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:13.986795 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7e791-48d2-4481-bb4c-f0b05e56df9d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:13.988027 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7e791-48d2-4481-bb4c-f0b05e56df9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:13.989462 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7e791-48d2-4481-bb4c-f0b05e56df9d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:13.995897 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 498/1012] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:13.996033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c1a34-dd09-4fac-b2f0-e5a2091bd9a7 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:13.997539 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7e791-48d2-4481-bb4c-f0b05e56df9d None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:14.030385 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa677c-5381-4d4a-ad7e-1e0e6cc10017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:14.031151 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa677c-5381-4d4a-ad7e-1e0e6cc10017 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:14.031432 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa677c-5381-4d4a-ad7e-1e0e6cc10017 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:14.031728 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa677c-5381-4d4a-ad7e-1e0e6cc10017 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:14.032377 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa677c-5381-4d4a-ad7e-1e0e6cc10017 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:14.033998 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa677c-5381-4d4a-ad7e-1e0e6cc10017 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:14.046250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-b1fa677c-5381-4d4a-ad7e-1e0e6cc10017 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 08:33:14.046250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:14.046250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:33:14.046250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:33:14.046250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:33:14.046250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:33:14.046250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:33:14.046250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:33:14.046250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 08:33:14.046250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:14.046250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:33:14.046250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:14.046250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:14.046250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:14.046250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:14.046250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:14.046250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:14.047242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:14.047242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:14.047242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:14.047242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:14.047242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:14.047242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:14.047242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:33:14.047242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:33:14.047242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:33:14.047242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:33:14.047242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:14.047242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:14.047242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:14.047242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:14.047242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:14.047242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:14.048149 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:14.048149 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:14.048149 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:14.048149 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:14.048149 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:14.048149 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:14.048149 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:14.048149 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:14.048149 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:14.048149 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:14.048149 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:33:14.048149 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:33:14.048149 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 08:33:14.048149 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:14.048149 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 515/1013] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:33:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:33:14.053416 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa677c-5381-4d4a-ad7e-1e0e6cc10017 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:14.104186 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7e791-48d2-4481-bb4c-f0b05e56df9d None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:14.117502 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:14.140358 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36853f-756b-4200-acd9-eb1d9c7b9012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:14.141020 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36853f-756b-4200-acd9-eb1d9c7b9012 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:14.141301 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36853f-756b-4200-acd9-eb1d9c7b9012 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:14.141576 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36853f-756b-4200-acd9-eb1d9c7b9012 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:14.142278 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36853f-756b-4200-acd9-eb1d9c7b9012 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:14.143723 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36853f-756b-4200-acd9-eb1d9c7b9012 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:14.153496 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:14.157249 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa677c-5381-4d4a-ad7e-1e0e6cc10017 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:14.192177 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d2a4b-8eb2-4a31-89da-b931792f3fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:14.192835 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d2a4b-8eb2-4a31-89da-b931792f3fe6 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:14.193116 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d2a4b-8eb2-4a31-89da-b931792f3fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:14.193389 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d2a4b-8eb2-4a31-89da-b931792f3fe6 None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:14.194085 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d2a4b-8eb2-4a31-89da-b931792f3fe6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:14.194390 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d2a4b-8eb2-4a31-89da-b931792f3fe6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:14.195769 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d2a4b-8eb2-4a31-89da-b931792f3fe6 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:14.200452 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 516/1014] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jul 25 08:33:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:14.206479 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d2a4b-8eb2-4a31-89da-b931792f3fe6 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:14.245430 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 499/1015] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jul 25 08:33:13 2022] POST /identity/v3/projects => generated 311 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:33:14.316710 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d2a4b-8eb2-4a31-89da-b931792f3fe6 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:14.345152 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:14.354637 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22155b-f980-4121-a907-7e68cc8ec453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:14.355319 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22155b-f980-4121-a907-7e68cc8ec453 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:14.355599 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22155b-f980-4121-a907-7e68cc8ec453 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:14.358218 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22155b-f980-4121-a907-7e68cc8ec453 None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:14.358218 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b22155b-f980-4121-a907-7e68cc8ec453 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:14.358218 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b22155b-f980-4121-a907-7e68cc8ec453 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:14.358454 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b22155b-f980-4121-a907-7e68cc8ec453 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:14.364411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 517/1016] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jul 25 08:33:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:14.370165 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36853f-756b-4200-acd9-eb1d9c7b9012 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:14.477913 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36853f-756b-4200-acd9-eb1d9c7b9012 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:14.516731 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7448b20-53d1-498c-9fb8-cb935ffb7da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:14.517739 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7448b20-53d1-498c-9fb8-cb935ffb7da0 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:14.518260 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7448b20-53d1-498c-9fb8-cb935ffb7da0 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:14.518738 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7448b20-53d1-498c-9fb8-cb935ffb7da0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:14.520408 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7448b20-53d1-498c-9fb8-cb935ffb7da0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:14.521793 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7448b20-53d1-498c-9fb8-cb935ffb7da0 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:14.599904 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 500/1017] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:33:14 2022] POST /identity/v3/endpoints => generated 334 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:33:15.503873 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e97c81-fe49-440e-9bc9-b3e558aec2c5 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:15.504404 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e97c81-fe49-440e-9bc9-b3e558aec2c5 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:15.504901 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e97c81-fe49-440e-9bc9-b3e558aec2c5 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:15.506927 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 518/1018] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:15.516289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02df0ab-9df2-4bc6-a69b-aa7a806108f5 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:15.516795 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02df0ab-9df2-4bc6-a69b-aa7a806108f5 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:15.516892 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02df0ab-9df2-4bc6-a69b-aa7a806108f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:15.536951 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-a02df0ab-9df2-4bc6-a69b-aa7a806108f5 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:15.539333 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a02df0ab-9df2-4bc6-a69b-aa7a806108f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:15.596033 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:15.634047 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 501/1019] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:15 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:15.661940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e97c81-fe49-440e-9bc9-b3e558aec2c5 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:15.794308 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e97c81-fe49-440e-9bc9-b3e558aec2c5 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:15.829374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e024a9e-6c86-43ae-81ab-3ca2f83bebd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:15.830064 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e024a9e-6c86-43ae-81ab-3ca2f83bebd3 None admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:15.830346 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e024a9e-6c86-43ae-81ab-3ca2f83bebd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:15.830621 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e024a9e-6c86-43ae-81ab-3ca2f83bebd3 None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:15.831374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e024a9e-6c86-43ae-81ab-3ca2f83bebd3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:15.832848 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e024a9e-6c86-43ae-81ab-3ca2f83bebd3 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:15.929264 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 519/1020] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jul 25 08:33:15 2022] POST /identity/v3/services => generated 242 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:33:16.351403 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120b0fd-1a0a-470e-b0fe-50139888de03 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:16.351822 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120b0fd-1a0a-470e-b0fe-50139888de03 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:16.352019 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120b0fd-1a0a-470e-b0fe-50139888de03 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:16.353407 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 502/1021] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:16.359329 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df98fb-214b-4dc3-9e62-ff39588d30f5 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:16.359637 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df98fb-214b-4dc3-9e62-ff39588d30f5 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:16.359939 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df98fb-214b-4dc3-9e62-ff39588d30f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:16.378733 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-d7df98fb-214b-4dc3-9e62-ff39588d30f5 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:16.379946 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-d7df98fb-214b-4dc3-9e62-ff39588d30f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:16.426971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:16.453645 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 520/1022] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:16.477562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120b0fd-1a0a-470e-b0fe-50139888de03 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:16.581731 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120b0fd-1a0a-470e-b0fe-50139888de03 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:16.621107 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc77b1-09bd-4187-9d2b-11b07aae00eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:16.621107 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc77b1-09bd-4187-9d2b-11b07aae00eb None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:16.621107 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc77b1-09bd-4187-9d2b-11b07aae00eb None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:16.621107 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc77b1-09bd-4187-9d2b-11b07aae00eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:16.621494 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc77b1-09bd-4187-9d2b-11b07aae00eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:16.621494 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc77b1-09bd-4187-9d2b-11b07aae00eb None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:16.622493 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 503/1023] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:16.627886 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df98fb-214b-4dc3-9e62-ff39588d30f5 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:16.745326 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df98fb-214b-4dc3-9e62-ff39588d30f5 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:16.760947 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40406e-1f4a-48f3-a4e6-6878d81bbc34 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:16.761237 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40406e-1f4a-48f3-a4e6-6878d81bbc34 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:16.761517 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40406e-1f4a-48f3-a4e6-6878d81bbc34 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:16.762883 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 504/1024] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:33:16.767745 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073037af-cf89-4fbc-8eeb-4f322d4a2ecb None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:16.768040 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073037af-cf89-4fbc-8eeb-4f322d4a2ecb None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:16.768322 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073037af-cf89-4fbc-8eeb-4f322d4a2ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:16.784782 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58b891-801d-4f00-80d5-9983075fdce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:16.785451 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58b891-801d-4f00-80d5-9983075fdce4 None admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:16.785730 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58b891-801d-4f00-80d5-9983075fdce4 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:16.786000 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58b891-801d-4f00-80d5-9983075fdce4 None admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:16.786705 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58b891-801d-4f00-80d5-9983075fdce4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:16.787867 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-073037af-cf89-4fbc-8eeb-4f322d4a2ecb None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:16.788157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58b891-801d-4f00-80d5-9983075fdce4 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:16.789062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-073037af-cf89-4fbc-8eeb-4f322d4a2ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:16.824224 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:16.856617 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 505/1025] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 08:33:16.881055 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073037af-cf89-4fbc-8eeb-4f322d4a2ecb None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:16.901036 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 521/1026] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jul 25 08:33:16 2022] POST /identity/v3/users => generated 285 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:33:16.991917 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073037af-cf89-4fbc-8eeb-4f322d4a2ecb None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:17.030159 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e750ca-b4ec-4424-8975-886a4b809dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:17.030994 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e750ca-b4ec-4424-8975-886a4b809dc8 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:17.031280 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e750ca-b4ec-4424-8975-886a4b809dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:17.031556 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e750ca-b4ec-4424-8975-886a4b809dc8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:17.043847 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e750ca-b4ec-4424-8975-886a4b809dc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:33:17.052730 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-90e750ca-b4ec-4424-8975-886a4b809dc8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 08:33:17.052730 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:17.052730 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:17.052730 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:17.052730 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:17.052730 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:17.052730 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:17.052730 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:17.052730 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:17.052730 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:17.052730 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:17.052730 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:17.052730 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:33:17.052730 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:33:17.052730 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:33:17.052730 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:33:17.053687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:33:17.053687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:33:17.053687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:33:17.053687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:33:17.053687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:17.053687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:17.053687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:17.053687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:17.053687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:17.053687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:17.053687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:17.053687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:17.053687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:17.053687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:17.053687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:17.053687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:17.054546 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:17.054546 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:17.054546 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:17.054546 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:17.054546 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:33:17.054546 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:33:17.054546 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:33:17.054546 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:33:17.054546 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:33:17.054546 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:33:17.054546 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 08:33:17.054546 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:17.054546 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 506/1027] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Jul 25 08:33:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:33:17.060096 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58b891-801d-4f00-80d5-9983075fdce4 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:17.097658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:17.170843 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58b891-801d-4f00-80d5-9983075fdce4 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:17.204534 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1a1e5-40bf-4347-b67c-560ed74d20bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:17.205199 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1a1e5-40bf-4347-b67c-560ed74d20bb None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:17.205533 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1a1e5-40bf-4347-b67c-560ed74d20bb None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:17.205812 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1a1e5-40bf-4347-b67c-560ed74d20bb None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:17.206559 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1a1e5-40bf-4347-b67c-560ed74d20bb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:17.206865 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1a1e5-40bf-4347-b67c-560ed74d20bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:17.208254 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1a1e5-40bf-4347-b67c-560ed74d20bb None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:17.216486 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 522/1028] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Jul 25 08:33:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:17.222543 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e750ca-b4ec-4424-8975-886a4b809dc8 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:17.253916 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:17.323853 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e750ca-b4ec-4424-8975-886a4b809dc8 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:17.359566 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0894de-556f-4432-8131-83cff04711e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:17.360385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0894de-556f-4432-8131-83cff04711e1 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:17.360667 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0894de-556f-4432-8131-83cff04711e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:17.360943 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0894de-556f-4432-8131-83cff04711e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:17.370780 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0894de-556f-4432-8131-83cff04711e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:17.372227 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0894de-556f-4432-8131-83cff04711e1 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:17.390342 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-df0894de-556f-4432-8131-83cff04711e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:17.390342 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:17.390342 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:17.390342 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:17.390342 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:17.390342 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:17.390342 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:17.390342 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:17.390342 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:17.390342 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:17.390342 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:17.390342 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:17.390342 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:33:17.390342 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:33:17.390342 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:33:17.391284 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:33:17.391284 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:17.391284 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:17.391284 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:17.391284 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:17.391284 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:17.391284 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:17.391284 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:17.391284 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:17.391284 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:17.391284 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:17.391284 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:17.391284 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:17.391284 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:17.391284 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:17.391284 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:17.391284 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:17.392671 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:33:17.392671 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:33:17.392671 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:17.392671 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:17.392671 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 507/1029] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:17.397210 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1a1e5-40bf-4347-b67c-560ed74d20bb None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:17.494032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:17.501782 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1a1e5-40bf-4347-b67c-560ed74d20bb None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:17.536431 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e95f8-49f0-4a8b-94cb-7cbf3267ac5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:17.537100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e95f8-49f0-4a8b-94cb-7cbf3267ac5d None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:17.537383 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e95f8-49f0-4a8b-94cb-7cbf3267ac5d None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:17.537660 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e95f8-49f0-4a8b-94cb-7cbf3267ac5d None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:17.538388 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e95f8-49f0-4a8b-94cb-7cbf3267ac5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:17.538695 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e95f8-49f0-4a8b-94cb-7cbf3267ac5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:17.540107 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e95f8-49f0-4a8b-94cb-7cbf3267ac5d None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:17.552879 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 523/1030] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:17.558224 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0894de-556f-4432-8131-83cff04711e1 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:17.643829 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:17.663766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0894de-556f-4432-8131-83cff04711e1 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:17.704712 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b92969-a71a-4c79-ab86-30b3a664aca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:17.705509 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b92969-a71a-4c79-ab86-30b3a664aca3 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:17.705795 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b92969-a71a-4c79-ab86-30b3a664aca3 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:17.706071 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b92969-a71a-4c79-ab86-30b3a664aca3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:17.719105 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b92969-a71a-4c79-ab86-30b3a664aca3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:17.720589 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b92969-a71a-4c79-ab86-30b3a664aca3 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:17.736220 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-15b92969-a71a-4c79-ab86-30b3a664aca3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:33:17.736220 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:17.736220 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:17.736220 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:17.736220 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:17.736220 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:17.736220 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:17.736220 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:17.736220 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:17.736220 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:17.736220 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:17.736220 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:17.736220 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:33:17.736220 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:33:17.736220 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:33:17.736220 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:33:17.737174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:17.737174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:17.737174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:33:17.737174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:33:17.737174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:33:17.737174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:33:17.737174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:17.737174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:17.737174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:17.737174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:17.737174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:17.737174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:17.737174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:17.737174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:17.737174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:17.737174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:17.737174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:17.737174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:17.738135 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:17.738135 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:17.738135 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:33:17.738135 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:33:17.738135 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:33:17.738135 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:33:17.738135 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:33:17.738135 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:33:17.738135 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:33:17.738135 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:17.739270 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 508/1031] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Jul 25 08:33:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:17.743176 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e95f8-49f0-4a8b-94cb-7cbf3267ac5d None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:17.844875 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e95f8-49f0-4a8b-94cb-7cbf3267ac5d None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:17.878333 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee18d7-5664-485c-a15d-0cb9e6ba56c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:17.878996 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee18d7-5664-485c-a15d-0cb9e6ba56c8 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:17.879275 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee18d7-5664-485c-a15d-0cb9e6ba56c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:17.879546 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee18d7-5664-485c-a15d-0cb9e6ba56c8 None admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:17.880419 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee18d7-5664-485c-a15d-0cb9e6ba56c8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:17.880724 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee18d7-5664-485c-a15d-0cb9e6ba56c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:17.882144 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee18d7-5664-485c-a15d-0cb9e6ba56c8 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:17.904466 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 524/1032] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Jul 25 08:33:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:17.906655 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b92969-a71a-4c79-ab86-30b3a664aca3 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:17.985207 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfeb62-9a76-4bb3-8a1b-f5572e3a3651 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:17.985533 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfeb62-9a76-4bb3-8a1b-f5572e3a3651 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:17.985783 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfeb62-9a76-4bb3-8a1b-f5572e3a3651 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:17.987291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 525/1033] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:33:17.992212 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20280f6-f3a6-4b32-a952-1b2fea7134db None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:17.992504 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20280f6-f3a6-4b32-a952-1b2fea7134db None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:17.992786 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20280f6-f3a6-4b32-a952-1b2fea7134db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:18.011000 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-a20280f6-f3a6-4b32-a952-1b2fea7134db None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:18.012465 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-a20280f6-f3a6-4b32-a952-1b2fea7134db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:18.015038 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b92969-a71a-4c79-ab86-30b3a664aca3 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:18.021356 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:18.052430 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf65f60-9b90-431f-9df6-c0d390411a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:18.053156 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf65f60-9b90-431f-9df6-c0d390411a0f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:18.053443 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf65f60-9b90-431f-9df6-c0d390411a0f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:18.053724 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf65f60-9b90-431f-9df6-c0d390411a0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:18.066607 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:18.085562 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 526/1034] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 08:33:18.109287 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20280f6-f3a6-4b32-a952-1b2fea7134db None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:18.127293 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf65f60-9b90-431f-9df6-c0d390411a0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:18.128785 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf65f60-9b90-431f-9df6-c0d390411a0f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:18.222965 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20280f6-f3a6-4b32-a952-1b2fea7134db None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:18.233872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 509/1035] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:33:17 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 08:33:18.239835 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf65f60-9b90-431f-9df6-c0d390411a0f None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:18.261905 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f1339-4caf-49cf-bead-e0912eb8d0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:18.262745 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f1339-4caf-49cf-bead-e0912eb8d0b6 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:18.263436 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f1339-4caf-49cf-bead-e0912eb8d0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:18.263777 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f1339-4caf-49cf-bead-e0912eb8d0b6 None admin] PATH_INFO: `/v3/services/image` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:18.264989 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f1339-4caf-49cf-bead-e0912eb8d0b6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:18.266835 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f1339-4caf-49cf-bead-e0912eb8d0b6 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:18.279217 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-706f1339-4caf-49cf-bead-e0912eb8d0b6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 08:33:18.279217 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:18.279217 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:33:18.279217 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:33:18.279217 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:33:18.279217 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:33:18.279217 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:33:18.279217 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:33:18.279217 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 08:33:18.279217 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:18.279217 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:33:18.279217 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:18.279217 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:18.279217 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:18.279217 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:18.279217 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:18.279217 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:18.281153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:18.281153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:18.281153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:18.281153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:18.281153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:18.281153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:18.281153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:33:18.281153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:33:18.281153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:33:18.281153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:33:18.281153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:18.281153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:18.281153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:18.281153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:18.281153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:18.281153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:18.282103 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:18.282103 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:18.282103 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:18.282103 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:18.282103 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:18.282103 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:18.282103 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:18.282103 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:18.282103 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:18.282103 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:18.282103 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:33:18.282103 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:33:18.282103 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 08:33:18.282103 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:18.282103 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 527/1036] 10.222.0.18 () {56 vars in 1105 bytes} [Mon Jul 25 08:33:18 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:33:18.287186 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f1339-4caf-49cf-bead-e0912eb8d0b6 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:18.288374 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:18.296769 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:18.353361 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf65f60-9b90-431f-9df6-c0d390411a0f None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:18.387971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3c47e-4dd9-4486-b57c-673816da0d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:18.388689 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3c47e-4dd9-4486-b57c-673816da0d84 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:18.389711 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3c47e-4dd9-4486-b57c-673816da0d84 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:18.390002 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3c47e-4dd9-4486-b57c-673816da0d84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:18.391007 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f1339-4caf-49cf-bead-e0912eb8d0b6 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:18.400044 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e3c47e-4dd9-4486-b57c-673816da0d84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:18.401481 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e3c47e-4dd9-4486-b57c-673816da0d84 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:18.419457 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-d3e3c47e-4dd9-4486-b57c-673816da0d84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:18.419457 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:18.419457 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:18.419457 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:18.419457 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:18.419457 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:18.419457 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:18.419457 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:18.419457 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:18.419457 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:18.419457 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:18.419457 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:18.419457 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:33:18.419457 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:33:18.419457 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:33:18.420868 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:33:18.420868 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:18.420868 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:18.420868 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:18.420868 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:18.420868 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:18.420868 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:18.420868 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:18.420868 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:18.420868 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:18.420868 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:18.420868 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:18.420868 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:18.420868 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:18.420868 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:18.420868 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:18.420868 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:18.422433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:33:18.422433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:33:18.422433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:18.422433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:18.422433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 510/1037] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:18.426474 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3c47e-4dd9-4486-b57c-673816da0d84 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:18.427593 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301cffbd-1763-47ff-a9ac-3e7e12284506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:18.428292 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301cffbd-1763-47ff-a9ac-3e7e12284506 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:18.428575 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301cffbd-1763-47ff-a9ac-3e7e12284506 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:18.428851 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301cffbd-1763-47ff-a9ac-3e7e12284506 None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:18.429565 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301cffbd-1763-47ff-a9ac-3e7e12284506 None admin] RBAC: Adding query filter params (name=image) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:18.429875 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301cffbd-1763-47ff-a9ac-3e7e12284506 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:18.431244 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301cffbd-1763-47ff-a9ac-3e7e12284506 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:18.441656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 528/1038] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:18.442907 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301cffbd-1763-47ff-a9ac-3e7e12284506 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:18.524992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:18.527094 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:18.532728 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3c47e-4dd9-4486-b57c-673816da0d84 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:18.558656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301cffbd-1763-47ff-a9ac-3e7e12284506 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:18.567513 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781bfca-b817-4112-82cb-d95ce1c4981a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:18.568266 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781bfca-b817-4112-82cb-d95ce1c4981a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:18.568771 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781bfca-b817-4112-82cb-d95ce1c4981a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:18.569418 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781bfca-b817-4112-82cb-d95ce1c4981a None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:18.570745 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3781bfca-b817-4112-82cb-d95ce1c4981a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:18.571061 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3781bfca-b817-4112-82cb-d95ce1c4981a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:18.572462 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3781bfca-b817-4112-82cb-d95ce1c4981a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:18.588963 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 511/1039] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:18.589892 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781bfca-b817-4112-82cb-d95ce1c4981a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:18.596930 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4e3ca-535b-4e1d-8cdc-2cdbe4133571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:18.601269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4e3ca-535b-4e1d-8cdc-2cdbe4133571 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:18.601269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4e3ca-535b-4e1d-8cdc-2cdbe4133571 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:18.601269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4e3ca-535b-4e1d-8cdc-2cdbe4133571 None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:18.601269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a4e3ca-535b-4e1d-8cdc-2cdbe4133571 None admin] RBAC: Adding query filter params (type=image) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:18.601269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a4e3ca-535b-4e1d-8cdc-2cdbe4133571 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:18.601955 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a4e3ca-535b-4e1d-8cdc-2cdbe4133571 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:18.608579 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 529/1040] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:18.614580 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4e3ca-535b-4e1d-8cdc-2cdbe4133571 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:18.704341 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781bfca-b817-4112-82cb-d95ce1c4981a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:18.724134 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4e3ca-535b-4e1d-8cdc-2cdbe4133571 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:18.745542 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf47f5-6f89-4469-9c0c-08e488e05855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:18.746658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf47f5-6f89-4469-9c0c-08e488e05855 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:18.747177 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf47f5-6f89-4469-9c0c-08e488e05855 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:18.747647 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf47f5-6f89-4469-9c0c-08e488e05855 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:18.755949 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf47f5-6f89-4469-9c0c-08e488e05855 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:18.757571 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf47f5-6f89-4469-9c0c-08e488e05855 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:18.758239 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdaf4c-d0a0-42bd-ab99-280ef34d66b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:18.758893 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdaf4c-d0a0-42bd-ab99-280ef34d66b6 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:18.759182 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdaf4c-d0a0-42bd-ab99-280ef34d66b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:18.759463 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdaf4c-d0a0-42bd-ab99-280ef34d66b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:18.760290 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fdaf4c-d0a0-42bd-ab99-280ef34d66b6 None admin] RBAC: Adding query filter params (interface=public, service_id=289fd98d7a3b43528ffff43fc059d364, region_id=RegionOne) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:18.760611 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fdaf4c-d0a0-42bd-ab99-280ef34d66b6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:18.762086 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fdaf4c-d0a0-42bd-ab99-280ef34d66b6 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:18.763546 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:18.767937 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 530/1041] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Jul 25 08:33:18 2022] GET /identity/v3/endpoints?service_id=289fd98d7a3b43528ffff43fc059d364&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:18.773349 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdaf4c-d0a0-42bd-ab99-280ef34d66b6 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:18.774595 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-c6bf47f5-6f89-4469-9c0c-08e488e05855 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:33:18.774595 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:18.774595 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:18.774595 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:18.774595 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:18.774595 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:18.774595 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:18.774595 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:18.774595 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:18.774595 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:18.774595 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:18.774595 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:18.774595 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:33:18.774595 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:33:18.774595 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:33:18.780353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:33:18.780353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:18.780353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:18.780353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:18.780353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:18.780353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:18.780353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:18.780353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:18.780353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:18.780353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:18.780353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:18.780353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:18.780353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:18.780353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:18.780353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:18.780353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:18.780353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:18.781455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:33:18.781455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:33:18.781455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:33:18.781455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:33:18.781455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:33:18.781455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:33:18.781455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:33:18.781455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:18.781455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 512/1042] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:33:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:18.781964 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf47f5-6f89-4469-9c0c-08e488e05855 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:18.798862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:18.888890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdaf4c-d0a0-42bd-ab99-280ef34d66b6 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:18.890588 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf47f5-6f89-4469-9c0c-08e488e05855 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:18.925748 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31024bcb-67b1-4ad6-8b42-d4350243a56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:18.926515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31024bcb-67b1-4ad6-8b42-d4350243a56b None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:18.926809 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31024bcb-67b1-4ad6-8b42-d4350243a56b None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:18.927089 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31024bcb-67b1-4ad6-8b42-d4350243a56b None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:18.927637 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db5f84-8dda-4c49-9f75-3f53c0c6fe77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:18.927846 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31024bcb-67b1-4ad6-8b42-d4350243a56b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:18.928307 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db5f84-8dda-4c49-9f75-3f53c0c6fe77 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:18.928593 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db5f84-8dda-4c49-9f75-3f53c0c6fe77 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:18.928872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db5f84-8dda-4c49-9f75-3f53c0c6fe77 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:18.929192 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31024bcb-67b1-4ad6-8b42-d4350243a56b None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:18.929664 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db5f84-8dda-4c49-9f75-3f53c0c6fe77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:18.929976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db5f84-8dda-4c49-9f75-3f53c0c6fe77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:18.931387 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db5f84-8dda-4c49-9f75-3f53c0c6fe77 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:18.936796 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 531/1043] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Jul 25 08:33:18 2022] GET /identity/v3/services => generated 1957 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:33:18.949481 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 513/1044] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:33:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:18.950708 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31024bcb-67b1-4ad6-8b42-d4350243a56b None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:19.020608 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:19.044510 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5d091-21be-451a-a326-1ccd5cae6e5d None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:19.044857 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5d091-21be-451a-a326-1ccd5cae6e5d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:19.045177 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5d091-21be-451a-a326-1ccd5cae6e5d None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:19.047442 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 514/1045] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:33:19.053103 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702762e-c4cd-4324-ae0b-6429a277c77c None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:19.053428 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702762e-c4cd-4324-ae0b-6429a277c77c None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:19.053676 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702762e-c4cd-4324-ae0b-6429a277c77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:19.066951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31024bcb-67b1-4ad6-8b42-d4350243a56b None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:19.075989 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-1702762e-c4cd-4324-ae0b-6429a277c77c None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:19.077875 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-1702762e-c4cd-4324-ae0b-6429a277c77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:19.107054 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a487d-2a29-45c3-a9f7-164e2f1cd41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:19.108375 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a487d-2a29-45c3-a9f7-164e2f1cd41a None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:19.108666 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a487d-2a29-45c3-a9f7-164e2f1cd41a None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:19.108947 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a487d-2a29-45c3-a9f7-164e2f1cd41a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:19.109813 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a487d-2a29-45c3-a9f7-164e2f1cd41a None admin] RBAC: Adding query filter params (role.id=285ea04d109c48018a60d5bbe255a9bd, scope.project.id=be349194440449209f19f6b535ffd4f6, user.id=1c1a08d3a76643a9996dc0daa8714ac6) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:19.110723 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a487d-2a29-45c3-a9f7-164e2f1cd41a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:19.111558 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a487d-2a29-45c3-a9f7-164e2f1cd41a None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:19.117472 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 532/1046] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:33:18 2022] GET /identity/v3/role_assignments?user.id=1c1a08d3a76643a9996dc0daa8714ac6&scope.project.id=be349194440449209f19f6b535ffd4f6&role.id=285ea04d109c48018a60d5bbe255a9bd => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:19.160057 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 515/1047] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:19.183194 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a487d-2a29-45c3-a9f7-164e2f1cd41a None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:19.294073 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a487d-2a29-45c3-a9f7-164e2f1cd41a None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:19.320689 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:19.329165 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f4e57-11ea-4e79-b642-e7d346ef1c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:19.329962 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f4e57-11ea-4e79-b642-e7d346ef1c5f None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:19.330245 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f4e57-11ea-4e79-b642-e7d346ef1c5f None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:19.330520 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f4e57-11ea-4e79-b642-e7d346ef1c5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:19.340977 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f4e57-11ea-4e79-b642-e7d346ef1c5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:33:19.359540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-4f2f4e57-11ea-4e79-b642-e7d346ef1c5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:33:19.359540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:19.359540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:19.359540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:19.359540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:19.359540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:19.359540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:19.359540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:19.359540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:19.359540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:19.359540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:19.359540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:19.359540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:33:19.359540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:33:19.359540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:33:19.359540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:33:19.360676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:33:19.360676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:33:19.360676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:33:19.360676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:33:19.360676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:19.360676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:19.360676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:19.360676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:19.360676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:19.360676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:19.360676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:19.360676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:19.360676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:19.360676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:19.360676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:19.360676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:19.361722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:19.361722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:19.361722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:19.361722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:19.361722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:33:19.361722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:33:19.361722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:33:19.361722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:33:19.361722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:33:19.361722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:33:19.361722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:33:19.361722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:19.361722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 533/1048] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:33:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:19.362607 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702762e-c4cd-4324-ae0b-6429a277c77c None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:19.362607 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:19.463355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702762e-c4cd-4324-ae0b-6429a277c77c None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:19.499392 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40561b4b-8383-4fca-8d3a-4bbb31fae0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:19.500093 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40561b4b-8383-4fca-8d3a-4bbb31fae0ea None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:19.500378 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40561b4b-8383-4fca-8d3a-4bbb31fae0ea None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:19.500656 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40561b4b-8383-4fca-8d3a-4bbb31fae0ea None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:19.501408 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40561b4b-8383-4fca-8d3a-4bbb31fae0ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:19.501714 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40561b4b-8383-4fca-8d3a-4bbb31fae0ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:19.503075 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40561b4b-8383-4fca-8d3a-4bbb31fae0ea None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:19.511316 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 516/1049] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:33:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:19.517709 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f4e57-11ea-4e79-b642-e7d346ef1c5f None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:19.624964 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f4e57-11ea-4e79-b642-e7d346ef1c5f None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:19.660839 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980d92d-1900-40cd-9cac-84f8e2173df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:19.661712 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980d92d-1900-40cd-9cac-84f8e2173df7 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:19.662000 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980d92d-1900-40cd-9cac-84f8e2173df7 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:19.662282 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980d92d-1900-40cd-9cac-84f8e2173df7 None admin] PATH_INFO: `/v3/users/b93ae5981ef34aa09a6e97682925eadf` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:19.675728 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980d92d-1900-40cd-9cac-84f8e2173df7 None admin] RBAC: Authorizing `identity:get_user(user_id=b93ae5981ef34aa09a6e97682925eadf)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:19.677187 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980d92d-1900-40cd-9cac-84f8e2173df7 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:19.683538 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 534/1050] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:33:19 2022] GET /identity/v3/users/b93ae5981ef34aa09a6e97682925eadf => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:19.684618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40561b4b-8383-4fca-8d3a-4bbb31fae0ea None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:19.751208 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:19.788192 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40561b4b-8383-4fca-8d3a-4bbb31fae0ea None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:19.822148 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98894b0-094d-4bd6-b9f1-f210c43de02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:19.822790 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98894b0-094d-4bd6-b9f1-f210c43de02b None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:19.823072 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98894b0-094d-4bd6-b9f1-f210c43de02b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:19.823347 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98894b0-094d-4bd6-b9f1-f210c43de02b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:19.895201 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98894b0-094d-4bd6-b9f1-f210c43de02b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:19.896589 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98894b0-094d-4bd6-b9f1-f210c43de02b None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:19.962843 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:20.004432 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 517/1051] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:33:19 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 08:33:20.005340 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980d92d-1900-40cd-9cac-84f8e2173df7 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:20.052077 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:20.109186 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980d92d-1900-40cd-9cac-84f8e2173df7 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:20.143752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46020607-f55a-4eb7-b3a5-391c0754d4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:20.144614 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46020607-f55a-4eb7-b3a5-391c0754d4e8 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:20.144898 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46020607-f55a-4eb7-b3a5-391c0754d4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:20.145175 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46020607-f55a-4eb7-b3a5-391c0754d4e8 None admin] PATH_INFO: `/v3/projects/4d87fecb76144f898c137682180a3c01` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:20.146398 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46020607-f55a-4eb7-b3a5-391c0754d4e8 None admin] RBAC: Authorizing `identity:get_project(project_id=4d87fecb76144f898c137682180a3c01)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:20.147819 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46020607-f55a-4eb7-b3a5-391c0754d4e8 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:20.149675 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 535/1052] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:33:20 2022] GET /identity/v3/projects/4d87fecb76144f898c137682180a3c01 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:20.155637 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98894b0-094d-4bd6-b9f1-f210c43de02b None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:20.256504 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98894b0-094d-4bd6-b9f1-f210c43de02b None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:20.293186 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f9776-4046-42bd-bfa9-95d3845dd8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:20.293844 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f9776-4046-42bd-bfa9-95d3845dd8ad None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:20.294129 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f9776-4046-42bd-bfa9-95d3845dd8ad None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:20.294407 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f9776-4046-42bd-bfa9-95d3845dd8ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:20.295874 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f9776-4046-42bd-bfa9-95d3845dd8ad None admin] RBAC: Adding query filter params (role.id=25b0f48c10474bf6b98aad8f093868ee, scope.project.id=4d87fecb76144f898c137682180a3c01, user.id=b93ae5981ef34aa09a6e97682925eadf) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:20.296162 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f9776-4046-42bd-bfa9-95d3845dd8ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:20.297629 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f9776-4046-42bd-bfa9-95d3845dd8ad None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:20.311892 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 518/1053] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:33:20 2022] GET /identity/v3/role_assignments?user.id=b93ae5981ef34aa09a6e97682925eadf&scope.project.id=4d87fecb76144f898c137682180a3c01&role.id=25b0f48c10474bf6b98aad8f093868ee => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:20.970350 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dff5ab-d86e-45b8-b58e-0fcc632d82fe None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:20.970572 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dff5ab-d86e-45b8-b58e-0fcc632d82fe None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:20.970815 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dff5ab-d86e-45b8-b58e-0fcc632d82fe None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:20.972365 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 536/1054] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:20.977849 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a4843-2419-4a43-b59e-91ed04e348b1 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:20.978313 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a4843-2419-4a43-b59e-91ed04e348b1 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:20.978408 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a4843-2419-4a43-b59e-91ed04e348b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:20.996539 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-a32a4843-2419-4a43-b59e-91ed04e348b1 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:20.997725 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a32a4843-2419-4a43-b59e-91ed04e348b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:21.023047 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:21.068418 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 519/1055] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:21.090597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dff5ab-d86e-45b8-b58e-0fcc632d82fe None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:21.173722 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83766492-6f21-4485-b307-7d506ce2b971 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:21.174023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83766492-6f21-4485-b307-7d506ce2b971 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:21.174302 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83766492-6f21-4485-b307-7d506ce2b971 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:21.175870 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 520/1056] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:33:21.180991 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93aecdc-da10-40c1-b7b4-e2e956c2d45b None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:21.181283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93aecdc-da10-40c1-b7b4-e2e956c2d45b None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:21.181561 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93aecdc-da10-40c1-b7b4-e2e956c2d45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:21.195940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dff5ab-d86e-45b8-b58e-0fcc632d82fe None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:21.200101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-a93aecdc-da10-40c1-b7b4-e2e956c2d45b None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:21.201320 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a93aecdc-da10-40c1-b7b4-e2e956c2d45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:21.209680 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:21.231036 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382890d5-989a-433c-b1ea-b0a3fc21d49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:21.231778 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382890d5-989a-433c-b1ea-b0a3fc21d49b None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:21.232061 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382890d5-989a-433c-b1ea-b0a3fc21d49b None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:21.232338 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382890d5-989a-433c-b1ea-b0a3fc21d49b None admin] PATH_INFO: `/v3/services/image` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:21.233575 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382890d5-989a-433c-b1ea-b0a3fc21d49b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:21.234995 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382890d5-989a-433c-b1ea-b0a3fc21d49b None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:21.249512 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-382890d5-989a-433c-b1ea-b0a3fc21d49b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 08:33:21.249512 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:21.249512 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:33:21.249512 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:33:21.249512 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:33:21.249512 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:33:21.249512 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:33:21.249512 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:33:21.249512 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 08:33:21.249512 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:21.249512 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:33:21.249512 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:21.249512 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:21.249512 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:21.249512 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:21.249512 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:21.249512 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:21.250530 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:21.250530 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:21.250530 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:21.250530 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:21.250530 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:21.250530 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:21.250530 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:33:21.250530 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:33:21.250530 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:33:21.250530 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:33:21.250530 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:21.250530 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:21.250530 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:21.250530 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:21.250530 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:21.250530 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:21.251372 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:21.251372 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:21.251372 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:21.251372 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:21.251372 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:21.251372 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:21.251372 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:21.251372 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:21.251372 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:21.251372 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:21.251372 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:33:21.251372 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:33:21.251372 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 08:33:21.251372 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:21.251372 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 537/1057] 10.222.0.18 () {56 vars in 1105 bytes} [Mon Jul 25 08:33:21 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:21.257712 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382890d5-989a-433c-b1ea-b0a3fc21d49b None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:21.280322 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 521/1058] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 08:33:21.302941 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93aecdc-da10-40c1-b7b4-e2e956c2d45b None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:21.363590 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382890d5-989a-433c-b1ea-b0a3fc21d49b None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:21.401995 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141d9e8-3a5d-4b60-a4c9-922fc3ae82b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:21.402682 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141d9e8-3a5d-4b60-a4c9-922fc3ae82b2 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:21.402975 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141d9e8-3a5d-4b60-a4c9-922fc3ae82b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:21.403261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141d9e8-3a5d-4b60-a4c9-922fc3ae82b2 None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:21.404031 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141d9e8-3a5d-4b60-a4c9-922fc3ae82b2 None admin] RBAC: Adding query filter params (name=image) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:21.404346 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141d9e8-3a5d-4b60-a4c9-922fc3ae82b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:21.406395 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141d9e8-3a5d-4b60-a4c9-922fc3ae82b2 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:21.411299 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:21.412180 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 538/1059] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:21.418216 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141d9e8-3a5d-4b60-a4c9-922fc3ae82b2 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:21.422699 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93aecdc-da10-40c1-b7b4-e2e956c2d45b None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:21.463163 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:21.466001 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6e610-f3e8-4b05-976a-dda13ea56f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:21.467125 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6e610-f3e8-4b05-976a-dda13ea56f5b None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:21.467415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6e610-f3e8-4b05-976a-dda13ea56f5b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:21.467805 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6e610-f3e8-4b05-976a-dda13ea56f5b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:21.479095 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6e610-f3e8-4b05-976a-dda13ea56f5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:33:21.487602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-89c6e610-f3e8-4b05-976a-dda13ea56f5b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 08:33:21.487602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:21.487602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:21.487602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:21.487602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:21.487602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:21.487602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:21.487602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:21.487602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:21.487602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:21.487602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:21.487602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:21.487602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:33:21.487602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:33:21.487602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:33:21.487602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:33:21.488579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:33:21.488579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:33:21.488579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:33:21.488579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:33:21.488579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:21.488579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:21.488579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:21.488579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:21.488579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:21.488579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:21.488579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:21.488579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:21.488579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:21.488579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:21.488579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:21.488579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:21.489715 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:21.489715 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:21.489715 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:21.489715 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:21.489715 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:33:21.489715 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:33:21.489715 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:33:21.489715 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:33:21.489715 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:33:21.489715 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:33:21.489715 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 08:33:21.489715 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:21.489715 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 522/1060] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Jul 25 08:33:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:33:21.494651 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6e610-f3e8-4b05-976a-dda13ea56f5b None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:21.527439 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141d9e8-3a5d-4b60-a4c9-922fc3ae82b2 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:21.563865 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56025d-69c2-4db3-8444-6b075e188a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:21.564955 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56025d-69c2-4db3-8444-6b075e188a7e None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:21.565424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56025d-69c2-4db3-8444-6b075e188a7e None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:21.566328 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56025d-69c2-4db3-8444-6b075e188a7e None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:21.567511 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56025d-69c2-4db3-8444-6b075e188a7e None admin] RBAC: Adding query filter params (type=image) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:21.568052 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56025d-69c2-4db3-8444-6b075e188a7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:21.570509 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56025d-69c2-4db3-8444-6b075e188a7e None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:21.577701 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 539/1061] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:21.583271 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56025d-69c2-4db3-8444-6b075e188a7e None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:21.599585 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6e610-f3e8-4b05-976a-dda13ea56f5b None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:21.632625 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795bdf3-face-4031-99db-d8992bac209e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:21.633285 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795bdf3-face-4031-99db-d8992bac209e None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:21.633572 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795bdf3-face-4031-99db-d8992bac209e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:21.633849 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795bdf3-face-4031-99db-d8992bac209e None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:21.634598 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795bdf3-face-4031-99db-d8992bac209e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:21.634912 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795bdf3-face-4031-99db-d8992bac209e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:21.636298 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795bdf3-face-4031-99db-d8992bac209e None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:21.644898 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 523/1062] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Jul 25 08:33:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:21.650486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795bdf3-face-4031-99db-d8992bac209e None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:21.666236 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:21.707587 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56025d-69c2-4db3-8444-6b075e188a7e None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:21.716083 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:21.743820 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a89b88-7d67-4af0-bacf-c3aaa7a5eef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:21.744404 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a89b88-7d67-4af0-bacf-c3aaa7a5eef8 None admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:21.744692 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a89b88-7d67-4af0-bacf-c3aaa7a5eef8 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:21.744971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a89b88-7d67-4af0-bacf-c3aaa7a5eef8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:21.745718 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a89b88-7d67-4af0-bacf-c3aaa7a5eef8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:21.747090 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a89b88-7d67-4af0-bacf-c3aaa7a5eef8 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:21.760820 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795bdf3-face-4031-99db-d8992bac209e None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:21.796614 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02af96e-562b-4be0-a16a-f857a2b94ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:21.797400 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02af96e-562b-4be0-a16a-f857a2b94ff8 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:21.797686 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02af96e-562b-4be0-a16a-f857a2b94ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:21.797962 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02af96e-562b-4be0-a16a-f857a2b94ff8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:21.808727 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02af96e-562b-4be0-a16a-f857a2b94ff8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:21.810157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02af96e-562b-4be0-a16a-f857a2b94ff8 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:21.828681 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-e02af96e-562b-4be0-a16a-f857a2b94ff8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:21.828681 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:21.828681 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:21.828681 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:21.828681 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:21.828681 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:21.828681 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:21.828681 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:21.828681 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:21.828681 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:21.828681 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:21.828681 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:21.828681 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:33:21.828681 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:33:21.828681 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:33:21.829758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:33:21.829758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:21.829758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:21.829758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:21.829758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:21.829758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:21.829758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:21.829758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:21.829758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:21.829758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:21.829758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:21.829758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:21.829758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:21.829758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:21.829758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:21.829758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:21.829758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:21.830996 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:33:21.830996 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:33:21.830996 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:21.830996 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:21.830996 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 524/1063] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:33:21.835477 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02af96e-562b-4be0-a16a-f857a2b94ff8 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:21.843753 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 540/1064] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:33:21 2022] POST /identity/v3/endpoints => generated 327 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:33:21.908372 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:21.950496 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02af96e-562b-4be0-a16a-f857a2b94ff8 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:21.994365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a60fea-3ce3-49c0-a5e1-822a47bd3770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:21.994965 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a60fea-3ce3-49c0-a5e1-822a47bd3770 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:21.994965 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a60fea-3ce3-49c0-a5e1-822a47bd3770 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:21.995129 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a60fea-3ce3-49c0-a5e1-822a47bd3770 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:21.995832 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a60fea-3ce3-49c0-a5e1-822a47bd3770 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:21.996140 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a60fea-3ce3-49c0-a5e1-822a47bd3770 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:21.997500 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a60fea-3ce3-49c0-a5e1-822a47bd3770 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:22.010500 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 525/1065] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:22.016197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a89b88-7d67-4af0-bacf-c3aaa7a5eef8 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:22.119380 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a89b88-7d67-4af0-bacf-c3aaa7a5eef8 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:22.153271 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84596eb-cd40-4f03-b16c-aa2f8fc79bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:22.154068 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84596eb-cd40-4f03-b16c-aa2f8fc79bda None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:22.154913 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84596eb-cd40-4f03-b16c-aa2f8fc79bda None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:22.155375 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84596eb-cd40-4f03-b16c-aa2f8fc79bda None admin] PATH_INFO: `/v3/users/nova` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:22.163393 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84596eb-cd40-4f03-b16c-aa2f8fc79bda None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:22.164888 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84596eb-cd40-4f03-b16c-aa2f8fc79bda None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:22.179035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-d84596eb-cd40-4f03-b16c-aa2f8fc79bda None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:33:22.179035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:22.179035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:22.179035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:22.179035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:22.179035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:22.179035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:22.179035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:22.179035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:22.179035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:22.179035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:22.179035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:22.179035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:33:22.179035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:33:22.179035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:33:22.179035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:33:22.180259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:22.180259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:22.180259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:33:22.180259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:33:22.180259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:33:22.180259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:33:22.180259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:22.180259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:22.180259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:22.180259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:22.180259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:22.180259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:22.180259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:22.180259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:22.180259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:22.180259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:22.180259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:22.180259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:22.181250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:22.181250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:22.181250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:33:22.181250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:33:22.181250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:33:22.181250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:33:22.181250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:33:22.181250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:33:22.181250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:33:22.181250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:22.181250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 541/1066] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Jul 25 08:33:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:33:22.186875 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a60fea-3ce3-49c0-a5e1-822a47bd3770 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:22.287566 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a60fea-3ce3-49c0-a5e1-822a47bd3770 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:22.308396 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:22.308582 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491cef0-26ae-4267-aecf-ce25140af0e7 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:22.308880 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491cef0-26ae-4267-aecf-ce25140af0e7 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:22.309166 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491cef0-26ae-4267-aecf-ce25140af0e7 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:22.310539 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 542/1067] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:33:22.315568 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151bd5b-440c-40f2-a418-50f079327ae9 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:22.319098 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151bd5b-440c-40f2-a418-50f079327ae9 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:22.319098 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151bd5b-440c-40f2-a418-50f079327ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:22.326137 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868a2b1-bcf3-4097-ac07-5288fb505238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:22.327583 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868a2b1-bcf3-4097-ac07-5288fb505238 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:22.328081 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868a2b1-bcf3-4097-ac07-5288fb505238 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:22.328558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868a2b1-bcf3-4097-ac07-5288fb505238 None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:22.330055 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868a2b1-bcf3-4097-ac07-5288fb505238 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:22.330568 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868a2b1-bcf3-4097-ac07-5288fb505238 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:22.332224 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868a2b1-bcf3-4097-ac07-5288fb505238 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:22.335033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-1151bd5b-440c-40f2-a418-50f079327ae9 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:22.336239 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-1151bd5b-440c-40f2-a418-50f079327ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:22.351418 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:22.352062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 526/1068] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Jul 25 08:33:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:22.358335 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868a2b1-bcf3-4097-ac07-5288fb505238 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:22.416091 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 543/1069] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 08:33:22.439320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151bd5b-440c-40f2-a418-50f079327ae9 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:22.472365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868a2b1-bcf3-4097-ac07-5288fb505238 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:22.508936 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e77ca2-edf1-4b1e-8706-a86f6204df11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:22.509726 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e77ca2-edf1-4b1e-8706-a86f6204df11 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:22.510006 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e77ca2-edf1-4b1e-8706-a86f6204df11 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:22.510277 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e77ca2-edf1-4b1e-8706-a86f6204df11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:22.521274 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e77ca2-edf1-4b1e-8706-a86f6204df11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:22.522812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e77ca2-edf1-4b1e-8706-a86f6204df11 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:22.543592 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151bd5b-440c-40f2-a418-50f079327ae9 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:22.544743 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-f6e77ca2-edf1-4b1e-8706-a86f6204df11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:22.544743 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:22.544743 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:22.544743 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:22.544743 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:22.544743 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:22.544743 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:22.544743 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:22.544743 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:22.544743 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:22.544743 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:22.544743 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:22.544743 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:33:22.544743 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:33:22.544743 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:33:22.546000 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:33:22.546000 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:22.546000 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:22.546000 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:22.546000 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:22.546000 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:22.546000 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:22.546000 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:22.546000 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:22.546000 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:22.546000 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:22.546000 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:22.546000 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:22.546000 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:22.546000 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:22.546000 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:22.546000 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:22.546895 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:33:22.546895 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:33:22.546895 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:22.546895 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:22.551885 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 527/1070] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:33:22.552800 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e77ca2-edf1-4b1e-8706-a86f6204df11 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:22.581010 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2949f15-9db8-4064-9e87-2548baef81fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:22.581814 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2949f15-9db8-4064-9e87-2548baef81fc None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:22.584350 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2949f15-9db8-4064-9e87-2548baef81fc None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:22.584350 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2949f15-9db8-4064-9e87-2548baef81fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:22.589491 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:22.594443 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2949f15-9db8-4064-9e87-2548baef81fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:33:22.602326 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-e2949f15-9db8-4064-9e87-2548baef81fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:33:22.602326 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:22.602326 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:22.602326 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:22.602326 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:22.602326 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:22.602326 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:22.602326 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:22.602326 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:22.602326 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:22.602326 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:22.602326 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:22.602326 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:33:22.602326 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:33:22.602326 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:33:22.602326 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:33:22.605831 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:33:22.605831 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:33:22.605831 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:33:22.605831 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:33:22.605831 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:22.605831 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:22.605831 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:22.605831 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:22.605831 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:22.605831 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:22.605831 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:22.605831 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:22.605831 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:22.605831 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:22.605831 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:22.605831 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:22.606684 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:22.606684 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:22.606684 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:22.606684 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:22.606684 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:33:22.606684 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:33:22.606684 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:33:22.606684 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:33:22.606684 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:33:22.606684 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:33:22.606684 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:33:22.606684 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:22.606684 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 544/1071] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:33:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:33:22.609494 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2949f15-9db8-4064-9e87-2548baef81fc None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:22.622508 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:22.672245 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e77ca2-edf1-4b1e-8706-a86f6204df11 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:22.713835 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96334b-7199-4f00-912b-948ec7df9634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:22.714509 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96334b-7199-4f00-912b-948ec7df9634 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:22.714787 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96334b-7199-4f00-912b-948ec7df9634 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:22.715065 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96334b-7199-4f00-912b-948ec7df9634 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:22.715818 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96334b-7199-4f00-912b-948ec7df9634 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:22.716129 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96334b-7199-4f00-912b-948ec7df9634 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:22.717737 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96334b-7199-4f00-912b-948ec7df9634 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:22.720672 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2949f15-9db8-4064-9e87-2548baef81fc None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:22.733606 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 528/1072] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:22.734570 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96334b-7199-4f00-912b-948ec7df9634 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:22.759622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14395b1-e4c5-43e8-b358-e023b737c7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:22.760307 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14395b1-e4c5-43e8-b358-e023b737c7ea None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:22.760588 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14395b1-e4c5-43e8-b358-e023b737c7ea None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:22.760861 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14395b1-e4c5-43e8-b358-e023b737c7ea None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:22.761597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14395b1-e4c5-43e8-b358-e023b737c7ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:22.761903 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14395b1-e4c5-43e8-b358-e023b737c7ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:22.763256 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14395b1-e4c5-43e8-b358-e023b737c7ea None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:22.772434 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 545/1073] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:33:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:22.778086 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14395b1-e4c5-43e8-b358-e023b737c7ea None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:22.836112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:22.846860 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96334b-7199-4f00-912b-948ec7df9634 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:22.851868 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:22.881649 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14395b1-e4c5-43e8-b358-e023b737c7ea None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:22.881939 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da631b8a-c06b-41c1-a4e2-97dc94a1f49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:22.882694 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da631b8a-c06b-41c1-a4e2-97dc94a1f49a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:22.883018 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da631b8a-c06b-41c1-a4e2-97dc94a1f49a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:22.883833 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da631b8a-c06b-41c1-a4e2-97dc94a1f49a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:22.892568 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da631b8a-c06b-41c1-a4e2-97dc94a1f49a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:22.894020 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da631b8a-c06b-41c1-a4e2-97dc94a1f49a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:22.908870 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-da631b8a-c06b-41c1-a4e2-97dc94a1f49a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:33:22.908870 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:22.908870 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:22.908870 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:22.908870 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:22.908870 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:22.908870 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:22.908870 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:22.908870 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:22.908870 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:22.908870 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:22.908870 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:22.908870 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:33:22.908870 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:33:22.908870 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:33:22.909959 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:33:22.909959 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:22.909959 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:22.909959 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:22.909959 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:22.909959 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:22.909959 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:22.909959 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:22.909959 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:22.909959 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:22.909959 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:22.909959 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:22.909959 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:22.909959 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:22.909959 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:22.909959 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:22.909959 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:22.910843 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:33:22.910843 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:33:22.910843 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:33:22.910843 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:33:22.910843 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:33:22.910843 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:33:22.910843 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:33:22.910843 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:22.910843 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 529/1074] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:33:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:22.915810 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da631b8a-c06b-41c1-a4e2-97dc94a1f49a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:22.918153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b7775-a67d-417d-9447-b27098a487a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:22.919015 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b7775-a67d-417d-9447-b27098a487a1 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:22.919325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b7775-a67d-417d-9447-b27098a487a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:22.919563 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b7775-a67d-417d-9447-b27098a487a1 None admin] PATH_INFO: `/v3/users/b93ae5981ef34aa09a6e97682925eadf` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:22.920832 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b7775-a67d-417d-9447-b27098a487a1 None admin] RBAC: Authorizing `identity:get_user(user_id=b93ae5981ef34aa09a6e97682925eadf)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:22.922259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b7775-a67d-417d-9447-b27098a487a1 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:22.923923 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 546/1075] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:33:22 2022] GET /identity/v3/users/b93ae5981ef34aa09a6e97682925eadf => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:22.929444 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b7775-a67d-417d-9447-b27098a487a1 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:23.031569 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da631b8a-c06b-41c1-a4e2-97dc94a1f49a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:23.038269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b7775-a67d-417d-9447-b27098a487a1 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:23.070256 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be684c-2383-43fe-bb70-5e8add1e6fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:23.071018 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be684c-2383-43fe-bb70-5e8add1e6fe3 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:23.071378 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be684c-2383-43fe-bb70-5e8add1e6fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:23.071769 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be684c-2383-43fe-bb70-5e8add1e6fe3 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:23.072569 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be684c-2383-43fe-bb70-5e8add1e6fe3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:23.072887 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be684c-2383-43fe-bb70-5e8add1e6fe3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:23.073721 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a5c42-13f6-42a3-8dba-bf524ef32d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:23.074333 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be684c-2383-43fe-bb70-5e8add1e6fe3 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:23.074576 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a5c42-13f6-42a3-8dba-bf524ef32d09 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:23.074856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a5c42-13f6-42a3-8dba-bf524ef32d09 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:23.075133 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a5c42-13f6-42a3-8dba-bf524ef32d09 None admin] PATH_INFO: `/v3/projects/4d87fecb76144f898c137682180a3c01` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:23.076363 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a5c42-13f6-42a3-8dba-bf524ef32d09 None admin] RBAC: Authorizing `identity:get_project(project_id=4d87fecb76144f898c137682180a3c01)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:23.077898 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a5c42-13f6-42a3-8dba-bf524ef32d09 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:23.084692 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 547/1076] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:33:22 2022] GET /identity/v3/projects/4d87fecb76144f898c137682180a3c01 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:23.085431 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a5c42-13f6-42a3-8dba-bf524ef32d09 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:23.086839 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 530/1077] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:33:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:23.092766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be684c-2383-43fe-bb70-5e8add1e6fe3 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:23.100985 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:23.105096 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:23.194456 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a5c42-13f6-42a3-8dba-bf524ef32d09 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:23.197987 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be684c-2383-43fe-bb70-5e8add1e6fe3 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:23.229213 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c0412-c586-4391-ad3b-5787bc96339b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:23.230094 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c0412-c586-4391-ad3b-5787bc96339b None admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:23.230422 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c0412-c586-4391-ad3b-5787bc96339b None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:23.230638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c0412-c586-4391-ad3b-5787bc96339b None admin] PATH_INFO: `/v3/projects/4d87fecb76144f898c137682180a3c01/users/b93ae5981ef34aa09a6e97682925eadf/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:23.233126 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c0412-c586-4391-ad3b-5787bc96339b None admin] RBAC: Authorizing `identity:create_grant(project_id=4d87fecb76144f898c137682180a3c01, user_id=b93ae5981ef34aa09a6e97682925eadf, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:23.233411 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e027888c-bced-4885-aef5-bd0828f2273a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:23.234291 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027888c-bced-4885-aef5-bd0828f2273a None admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:23.234549 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c0412-c586-4391-ad3b-5787bc96339b None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:23.234648 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027888c-bced-4885-aef5-bd0828f2273a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:23.234832 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027888c-bced-4885-aef5-bd0828f2273a None admin] PATH_INFO: `/v3/projects/be349194440449209f19f6b535ffd4f6/users/1c1a08d3a76643a9996dc0daa8714ac6/roles/285ea04d109c48018a60d5bbe255a9bd` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:23.237101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e027888c-bced-4885-aef5-bd0828f2273a None admin] RBAC: Authorizing `identity:create_grant(project_id=be349194440449209f19f6b535ffd4f6, user_id=1c1a08d3a76643a9996dc0daa8714ac6, role_id=285ea04d109c48018a60d5bbe255a9bd)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:23.238562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e027888c-bced-4885-aef5-bd0828f2273a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:23.317006 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 548/1078] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 08:33:23 2022] PUT /identity/v3/projects/4d87fecb76144f898c137682180a3c01/users/b93ae5981ef34aa09a6e97682925eadf/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:33:23.346472 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 531/1079] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 08:33:23 2022] PUT /identity/v3/projects/be349194440449209f19f6b535ffd4f6/users/1c1a08d3a76643a9996dc0daa8714ac6/roles/285ea04d109c48018a60d5bbe255a9bd => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:33:23.894130 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f2306-7e65-4072-807a-9f7e0dfbb504 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:23.894477 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f2306-7e65-4072-807a-9f7e0dfbb504 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:23.894698 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f2306-7e65-4072-807a-9f7e0dfbb504 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:23.896276 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 549/1080] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:23.901159 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef9851-c8fa-4421-8d92-dac497b38463 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:23.901449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef9851-c8fa-4421-8d92-dac497b38463 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:23.901724 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef9851-c8fa-4421-8d92-dac497b38463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:23.920690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-a2ef9851-c8fa-4421-8d92-dac497b38463 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:23.921870 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a2ef9851-c8fa-4421-8d92-dac497b38463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:23.984756 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:23.989962 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 532/1081] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 08:33:24.012259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f2306-7e65-4072-807a-9f7e0dfbb504 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:24.081072 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:24.116799 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f2306-7e65-4072-807a-9f7e0dfbb504 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:24.149851 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25447c9f-be70-4c91-8aa4-39ca31423b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:24.150493 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25447c9f-be70-4c91-8aa4-39ca31423b19 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:24.150826 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25447c9f-be70-4c91-8aa4-39ca31423b19 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:24.151101 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25447c9f-be70-4c91-8aa4-39ca31423b19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:24.218597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25447c9f-be70-4c91-8aa4-39ca31423b19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:24.220089 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25447c9f-be70-4c91-8aa4-39ca31423b19 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:24.283070 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:24.317934 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 550/1082] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:33:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 08:33:24.323599 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef9851-c8fa-4421-8d92-dac497b38463 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:24.426618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef9851-c8fa-4421-8d92-dac497b38463 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:24.464514 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d50d8-19e6-4b8d-b824-7c27a990d229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:24.465339 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d50d8-19e6-4b8d-b824-7c27a990d229 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:24.465623 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d50d8-19e6-4b8d-b824-7c27a990d229 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:24.465899 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d50d8-19e6-4b8d-b824-7c27a990d229 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:24.477310 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d50d8-19e6-4b8d-b824-7c27a990d229 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:24.478761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d50d8-19e6-4b8d-b824-7c27a990d229 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:24.496379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-cf4d50d8-19e6-4b8d-b824-7c27a990d229 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:24.496379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:24.496379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:24.496379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:24.496379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:24.496379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:24.496379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:24.496379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:24.496379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:24.496379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:24.496379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:24.496379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:24.496379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:33:24.496379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:33:24.496379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:33:24.497316 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:33:24.497316 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:24.497316 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:24.497316 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:24.497316 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:24.497316 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:24.497316 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:24.497316 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:24.497316 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:24.497316 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:24.497316 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:24.497316 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:24.497316 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:24.497316 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:24.497316 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:24.497316 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:24.497316 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:24.504402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:33:24.504402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:33:24.504402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:24.504402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:24.504402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 533/1083] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:33:24.505624 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25447c9f-be70-4c91-8aa4-39ca31423b19 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:24.609364 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25447c9f-be70-4c91-8aa4-39ca31423b19 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:24.643606 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68016d17-ff99-4513-83b8-319efc3bc277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:24.644277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68016d17-ff99-4513-83b8-319efc3bc277 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:24.644559 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68016d17-ff99-4513-83b8-319efc3bc277 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:24.644832 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68016d17-ff99-4513-83b8-319efc3bc277 None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:24.645551 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68016d17-ff99-4513-83b8-319efc3bc277 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:24.646278 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68016d17-ff99-4513-83b8-319efc3bc277 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:24.647218 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68016d17-ff99-4513-83b8-319efc3bc277 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:24.659522 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 551/1084] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:25.345193 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae357dbd-d4a3-48ea-b2b8-5b83fc5e50a8 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:25.345781 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae357dbd-d4a3-48ea-b2b8-5b83fc5e50a8 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:25.345781 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae357dbd-d4a3-48ea-b2b8-5b83fc5e50a8 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:25.347124 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 534/1085] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:25.352250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333c27c-cdae-4d02-b25d-2ace788cef8e None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:25.352661 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333c27c-cdae-4d02-b25d-2ace788cef8e None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:25.352809 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333c27c-cdae-4d02-b25d-2ace788cef8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:25.365388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f6dcb-b174-42b9-a556-e7fed822fd4a None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:25.365678 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f6dcb-b174-42b9-a556-e7fed822fd4a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:25.365964 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f6dcb-b174-42b9-a556-e7fed822fd4a None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:25.367280 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 535/1086] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:33:25.371251 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-1333c27c-cdae-4d02-b25d-2ace788cef8e None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:25.372138 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8adbb-dd2b-4ffe-96c3-e231c5a349ab None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:25.372428 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8adbb-dd2b-4ffe-96c3-e231c5a349ab None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:25.372524 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-1333c27c-cdae-4d02-b25d-2ace788cef8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:25.372709 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8adbb-dd2b-4ffe-96c3-e231c5a349ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:25.390973 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-32a8adbb-dd2b-4ffe-96c3-e231c5a349ab None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:25.392193 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-32a8adbb-dd2b-4ffe-96c3-e231c5a349ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:25.395447 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:25.439847 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:25.441208 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 552/1087] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:25.459734 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 536/1088] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 08:33:25.463595 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333c27c-cdae-4d02-b25d-2ace788cef8e None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:25.482300 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8adbb-dd2b-4ffe-96c3-e231c5a349ab None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:25.562598 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333c27c-cdae-4d02-b25d-2ace788cef8e None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:25.580369 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8adbb-dd2b-4ffe-96c3-e231c5a349ab None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:25.597702 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51668aeb-353a-4047-8899-24a1dfa638e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:25.598433 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51668aeb-353a-4047-8899-24a1dfa638e8 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:25.598719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51668aeb-353a-4047-8899-24a1dfa638e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:25.598995 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51668aeb-353a-4047-8899-24a1dfa638e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:25.609461 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51668aeb-353a-4047-8899-24a1dfa638e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:33:25.615937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15501234-91ac-4adc-b20d-a7f20366c591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:25.616743 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15501234-91ac-4adc-b20d-a7f20366c591 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:25.617030 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15501234-91ac-4adc-b20d-a7f20366c591 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:25.617208 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-51668aeb-353a-4047-8899-24a1dfa638e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:33:25.617208 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:25.617208 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:25.617208 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:25.617208 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:25.617208 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:25.617208 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:25.617208 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:25.617208 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:25.617208 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:25.617208 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:25.617208 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:25.617208 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:33:25.617208 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:33:25.617208 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:33:25.617208 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:33:25.618292 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:33:25.618292 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:33:25.618292 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:33:25.618292 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:33:25.618292 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:25.618292 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:25.618292 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:25.618292 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:25.618292 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:25.618292 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:25.618292 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:25.618292 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:25.618292 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:25.618292 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:25.618292 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:25.618292 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:25.619334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:25.619334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:25.619334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:25.619334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:25.619334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:33:25.619334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:33:25.619334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:33:25.619334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:33:25.619334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:33:25.619334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:33:25.619334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:33:25.619334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:25.620158 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15501234-91ac-4adc-b20d-a7f20366c591 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:25.620243 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 553/1089] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:33:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:33:25.624783 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51668aeb-353a-4047-8899-24a1dfa638e8 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:25.630254 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15501234-91ac-4adc-b20d-a7f20366c591 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:33:25.638498 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-15501234-91ac-4adc-b20d-a7f20366c591 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 08:33:25.638498 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:25.638498 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:25.638498 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:25.638498 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:25.638498 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:25.638498 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:25.638498 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:25.638498 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:25.638498 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:25.638498 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:25.638498 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:25.638498 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:33:25.638498 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:33:25.638498 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:33:25.638498 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:33:25.640069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:33:25.640069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:33:25.640069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:33:25.640069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:33:25.640069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:25.640069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:25.640069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:25.640069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:25.640069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:25.640069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:25.640069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:25.640069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:25.640069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:25.640069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:25.640069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:25.640069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:25.641051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:25.641051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:25.641051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:25.641051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:25.641051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:33:25.641051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:33:25.641051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:33:25.641051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:33:25.641051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:33:25.641051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:33:25.641051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 08:33:25.641051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:25.641051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 537/1090] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Jul 25 08:33:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:33:25.646066 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15501234-91ac-4adc-b20d-a7f20366c591 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:25.646815 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:25.689796 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:25.733130 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51668aeb-353a-4047-8899-24a1dfa638e8 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:25.749501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15501234-91ac-4adc-b20d-a7f20366c591 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:25.767211 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef17b96-e872-44a7-9bbb-dad31bf42be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:25.767914 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef17b96-e872-44a7-9bbb-dad31bf42be5 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:25.768198 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef17b96-e872-44a7-9bbb-dad31bf42be5 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:25.768472 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef17b96-e872-44a7-9bbb-dad31bf42be5 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:25.769218 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef17b96-e872-44a7-9bbb-dad31bf42be5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:25.769522 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef17b96-e872-44a7-9bbb-dad31bf42be5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:25.770882 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef17b96-e872-44a7-9bbb-dad31bf42be5 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:25.778709 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 554/1091] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:33:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:25.782125 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7215d-807c-4a3f-8835-c191b7a3221a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:25.783023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7215d-807c-4a3f-8835-c191b7a3221a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:25.783339 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7215d-807c-4a3f-8835-c191b7a3221a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:25.783738 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7215d-807c-4a3f-8835-c191b7a3221a None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:25.784556 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7215d-807c-4a3f-8835-c191b7a3221a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:25.784746 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef17b96-e872-44a7-9bbb-dad31bf42be5 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:25.784862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7215d-807c-4a3f-8835-c191b7a3221a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:25.786197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7215d-807c-4a3f-8835-c191b7a3221a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:25.798717 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 538/1092] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Jul 25 08:33:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:25.799727 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7215d-807c-4a3f-8835-c191b7a3221a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:25.864866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:25.883364 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef17b96-e872-44a7-9bbb-dad31bf42be5 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:25.897826 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7215d-807c-4a3f-8835-c191b7a3221a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:25.900146 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:25.921444 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210ef43-f8c4-40bd-9afa-3978dffbaf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:25.922319 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210ef43-f8c4-40bd-9afa-3978dffbaf7d None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:25.922602 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210ef43-f8c4-40bd-9afa-3978dffbaf7d None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:25.922873 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210ef43-f8c4-40bd-9afa-3978dffbaf7d None admin] PATH_INFO: `/v3/users/b93ae5981ef34aa09a6e97682925eadf` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:25.924189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210ef43-f8c4-40bd-9afa-3978dffbaf7d None admin] RBAC: Authorizing `identity:get_user(user_id=b93ae5981ef34aa09a6e97682925eadf)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:25.925633 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210ef43-f8c4-40bd-9afa-3978dffbaf7d None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:25.927290 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 555/1093] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:33:25 2022] GET /identity/v3/users/b93ae5981ef34aa09a6e97682925eadf => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:25.932401 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277295b-8a5c-4418-b989-74da0047b4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:25.932820 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210ef43-f8c4-40bd-9afa-3978dffbaf7d None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:25.933256 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277295b-8a5c-4418-b989-74da0047b4f8 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:25.933535 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277295b-8a5c-4418-b989-74da0047b4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:25.933807 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277295b-8a5c-4418-b989-74da0047b4f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:25.945390 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277295b-8a5c-4418-b989-74da0047b4f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:25.946838 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277295b-8a5c-4418-b989-74da0047b4f8 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:25.964411 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-5277295b-8a5c-4418-b989-74da0047b4f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:25.964411 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:25.964411 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:25.964411 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:25.964411 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:25.964411 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:25.964411 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:25.964411 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:25.964411 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:25.964411 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:25.964411 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:25.964411 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:25.964411 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:33:25.964411 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:33:25.964411 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:33:25.965410 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:33:25.965410 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:25.965410 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:25.965410 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:25.965410 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:25.965410 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:25.965410 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:25.965410 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:25.965410 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:25.965410 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:25.965410 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:25.965410 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:25.965410 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:25.965410 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:25.965410 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:25.965410 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:25.965410 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:25.966716 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:33:25.966716 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:33:25.966716 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:25.966716 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:25.966716 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 539/1094] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:25.972021 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277295b-8a5c-4418-b989-74da0047b4f8 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:26.032619 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210ef43-f8c4-40bd-9afa-3978dffbaf7d None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:26.065096 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d59f3-c706-4f8a-a7fe-106a83c12ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:26.065731 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d59f3-c706-4f8a-a7fe-106a83c12ae3 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:26.066015 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d59f3-c706-4f8a-a7fe-106a83c12ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:26.066291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d59f3-c706-4f8a-a7fe-106a83c12ae3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:26.070936 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277295b-8a5c-4418-b989-74da0047b4f8 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:26.084294 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:26.105487 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87e19c-8243-4ddb-951a-8d144c4c4a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:26.106145 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87e19c-8243-4ddb-951a-8d144c4c4a57 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:26.106434 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87e19c-8243-4ddb-951a-8d144c4c4a57 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:26.106712 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87e19c-8243-4ddb-951a-8d144c4c4a57 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:26.107600 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87e19c-8243-4ddb-951a-8d144c4c4a57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:26.108026 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87e19c-8243-4ddb-951a-8d144c4c4a57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:26.109408 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87e19c-8243-4ddb-951a-8d144c4c4a57 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:26.125976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 540/1095] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:26.126963 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87e19c-8243-4ddb-951a-8d144c4c4a57 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:26.134382 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d59f3-c706-4f8a-a7fe-106a83c12ae3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:26.135867 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d59f3-c706-4f8a-a7fe-106a83c12ae3 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:26.144460 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:26.226056 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87e19c-8243-4ddb-951a-8d144c4c4a57 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:26.232260 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 556/1096] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:33:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 08:33:26.238504 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d59f3-c706-4f8a-a7fe-106a83c12ae3 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:26.263028 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6231a6e-f854-4166-a1d8-74d6a61d12e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:26.263912 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6231a6e-f854-4166-a1d8-74d6a61d12e4 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:26.264336 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6231a6e-f854-4166-a1d8-74d6a61d12e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:26.264623 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6231a6e-f854-4166-a1d8-74d6a61d12e4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:26.271570 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6231a6e-f854-4166-a1d8-74d6a61d12e4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:26.273039 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6231a6e-f854-4166-a1d8-74d6a61d12e4 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:26.285524 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:26.287368 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-d6231a6e-f854-4166-a1d8-74d6a61d12e4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:33:26.287368 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:26.287368 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:26.287368 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:26.287368 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:26.287368 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:26.287368 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:26.287368 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:26.287368 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:26.287368 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:26.287368 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:26.287368 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:26.287368 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:33:26.287368 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:33:26.287368 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:33:26.287368 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:33:26.288440 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:26.288440 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:26.288440 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:33:26.288440 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:33:26.288440 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:33:26.288440 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:33:26.288440 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:26.288440 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:26.288440 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:26.288440 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:26.288440 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:26.288440 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:26.288440 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:26.288440 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:26.288440 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:26.288440 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:26.288440 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:26.288440 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:26.289402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:26.289402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:26.289402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:33:26.289402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:33:26.289402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:33:26.289402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:33:26.289402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:33:26.289402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:33:26.289402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 08:33:26.289402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:26.289402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 541/1097] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Jul 25 08:33:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:26.294368 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6231a6e-f854-4166-a1d8-74d6a61d12e4 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:26.335833 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d59f3-c706-4f8a-a7fe-106a83c12ae3 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:26.368575 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51a2c8-2615-4342-9e45-4ee9e358c57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:26.369418 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51a2c8-2615-4342-9e45-4ee9e358c57b None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:26.369697 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51a2c8-2615-4342-9e45-4ee9e358c57b None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:26.369974 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51a2c8-2615-4342-9e45-4ee9e358c57b None admin] PATH_INFO: `/v3/projects/4d87fecb76144f898c137682180a3c01` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:26.370305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:26.371144 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51a2c8-2615-4342-9e45-4ee9e358c57b None admin] RBAC: Authorizing `identity:get_project(project_id=4d87fecb76144f898c137682180a3c01)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:26.372687 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51a2c8-2615-4342-9e45-4ee9e358c57b None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:26.374286 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 557/1098] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:33:26 2022] GET /identity/v3/projects/4d87fecb76144f898c137682180a3c01 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:26.380234 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51a2c8-2615-4342-9e45-4ee9e358c57b None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:26.394238 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6231a6e-f854-4166-a1d8-74d6a61d12e4 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:26.431259 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060830f-9fa2-41db-9ae6-32f8d296a299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:26.431964 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060830f-9fa2-41db-9ae6-32f8d296a299 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:26.432252 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060830f-9fa2-41db-9ae6-32f8d296a299 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:26.432529 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060830f-9fa2-41db-9ae6-32f8d296a299 None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:26.433376 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060830f-9fa2-41db-9ae6-32f8d296a299 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:26.433684 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060830f-9fa2-41db-9ae6-32f8d296a299 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:26.435106 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060830f-9fa2-41db-9ae6-32f8d296a299 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:26.453375 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 542/1099] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Jul 25 08:33:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:26.459020 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060830f-9fa2-41db-9ae6-32f8d296a299 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:26.479763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51a2c8-2615-4342-9e45-4ee9e358c57b None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:26.495766 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:26.514700 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497f130-471f-47f8-aa77-a5f22e881090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:26.515352 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497f130-471f-47f8-aa77-a5f22e881090 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:26.515661 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497f130-471f-47f8-aa77-a5f22e881090 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:26.516060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497f130-471f-47f8-aa77-a5f22e881090 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:26.516832 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497f130-471f-47f8-aa77-a5f22e881090 None admin] RBAC: Adding query filter params (role.id=25b0f48c10474bf6b98aad8f093868ee, scope.project.id=4d87fecb76144f898c137682180a3c01, user.id=b93ae5981ef34aa09a6e97682925eadf) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:26.517146 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497f130-471f-47f8-aa77-a5f22e881090 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:26.518575 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497f130-471f-47f8-aa77-a5f22e881090 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:26.524372 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 558/1100] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:33:26 2022] GET /identity/v3/role_assignments?user.id=b93ae5981ef34aa09a6e97682925eadf&scope.project.id=4d87fecb76144f898c137682180a3c01&role.id=25b0f48c10474bf6b98aad8f093868ee => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:26.564511 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060830f-9fa2-41db-9ae6-32f8d296a299 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:26.602793 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36dca0-765b-476a-9430-569f7dfd35b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:26.603458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36dca0-765b-476a-9430-569f7dfd35b8 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:26.603778 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36dca0-765b-476a-9430-569f7dfd35b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:26.604057 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36dca0-765b-476a-9430-569f7dfd35b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:26.607125 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:26.676534 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36dca0-765b-476a-9430-569f7dfd35b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:26.677900 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36dca0-765b-476a-9430-569f7dfd35b8 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:26.777353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 543/1101] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:33:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 08:33:26.784052 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497f130-471f-47f8-aa77-a5f22e881090 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:26.887805 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497f130-471f-47f8-aa77-a5f22e881090 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:26.922690 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8c898-19f3-4783-90d3-86cd031d4070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:26.923476 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8c898-19f3-4783-90d3-86cd031d4070 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:26.923785 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8c898-19f3-4783-90d3-86cd031d4070 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:26.924061 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8c898-19f3-4783-90d3-86cd031d4070 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:26.934533 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8c898-19f3-4783-90d3-86cd031d4070 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:26.936587 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8c898-19f3-4783-90d3-86cd031d4070 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:26.953397 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-bad8c898-19f3-4783-90d3-86cd031d4070 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:26.953397 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:26.953397 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:26.953397 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:26.953397 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:26.953397 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:26.953397 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:26.953397 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:26.953397 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:26.953397 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:26.953397 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:26.953397 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:26.953397 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:33:26.953397 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:33:26.953397 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:33:26.954464 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:33:26.954464 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:26.954464 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:26.954464 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:26.954464 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:26.954464 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:26.954464 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:26.954464 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:26.954464 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:26.954464 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:26.954464 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:26.954464 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:26.954464 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:26.954464 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:26.954464 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:26.954464 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:26.954464 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:26.955374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:33:26.955374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:33:26.955374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:33:26.955374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:26.955374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 559/1102] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:26.960298 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36dca0-765b-476a-9430-569f7dfd35b8 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:26.992832 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:27.059317 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36dca0-765b-476a-9430-569f7dfd35b8 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:27.093935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79876863-be4f-4a76-aac2-b2f18f621eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:27.094602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79876863-be4f-4a76-aac2-b2f18f621eb9 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:27.094887 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79876863-be4f-4a76-aac2-b2f18f621eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:27.095163 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79876863-be4f-4a76-aac2-b2f18f621eb9 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:27.095919 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79876863-be4f-4a76-aac2-b2f18f621eb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:27.096230 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79876863-be4f-4a76-aac2-b2f18f621eb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:27.097589 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79876863-be4f-4a76-aac2-b2f18f621eb9 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:27.109123 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 544/1103] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:27.114766 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8c898-19f3-4783-90d3-86cd031d4070 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:27.146205 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:27.216047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8c898-19f3-4783-90d3-86cd031d4070 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:27.249563 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd2889-b69a-478f-9fca-82795a65424f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:27.250352 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd2889-b69a-478f-9fca-82795a65424f None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:27.250638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd2889-b69a-478f-9fca-82795a65424f None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:27.250916 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd2889-b69a-478f-9fca-82795a65424f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:27.257577 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd2889-b69a-478f-9fca-82795a65424f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:27.259022 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd2889-b69a-478f-9fca-82795a65424f None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:27.274224 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-03bd2889-b69a-478f-9fca-82795a65424f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:33:27.274224 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:27.274224 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:27.274224 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:27.274224 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:27.274224 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:27.274224 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:27.274224 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:27.274224 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:27.274224 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:27.274224 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:27.274224 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:27.274224 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:33:27.274224 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:33:27.274224 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:33:27.275101 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:33:27.275101 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:27.275101 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:27.275101 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:27.275101 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:27.275101 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:27.275101 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:27.275101 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:27.275101 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:27.275101 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:27.275101 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:27.275101 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:27.275101 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:27.275101 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:27.275101 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:27.275101 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:27.275101 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:27.276152 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:33:27.276152 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:33:27.276152 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:33:27.276152 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:33:27.276152 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:33:27.276152 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:33:27.276152 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:33:27.276152 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:27.276152 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 560/1104] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:33:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:27.281323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79876863-be4f-4a76-aac2-b2f18f621eb9 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:27.372524 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:27.379720 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79876863-be4f-4a76-aac2-b2f18f621eb9 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:27.412974 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75eca0-105a-4d1e-ac22-b190eb2d7569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:27.413884 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75eca0-105a-4d1e-ac22-b190eb2d7569 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:27.414329 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75eca0-105a-4d1e-ac22-b190eb2d7569 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:27.414958 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75eca0-105a-4d1e-ac22-b190eb2d7569 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:27.415786 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75eca0-105a-4d1e-ac22-b190eb2d7569 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:27.416101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75eca0-105a-4d1e-ac22-b190eb2d7569 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:27.417524 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75eca0-105a-4d1e-ac22-b190eb2d7569 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:27.429859 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 545/1105] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:33:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:27.436481 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd2889-b69a-478f-9fca-82795a65424f None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:27.524295 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:27.533870 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd2889-b69a-478f-9fca-82795a65424f None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:27.566756 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87dd385-57ce-4535-b4c9-54f909ad055a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:27.567409 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87dd385-57ce-4535-b4c9-54f909ad055a None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:27.567725 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87dd385-57ce-4535-b4c9-54f909ad055a None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:27.568007 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87dd385-57ce-4535-b4c9-54f909ad055a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:27.568838 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87dd385-57ce-4535-b4c9-54f909ad055a None admin] RBAC: Adding query filter params (role.id=285ea04d109c48018a60d5bbe255a9bd, scope.project.id=be349194440449209f19f6b535ffd4f6, user.id=1c1a08d3a76643a9996dc0daa8714ac6) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:27.569152 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87dd385-57ce-4535-b4c9-54f909ad055a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:27.570593 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87dd385-57ce-4535-b4c9-54f909ad055a None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:27.576929 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 561/1106] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:33:27 2022] GET /identity/v3/role_assignments?user.id=1c1a08d3a76643a9996dc0daa8714ac6&scope.project.id=be349194440449209f19f6b535ffd4f6&role.id=285ea04d109c48018a60d5bbe255a9bd => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:28.554779 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9a659-6852-4183-9e04-e818d0ee0e84 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:28.555302 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9a659-6852-4183-9e04-e818d0ee0e84 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:28.555395 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9a659-6852-4183-9e04-e818d0ee0e84 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:28.556750 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 546/1107] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:28.562067 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03de19-04e4-42ba-a5bc-0f1182b47913 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:28.562464 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03de19-04e4-42ba-a5bc-0f1182b47913 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:28.562623 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03de19-04e4-42ba-a5bc-0f1182b47913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:28.580917 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-bf03de19-04e4-42ba-a5bc-0f1182b47913 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:28.582086 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-bf03de19-04e4-42ba-a5bc-0f1182b47913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:28.646601 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 562/1108] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:28.671696 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9a659-6852-4183-9e04-e818d0ee0e84 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:28.772446 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9a659-6852-4183-9e04-e818d0ee0e84 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:28.805737 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c19949-959a-49f5-a520-70840b6ed96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:28.806446 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c19949-959a-49f5-a520-70840b6ed96e None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:28.806728 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c19949-959a-49f5-a520-70840b6ed96e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:28.807002 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c19949-959a-49f5-a520-70840b6ed96e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:28.808323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c19949-959a-49f5-a520-70840b6ed96e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:28.809739 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c19949-959a-49f5-a520-70840b6ed96e None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:28.811381 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 547/1109] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:28.817068 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03de19-04e4-42ba-a5bc-0f1182b47913 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:28.898247 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:28.913331 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03de19-04e4-42ba-a5bc-0f1182b47913 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:28.946434 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee048de-f9a0-4af0-93dc-a258795b6955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:28.947088 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee048de-f9a0-4af0-93dc-a258795b6955 None admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:28.947366 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee048de-f9a0-4af0-93dc-a258795b6955 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:28.947663 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee048de-f9a0-4af0-93dc-a258795b6955 None admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:28.948376 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee048de-f9a0-4af0-93dc-a258795b6955 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:28.949790 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee048de-f9a0-4af0-93dc-a258795b6955 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:29.019843 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 563/1110] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jul 25 08:33:28 2022] POST /identity/v3/users => generated 286 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:33:31.062931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d3488-f9fd-4466-ba54-a72f05566f80 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:31.063436 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d3488-f9fd-4466-ba54-a72f05566f80 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:31.063436 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d3488-f9fd-4466-ba54-a72f05566f80 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:31.064795 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 548/1111] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:31.070044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25329801-32ea-4599-b962-29c822dd6f02 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:31.070410 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25329801-32ea-4599-b962-29c822dd6f02 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:31.070615 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25329801-32ea-4599-b962-29c822dd6f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:31.088309 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-25329801-32ea-4599-b962-29c822dd6f02 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:31.089503 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-25329801-32ea-4599-b962-29c822dd6f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:31.153767 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 564/1112] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:31.178152 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d3488-f9fd-4466-ba54-a72f05566f80 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:31.202391 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:31.276844 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d3488-f9fd-4466-ba54-a72f05566f80 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:31.310111 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69892ae-71fe-415b-80a2-8fe8b528f0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:31.311196 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69892ae-71fe-415b-80a2-8fe8b528f0c8 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:31.311482 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69892ae-71fe-415b-80a2-8fe8b528f0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:31.311791 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69892ae-71fe-415b-80a2-8fe8b528f0c8 None admin] PATH_INFO: `/v3/roles/be32d79ae2964b4b93a1efff3a9aa70b` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:31.313314 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69892ae-71fe-415b-80a2-8fe8b528f0c8 None admin] RBAC: Authorizing `identity:get_role(role_id=be32d79ae2964b4b93a1efff3a9aa70b)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:31.314621 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69892ae-71fe-415b-80a2-8fe8b528f0c8 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:31.316005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 549/1113] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:33:31 2022] GET /identity/v3/roles/be32d79ae2964b4b93a1efff3a9aa70b => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:31.321818 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25329801-32ea-4599-b962-29c822dd6f02 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:31.389381 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:31.417397 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25329801-32ea-4599-b962-29c822dd6f02 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:31.450068 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef834c-02e2-4205-9feb-f01cb2f03fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:31.451440 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef834c-02e2-4205-9feb-f01cb2f03fdf None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:31.451855 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef834c-02e2-4205-9feb-f01cb2f03fdf None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:31.452270 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef834c-02e2-4205-9feb-f01cb2f03fdf None admin] PATH_INFO: `/v3/users/22d94b9e42584d5f9987467f269a2939` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:31.464736 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef834c-02e2-4205-9feb-f01cb2f03fdf None admin] RBAC: Authorizing `identity:get_user(user_id=22d94b9e42584d5f9987467f269a2939)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:31.466172 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef834c-02e2-4205-9feb-f01cb2f03fdf None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:31.468492 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 565/1114] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:33:31 2022] GET /identity/v3/users/22d94b9e42584d5f9987467f269a2939 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:31.474218 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69892ae-71fe-415b-80a2-8fe8b528f0c8 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:31.561452 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:31.570715 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69892ae-71fe-415b-80a2-8fe8b528f0c8 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:31.604639 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068ea54-560a-45db-8b6c-caa40f60ff47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:31.605272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068ea54-560a-45db-8b6c-caa40f60ff47 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:31.605559 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068ea54-560a-45db-8b6c-caa40f60ff47 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:31.605836 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068ea54-560a-45db-8b6c-caa40f60ff47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:31.671010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068ea54-560a-45db-8b6c-caa40f60ff47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:31.672466 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068ea54-560a-45db-8b6c-caa40f60ff47 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:31.758201 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:31.768894 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 550/1115] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:33:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 08:33:31.774798 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef834c-02e2-4205-9feb-f01cb2f03fdf None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:31.871115 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef834c-02e2-4205-9feb-f01cb2f03fdf None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:31.944844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:31.950179 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f682b1-3fea-4341-8040-db5240a1404b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:31.951690 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f682b1-3fea-4341-8040-db5240a1404b None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:31.952168 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f682b1-3fea-4341-8040-db5240a1404b None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:31.952451 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f682b1-3fea-4341-8040-db5240a1404b None admin] PATH_INFO: `/v3/projects/4d87fecb76144f898c137682180a3c01` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:31.953630 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f682b1-3fea-4341-8040-db5240a1404b None admin] RBAC: Authorizing `identity:get_project(project_id=4d87fecb76144f898c137682180a3c01)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:31.955065 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f682b1-3fea-4341-8040-db5240a1404b None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:31.956774 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 566/1116] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:33:31 2022] GET /identity/v3/projects/4d87fecb76144f898c137682180a3c01 => generated 311 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:31.962881 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068ea54-560a-45db-8b6c-caa40f60ff47 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:32.058339 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068ea54-560a-45db-8b6c-caa40f60ff47 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:32.091386 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4a4f6-adcf-4a8c-88f6-01d87df42a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:32.092480 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4a4f6-adcf-4a8c-88f6-01d87df42a75 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:32.092575 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4a4f6-adcf-4a8c-88f6-01d87df42a75 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:32.092817 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4a4f6-adcf-4a8c-88f6-01d87df42a75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:32.093643 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4a4f6-adcf-4a8c-88f6-01d87df42a75 None admin] RBAC: Adding query filter params (role.id=be32d79ae2964b4b93a1efff3a9aa70b, scope.project.id=4d87fecb76144f898c137682180a3c01, user.id=22d94b9e42584d5f9987467f269a2939) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:32.093960 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4a4f6-adcf-4a8c-88f6-01d87df42a75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:32.095378 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4a4f6-adcf-4a8c-88f6-01d87df42a75 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:32.100811 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 551/1117] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:33:31 2022] GET /identity/v3/role_assignments?user.id=22d94b9e42584d5f9987467f269a2939&scope.project.id=4d87fecb76144f898c137682180a3c01&role.id=be32d79ae2964b4b93a1efff3a9aa70b => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:34.053629 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fec2db-03bc-4829-8688-736f170d0b81 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:34.054130 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fec2db-03bc-4829-8688-736f170d0b81 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:34.054130 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fec2db-03bc-4829-8688-736f170d0b81 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:34.055463 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 567/1118] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:34.060692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110450a-c27d-4b64-b5d1-7a596247bf7a None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:34.061152 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110450a-c27d-4b64-b5d1-7a596247bf7a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:34.061436 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110450a-c27d-4b64-b5d1-7a596247bf7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:34.079221 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-8110450a-c27d-4b64-b5d1-7a596247bf7a None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:34.080438 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-8110450a-c27d-4b64-b5d1-7a596247bf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:34.130704 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:34.149282 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 552/1119] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:34.172618 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fec2db-03bc-4829-8688-736f170d0b81 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:34.273471 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fec2db-03bc-4829-8688-736f170d0b81 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:34.306191 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f2cc7-a95b-489e-b497-8064f28617be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:34.306982 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f2cc7-a95b-489e-b497-8064f28617be None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:34.307262 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f2cc7-a95b-489e-b497-8064f28617be None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:34.307537 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f2cc7-a95b-489e-b497-8064f28617be None admin] PATH_INFO: `/v3/roles/be32d79ae2964b4b93a1efff3a9aa70b` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:34.309041 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f2cc7-a95b-489e-b497-8064f28617be None admin] RBAC: Authorizing `identity:get_role(role_id=be32d79ae2964b4b93a1efff3a9aa70b)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:34.310573 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f2cc7-a95b-489e-b497-8064f28617be None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:34.311980 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 568/1120] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:33:34 2022] GET /identity/v3/roles/be32d79ae2964b4b93a1efff3a9aa70b => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:34.317729 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110450a-c27d-4b64-b5d1-7a596247bf7a None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:34.412644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110450a-c27d-4b64-b5d1-7a596247bf7a None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:34.445128 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cf0a2-cee7-4b26-8970-5a2f22b05332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:34.445973 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cf0a2-cee7-4b26-8970-5a2f22b05332 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:34.446252 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cf0a2-cee7-4b26-8970-5a2f22b05332 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:34.446528 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cf0a2-cee7-4b26-8970-5a2f22b05332 None admin] PATH_INFO: `/v3/users/22d94b9e42584d5f9987467f269a2939` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:34.447707 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916cf0a2-cee7-4b26-8970-5a2f22b05332 None admin] RBAC: Authorizing `identity:get_user(user_id=22d94b9e42584d5f9987467f269a2939)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:34.449124 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916cf0a2-cee7-4b26-8970-5a2f22b05332 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:34.450707 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 553/1121] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:33:34 2022] GET /identity/v3/users/22d94b9e42584d5f9987467f269a2939 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:34.457175 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f2cc7-a95b-489e-b497-8064f28617be None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:34.521108 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:34.555887 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f2cc7-a95b-489e-b497-8064f28617be None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:34.587956 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204e51a-6b90-4c8f-a640-20e4adce3668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:34.588747 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204e51a-6b90-4c8f-a640-20e4adce3668 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:34.589029 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204e51a-6b90-4c8f-a640-20e4adce3668 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:34.589304 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204e51a-6b90-4c8f-a640-20e4adce3668 None admin] PATH_INFO: `/v3/projects/4d87fecb76144f898c137682180a3c01` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:34.590469 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b204e51a-6b90-4c8f-a640-20e4adce3668 None admin] RBAC: Authorizing `identity:get_project(project_id=4d87fecb76144f898c137682180a3c01)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:34.592522 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b204e51a-6b90-4c8f-a640-20e4adce3668 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:34.594201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 569/1122] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:33:34 2022] GET /identity/v3/projects/4d87fecb76144f898c137682180a3c01 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:34.600123 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cf0a2-cee7-4b26-8970-5a2f22b05332 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:34.650937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:34.698388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cf0a2-cee7-4b26-8970-5a2f22b05332 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:34.732475 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27545f1-e885-4ca1-9c3e-0a00281768d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:34.733441 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27545f1-e885-4ca1-9c3e-0a00281768d3 None admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:34.733724 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27545f1-e885-4ca1-9c3e-0a00281768d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:34.734001 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27545f1-e885-4ca1-9c3e-0a00281768d3 None admin] PATH_INFO: `/v3/projects/4d87fecb76144f898c137682180a3c01/users/22d94b9e42584d5f9987467f269a2939/roles/be32d79ae2964b4b93a1efff3a9aa70b` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:34.736198 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27545f1-e885-4ca1-9c3e-0a00281768d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d87fecb76144f898c137682180a3c01, user_id=22d94b9e42584d5f9987467f269a2939, role_id=be32d79ae2964b4b93a1efff3a9aa70b)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:34.737625 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27545f1-e885-4ca1-9c3e-0a00281768d3 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:34.814135 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 554/1123] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 08:33:34 2022] PUT /identity/v3/projects/4d87fecb76144f898c137682180a3c01/users/22d94b9e42584d5f9987467f269a2939/roles/be32d79ae2964b4b93a1efff3a9aa70b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:33:36.800677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52102f-34d0-4cfa-9749-451a1b3918ab None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:36.801214 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52102f-34d0-4cfa-9749-451a1b3918ab None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:36.801214 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52102f-34d0-4cfa-9749-451a1b3918ab None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:36.802607 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 570/1124] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:36.807872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1525a-c0f8-4024-87cd-ac4cdca1457b None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:36.808302 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1525a-c0f8-4024-87cd-ac4cdca1457b None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:36.808596 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1525a-c0f8-4024-87cd-ac4cdca1457b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:36.826769 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-5aa1525a-c0f8-4024-87cd-ac4cdca1457b None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:36.827977 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-5aa1525a-c0f8-4024-87cd-ac4cdca1457b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:36.898828 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 555/1125] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:36.922530 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52102f-34d0-4cfa-9749-451a1b3918ab None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:37.019764 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52102f-34d0-4cfa-9749-451a1b3918ab None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:37.052257 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54325c-48ee-4ebf-8c44-15b3b35d8123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:37.053095 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54325c-48ee-4ebf-8c44-15b3b35d8123 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:37.053379 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54325c-48ee-4ebf-8c44-15b3b35d8123 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:37.053654 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54325c-48ee-4ebf-8c44-15b3b35d8123 None admin] PATH_INFO: `/v3/roles/be32d79ae2964b4b93a1efff3a9aa70b` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:37.055114 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd54325c-48ee-4ebf-8c44-15b3b35d8123 None admin] RBAC: Authorizing `identity:get_role(role_id=be32d79ae2964b4b93a1efff3a9aa70b)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:37.056503 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd54325c-48ee-4ebf-8c44-15b3b35d8123 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:37.057840 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 571/1126] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:33:36 2022] GET /identity/v3/roles/be32d79ae2964b4b93a1efff3a9aa70b => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:37.063667 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1525a-c0f8-4024-87cd-ac4cdca1457b None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:37.104937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:37.160158 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1525a-c0f8-4024-87cd-ac4cdca1457b None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:37.192858 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24443ca8-34e9-4b42-adc7-395bbe49386f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:37.193717 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24443ca8-34e9-4b42-adc7-395bbe49386f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:37.194000 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24443ca8-34e9-4b42-adc7-395bbe49386f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:37.194275 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24443ca8-34e9-4b42-adc7-395bbe49386f None admin] PATH_INFO: `/v3/users/22d94b9e42584d5f9987467f269a2939` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:37.195445 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24443ca8-34e9-4b42-adc7-395bbe49386f None admin] RBAC: Authorizing `identity:get_user(user_id=22d94b9e42584d5f9987467f269a2939)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:37.196908 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24443ca8-34e9-4b42-adc7-395bbe49386f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:37.198521 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 556/1127] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:33:37 2022] GET /identity/v3/users/22d94b9e42584d5f9987467f269a2939 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:37.204311 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54325c-48ee-4ebf-8c44-15b3b35d8123 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:37.207127 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:37.302032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54325c-48ee-4ebf-8c44-15b3b35d8123 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:37.334470 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce48cc-f4b7-489d-b8a3-fedd37c99990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:37.335105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce48cc-f4b7-489d-b8a3-fedd37c99990 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:37.335388 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce48cc-f4b7-489d-b8a3-fedd37c99990 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:37.335696 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce48cc-f4b7-489d-b8a3-fedd37c99990 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:37.400099 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce48cc-f4b7-489d-b8a3-fedd37c99990 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:37.401526 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce48cc-f4b7-489d-b8a3-fedd37c99990 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:37.403244 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:37.496080 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 572/1128] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:33:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 08:33:37.501919 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24443ca8-34e9-4b42-adc7-395bbe49386f None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:37.599198 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24443ca8-34e9-4b42-adc7-395bbe49386f None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:37.609339 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:37.631291 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab658e61-5a75-440b-bd6b-d3932c014ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:37.632164 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab658e61-5a75-440b-bd6b-d3932c014ca0 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:37.632446 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab658e61-5a75-440b-bd6b-d3932c014ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:37.632720 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab658e61-5a75-440b-bd6b-d3932c014ca0 None admin] PATH_INFO: `/v3/projects/4d87fecb76144f898c137682180a3c01` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:37.633945 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab658e61-5a75-440b-bd6b-d3932c014ca0 None admin] RBAC: Authorizing `identity:get_project(project_id=4d87fecb76144f898c137682180a3c01)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:37.635350 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab658e61-5a75-440b-bd6b-d3932c014ca0 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:37.637050 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 557/1129] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:33:37 2022] GET /identity/v3/projects/4d87fecb76144f898c137682180a3c01 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:37.643802 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce48cc-f4b7-489d-b8a3-fedd37c99990 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:37.741740 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce48cc-f4b7-489d-b8a3-fedd37c99990 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:37.743245 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:37.775687 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da03e6-df43-414f-acb7-7ecbf27a6ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:37.776330 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da03e6-df43-414f-acb7-7ecbf27a6ea0 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:37.776610 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da03e6-df43-414f-acb7-7ecbf27a6ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:37.776883 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da03e6-df43-414f-acb7-7ecbf27a6ea0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:37.777716 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da03e6-df43-414f-acb7-7ecbf27a6ea0 None admin] RBAC: Adding query filter params (role.id=be32d79ae2964b4b93a1efff3a9aa70b, scope.project.id=4d87fecb76144f898c137682180a3c01, user.id=22d94b9e42584d5f9987467f269a2939) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:37.778027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da03e6-df43-414f-acb7-7ecbf27a6ea0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:37.779643 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da03e6-df43-414f-acb7-7ecbf27a6ea0 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:37.785486 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 573/1130] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:33:37 2022] GET /identity/v3/role_assignments?user.id=22d94b9e42584d5f9987467f269a2939&scope.project.id=4d87fecb76144f898c137682180a3c01&role.id=be32d79ae2964b4b93a1efff3a9aa70b => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:39.801437 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bb7be-38ca-4d3b-b568-29adb092a5ce None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:39.801956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bb7be-38ca-4d3b-b568-29adb092a5ce None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:39.802061 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bb7be-38ca-4d3b-b568-29adb092a5ce None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:39.803347 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 558/1131] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:39.808724 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4f18f-71e3-4376-b75b-a501dded6e1e None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:39.809234 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4f18f-71e3-4376-b75b-a501dded6e1e None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:39.809328 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4f18f-71e3-4376-b75b-a501dded6e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:39.827488 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-cce4f18f-71e3-4376-b75b-a501dded6e1e None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:39.828685 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-cce4f18f-71e3-4376-b75b-a501dded6e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:39.891351 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 574/1132] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:39.914868 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bb7be-38ca-4d3b-b568-29adb092a5ce None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:40.013207 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bb7be-38ca-4d3b-b568-29adb092a5ce None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:40.047210 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28dd397-8fb8-47b4-a0fd-414cd376a53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:40.048024 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28dd397-8fb8-47b4-a0fd-414cd376a53e None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:40.048313 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28dd397-8fb8-47b4-a0fd-414cd376a53e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:40.048596 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28dd397-8fb8-47b4-a0fd-414cd376a53e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:40.049769 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28dd397-8fb8-47b4-a0fd-414cd376a53e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:40.051204 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28dd397-8fb8-47b4-a0fd-414cd376a53e None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:40.052848 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 559/1133] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:40.058469 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4f18f-71e3-4376-b75b-a501dded6e1e None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:40.150934 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:40.157292 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4f18f-71e3-4376-b75b-a501dded6e1e None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:40.190768 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf2b92-fc1a-45b1-bd2f-036617aa4706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:40.191407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf2b92-fc1a-45b1-bd2f-036617aa4706 None admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:40.191745 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf2b92-fc1a-45b1-bd2f-036617aa4706 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:40.192020 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf2b92-fc1a-45b1-bd2f-036617aa4706 None admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:40.192724 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf2b92-fc1a-45b1-bd2f-036617aa4706 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:40.194149 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf2b92-fc1a-45b1-bd2f-036617aa4706 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:40.306326 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 575/1134] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jul 25 08:33:40 2022] POST /identity/v3/projects => generated 311 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:33:42.308219 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e661da2-b046-41d3-9ce8-48193d30eec3 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:42.308792 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e661da2-b046-41d3-9ce8-48193d30eec3 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:42.308792 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e661da2-b046-41d3-9ce8-48193d30eec3 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:42.310135 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 560/1135] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:42.315307 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c10eb3-77d8-49f2-85d6-7f9ac7ebcf24 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:42.315771 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c10eb3-77d8-49f2-85d6-7f9ac7ebcf24 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:42.315897 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c10eb3-77d8-49f2-85d6-7f9ac7ebcf24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:42.333743 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-50c10eb3-77d8-49f2-85d6-7f9ac7ebcf24 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:42.334930 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-50c10eb3-77d8-49f2-85d6-7f9ac7ebcf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:42.399356 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 576/1136] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:42.424053 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e661da2-b046-41d3-9ce8-48193d30eec3 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:42.470686 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:42.523804 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e661da2-b046-41d3-9ce8-48193d30eec3 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:42.557445 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18ee24-8d41-4de9-8771-536eddbb3ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:42.558274 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18ee24-8d41-4de9-8771-536eddbb3ef4 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:42.558506 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18ee24-8d41-4de9-8771-536eddbb3ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:42.558784 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18ee24-8d41-4de9-8771-536eddbb3ef4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:42.560560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18ee24-8d41-4de9-8771-536eddbb3ef4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:42.561976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18ee24-8d41-4de9-8771-536eddbb3ef4 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:42.563570 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 561/1137] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:33:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:42.569266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c10eb3-77d8-49f2-85d6-7f9ac7ebcf24 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:42.643367 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:42.663893 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c10eb3-77d8-49f2-85d6-7f9ac7ebcf24 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:42.697859 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2813a8d-bced-41c8-9c63-67d705ece9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:42.698542 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2813a8d-bced-41c8-9c63-67d705ece9c1 None admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:42.698820 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2813a8d-bced-41c8-9c63-67d705ece9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:42.699092 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2813a8d-bced-41c8-9c63-67d705ece9c1 None admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:42.699832 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2813a8d-bced-41c8-9c63-67d705ece9c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:42.701336 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2813a8d-bced-41c8-9c63-67d705ece9c1 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:42.785275 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 577/1138] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jul 25 08:33:42 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:33:44.791202 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb69a7-540b-4dea-919f-efa55a9a4d9d None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:44.791711 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb69a7-540b-4dea-919f-efa55a9a4d9d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:44.791829 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb69a7-540b-4dea-919f-efa55a9a4d9d None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:44.793121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 562/1139] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:44.801897 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3a0db-4052-469a-8260-8efdf681fc27 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:44.802287 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3a0db-4052-469a-8260-8efdf681fc27 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:44.802448 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3a0db-4052-469a-8260-8efdf681fc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:44.821723 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-62d3a0db-4052-469a-8260-8efdf681fc27 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:44.822924 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-62d3a0db-4052-469a-8260-8efdf681fc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:44.887216 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 578/1140] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:44.910955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb69a7-540b-4dea-919f-efa55a9a4d9d None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:45.008244 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb69a7-540b-4dea-919f-efa55a9a4d9d None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:45.021982 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:45.041547 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1182c5-8ecb-4b82-a76f-7ef772f0798e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:45.055502 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1182c5-8ecb-4b82-a76f-7ef772f0798e None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:45.055502 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1182c5-8ecb-4b82-a76f-7ef772f0798e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:45.055502 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1182c5-8ecb-4b82-a76f-7ef772f0798e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:45.055502 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1182c5-8ecb-4b82-a76f-7ef772f0798e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:33:45.060180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-1d1182c5-8ecb-4b82-a76f-7ef772f0798e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:33:45.060180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:45.060180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:45.060180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:45.060180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:45.060180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:45.060180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:45.060180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:45.060180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:45.060180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:45.060180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:45.060180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:45.060180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:33:45.060180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:33:45.060180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:33:45.060180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:33:45.061321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:33:45.061321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:33:45.061321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:33:45.061321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:33:45.061321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:45.061321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:45.061321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:45.061321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:45.061321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:45.061321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:45.061321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:45.061321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:45.061321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:45.061321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:45.061321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:45.061321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:45.062499 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:45.062499 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:45.062499 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:45.062499 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:45.062499 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:33:45.062499 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:33:45.062499 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:33:45.062499 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:33:45.062499 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:33:45.062499 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:33:45.062499 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:33:45.062499 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:45.062499 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 563/1141] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:33:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:45.067456 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3a0db-4052-469a-8260-8efdf681fc27 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:45.127224 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:45.163674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3a0db-4052-469a-8260-8efdf681fc27 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:45.196453 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023f06a-f00e-4794-9c2c-770c28e6069c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:45.197106 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023f06a-f00e-4794-9c2c-770c28e6069c None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:45.197391 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023f06a-f00e-4794-9c2c-770c28e6069c None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:45.197667 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023f06a-f00e-4794-9c2c-770c28e6069c None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:45.198410 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023f06a-f00e-4794-9c2c-770c28e6069c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:45.198715 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023f06a-f00e-4794-9c2c-770c28e6069c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:45.200109 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023f06a-f00e-4794-9c2c-770c28e6069c None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:45.208115 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 579/1142] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:33:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:45.213832 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1182c5-8ecb-4b82-a76f-7ef772f0798e None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:45.311937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1182c5-8ecb-4b82-a76f-7ef772f0798e None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:45.344617 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84cf65-62a1-4012-afd2-7ffe82c73f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:45.345474 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84cf65-62a1-4012-afd2-7ffe82c73f9d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:45.345761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84cf65-62a1-4012-afd2-7ffe82c73f9d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:45.346041 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84cf65-62a1-4012-afd2-7ffe82c73f9d None admin] PATH_INFO: `/v3/users/e1479d0bca1a48089e8b1371a6733811` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:45.359765 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84cf65-62a1-4012-afd2-7ffe82c73f9d None admin] RBAC: Authorizing `identity:get_user(user_id=e1479d0bca1a48089e8b1371a6733811)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:45.361202 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84cf65-62a1-4012-afd2-7ffe82c73f9d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:45.362848 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 564/1143] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:33:45 2022] GET /identity/v3/users/e1479d0bca1a48089e8b1371a6733811 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:45.368548 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023f06a-f00e-4794-9c2c-770c28e6069c None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:45.464113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023f06a-f00e-4794-9c2c-770c28e6069c None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:45.488821 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:45.497025 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3973f4-baf7-4534-bcc1-5b3c1ba8fe55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:45.502136 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3973f4-baf7-4534-bcc1-5b3c1ba8fe55 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:45.502136 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3973f4-baf7-4534-bcc1-5b3c1ba8fe55 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:45.502136 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3973f4-baf7-4534-bcc1-5b3c1ba8fe55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:45.563730 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3973f4-baf7-4534-bcc1-5b3c1ba8fe55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:45.565108 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3973f4-baf7-4534-bcc1-5b3c1ba8fe55 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:45.661609 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 580/1144] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:33:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 08:33:45.667586 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84cf65-62a1-4012-afd2-7ffe82c73f9d None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:45.698215 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:45.764544 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84cf65-62a1-4012-afd2-7ffe82c73f9d None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:45.797368 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3602be5-3617-4a2b-b422-416e668dc204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:45.798217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3602be5-3617-4a2b-b422-416e668dc204 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:45.798500 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3602be5-3617-4a2b-b422-416e668dc204 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:45.798778 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3602be5-3617-4a2b-b422-416e668dc204 None admin] PATH_INFO: `/v3/projects/ee964cb7007d4b7983ea8124d352d372` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:45.799965 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3602be5-3617-4a2b-b422-416e668dc204 None admin] RBAC: Authorizing `identity:get_project(project_id=ee964cb7007d4b7983ea8124d352d372)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:45.801375 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3602be5-3617-4a2b-b422-416e668dc204 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:45.803039 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 565/1145] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:33:45 2022] GET /identity/v3/projects/ee964cb7007d4b7983ea8124d352d372 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:45.809124 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3973f4-baf7-4534-bcc1-5b3c1ba8fe55 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:45.835514 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:45.905836 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3973f4-baf7-4534-bcc1-5b3c1ba8fe55 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:45.939685 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33436ec9-6aa5-49f6-9a54-c8ecad83bc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:45.940329 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33436ec9-6aa5-49f6-9a54-c8ecad83bc01 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:45.940611 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33436ec9-6aa5-49f6-9a54-c8ecad83bc01 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:45.940887 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33436ec9-6aa5-49f6-9a54-c8ecad83bc01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:45.941709 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33436ec9-6aa5-49f6-9a54-c8ecad83bc01 None admin] RBAC: Adding query filter params (role.id=25b0f48c10474bf6b98aad8f093868ee, scope.project.id=ee964cb7007d4b7983ea8124d352d372, user.id=e1479d0bca1a48089e8b1371a6733811) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:45.942020 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33436ec9-6aa5-49f6-9a54-c8ecad83bc01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:45.943451 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33436ec9-6aa5-49f6-9a54-c8ecad83bc01 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:45.948687 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 581/1146] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:33:45 2022] GET /identity/v3/role_assignments?user.id=e1479d0bca1a48089e8b1371a6733811&scope.project.id=ee964cb7007d4b7983ea8124d352d372&role.id=25b0f48c10474bf6b98aad8f093868ee => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:47.884901 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d88df8-0be7-46f0-ae37-44a425f7d75e None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:47.885450 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d88df8-0be7-46f0-ae37-44a425f7d75e None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:47.885450 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d88df8-0be7-46f0-ae37-44a425f7d75e None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:47.886820 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 566/1147] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:47.892583 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc65309-1bb5-4023-b261-fd1af865a02c None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:47.892981 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc65309-1bb5-4023-b261-fd1af865a02c None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:47.893141 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc65309-1bb5-4023-b261-fd1af865a02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:47.911866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-ffc65309-1bb5-4023-b261-fd1af865a02c None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:47.913050 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-ffc65309-1bb5-4023-b261-fd1af865a02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:47.977525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 582/1148] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:48.000160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d88df8-0be7-46f0-ae37-44a425f7d75e None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:48.095477 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:48.099044 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d88df8-0be7-46f0-ae37-44a425f7d75e None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:48.131455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aecfbb-6e5f-41b6-aa93-7e0f38991964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:48.132260 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aecfbb-6e5f-41b6-aa93-7e0f38991964 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:48.132548 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aecfbb-6e5f-41b6-aa93-7e0f38991964 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:48.132828 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aecfbb-6e5f-41b6-aa93-7e0f38991964 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:48.143733 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aecfbb-6e5f-41b6-aa93-7e0f38991964 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:33:48.151312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-72aecfbb-6e5f-41b6-aa93-7e0f38991964 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:33:48.151312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:48.151312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:48.151312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:48.151312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:48.151312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:48.151312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:48.151312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:48.151312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:48.151312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:48.151312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:48.151312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:48.151312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:33:48.151312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:33:48.151312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:33:48.151312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:33:48.152424 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:33:48.152424 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:33:48.152424 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:33:48.152424 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:33:48.152424 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:48.152424 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:48.152424 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:48.152424 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:48.152424 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:48.152424 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:48.152424 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:48.152424 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:48.152424 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:48.152424 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:48.152424 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:48.152424 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:48.153449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:48.153449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:48.153449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:48.153449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:48.153449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:33:48.153449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:33:48.153449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:33:48.153449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:33:48.153449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:33:48.153449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:33:48.153449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:33:48.153449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:48.153449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 567/1149] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:33:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:48.159399 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc65309-1bb5-4023-b261-fd1af865a02c None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:48.180235 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:48.256907 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc65309-1bb5-4023-b261-fd1af865a02c None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:48.291918 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da0078-a6a7-4696-8900-b13e0765f248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:48.292581 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da0078-a6a7-4696-8900-b13e0765f248 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:48.292863 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da0078-a6a7-4696-8900-b13e0765f248 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:48.293135 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da0078-a6a7-4696-8900-b13e0765f248 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:48.293875 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da0078-a6a7-4696-8900-b13e0765f248 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:48.294181 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da0078-a6a7-4696-8900-b13e0765f248 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:48.295826 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da0078-a6a7-4696-8900-b13e0765f248 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:48.303806 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 583/1150] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:33:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:33:48.309438 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aecfbb-6e5f-41b6-aa93-7e0f38991964 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:48.408190 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aecfbb-6e5f-41b6-aa93-7e0f38991964 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:48.440956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90776cf-60b1-4ef5-a0f7-9124bd0053bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:48.441807 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90776cf-60b1-4ef5-a0f7-9124bd0053bc None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:48.442091 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90776cf-60b1-4ef5-a0f7-9124bd0053bc None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:48.442367 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90776cf-60b1-4ef5-a0f7-9124bd0053bc None admin] PATH_INFO: `/v3/users/e1479d0bca1a48089e8b1371a6733811` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:48.443532 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90776cf-60b1-4ef5-a0f7-9124bd0053bc None admin] RBAC: Authorizing `identity:get_user(user_id=e1479d0bca1a48089e8b1371a6733811)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:48.444975 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90776cf-60b1-4ef5-a0f7-9124bd0053bc None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:48.446568 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 568/1151] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:33:48 2022] GET /identity/v3/users/e1479d0bca1a48089e8b1371a6733811 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:48.452520 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da0078-a6a7-4696-8900-b13e0765f248 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:48.532663 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:48.556560 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da0078-a6a7-4696-8900-b13e0765f248 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:48.589284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328bf5a-73a2-426e-8cd4-1a971d5f1d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:48.590126 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328bf5a-73a2-426e-8cd4-1a971d5f1d09 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:48.590407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328bf5a-73a2-426e-8cd4-1a971d5f1d09 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:48.590678 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328bf5a-73a2-426e-8cd4-1a971d5f1d09 None admin] PATH_INFO: `/v3/projects/ee964cb7007d4b7983ea8124d352d372` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:48.591901 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328bf5a-73a2-426e-8cd4-1a971d5f1d09 None admin] RBAC: Authorizing `identity:get_project(project_id=ee964cb7007d4b7983ea8124d352d372)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:48.593333 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328bf5a-73a2-426e-8cd4-1a971d5f1d09 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:48.595020 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 584/1152] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:33:48 2022] GET /identity/v3/projects/ee964cb7007d4b7983ea8124d352d372 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:48.600980 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90776cf-60b1-4ef5-a0f7-9124bd0053bc None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:48.630291 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:48.698824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90776cf-60b1-4ef5-a0f7-9124bd0053bc None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:48.732391 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977b740-c2d2-4887-87ff-4dcc98018225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:48.733275 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977b740-c2d2-4887-87ff-4dcc98018225 None admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:48.733564 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977b740-c2d2-4887-87ff-4dcc98018225 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:48.733841 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977b740-c2d2-4887-87ff-4dcc98018225 None admin] PATH_INFO: `/v3/projects/ee964cb7007d4b7983ea8124d352d372/users/e1479d0bca1a48089e8b1371a6733811/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:48.735819 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977b740-c2d2-4887-87ff-4dcc98018225 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee964cb7007d4b7983ea8124d352d372, user_id=e1479d0bca1a48089e8b1371a6733811, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:48.737237 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977b740-c2d2-4887-87ff-4dcc98018225 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:48.818921 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 569/1153] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 08:33:48 2022] PUT /identity/v3/projects/ee964cb7007d4b7983ea8124d352d372/users/e1479d0bca1a48089e8b1371a6733811/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:33:50.784259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3480b1-62c4-423e-a474-9a144211c283 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:50.784781 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3480b1-62c4-423e-a474-9a144211c283 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:50.784882 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3480b1-62c4-423e-a474-9a144211c283 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:50.786181 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 585/1154] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:50.791312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8db31-9122-4845-a1b5-cc8bdbdf1fa2 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:50.791741 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8db31-9122-4845-a1b5-cc8bdbdf1fa2 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:50.791903 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8db31-9122-4845-a1b5-cc8bdbdf1fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:50.810142 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-f0e8db31-9122-4845-a1b5-cc8bdbdf1fa2 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:50.811354 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f0e8db31-9122-4845-a1b5-cc8bdbdf1fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:50.875330 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 570/1155] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:50.898353 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3480b1-62c4-423e-a474-9a144211c283 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:50.997339 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3480b1-62c4-423e-a474-9a144211c283 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:51.029728 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68adc6f-27de-43ab-9f1c-89d8c4ae1775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:51.030506 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68adc6f-27de-43ab-9f1c-89d8c4ae1775 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:51.030790 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68adc6f-27de-43ab-9f1c-89d8c4ae1775 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:51.031061 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68adc6f-27de-43ab-9f1c-89d8c4ae1775 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:51.041455 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68adc6f-27de-43ab-9f1c-89d8c4ae1775 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:33:51.049705 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-d68adc6f-27de-43ab-9f1c-89d8c4ae1775 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:33:51.049705 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:51.049705 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:51.049705 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:51.049705 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:51.049705 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:51.049705 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:51.049705 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:51.049705 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:51.049705 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:51.049705 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:51.049705 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:51.049705 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:33:51.049705 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:33:51.049705 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:33:51.049705 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:33:51.050801 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:33:51.050801 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:33:51.050801 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:33:51.050801 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:33:51.050801 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:51.050801 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:51.050801 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:51.050801 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:51.050801 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:51.050801 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:51.050801 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:51.050801 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:51.050801 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:51.050801 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:51.050801 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:51.050801 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:51.051725 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:51.051725 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:51.051725 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:51.051725 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:51.051725 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:33:51.051725 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:33:51.051725 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:33:51.051725 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:33:51.051725 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:33:51.051725 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:33:51.051725 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:33:51.051725 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:33:51.051725 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 586/1156] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:33:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:51.057003 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8db31-9122-4845-a1b5-cc8bdbdf1fa2 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:51.075335 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:51.152227 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8db31-9122-4845-a1b5-cc8bdbdf1fa2 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:51.185304 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d1638-0cc7-4f1e-870e-dab86073a916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:51.185966 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d1638-0cc7-4f1e-870e-dab86073a916 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:51.186243 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d1638-0cc7-4f1e-870e-dab86073a916 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:51.186544 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d1638-0cc7-4f1e-870e-dab86073a916 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:51.187287 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d1638-0cc7-4f1e-870e-dab86073a916 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:51.187592 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d1638-0cc7-4f1e-870e-dab86073a916 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:51.188978 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d1638-0cc7-4f1e-870e-dab86073a916 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:51.196749 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 571/1157] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:33:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:51.202692 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68adc6f-27de-43ab-9f1c-89d8c4ae1775 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:51.214535 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:51.300551 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68adc6f-27de-43ab-9f1c-89d8c4ae1775 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:51.332388 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e5b2f-bde9-42eb-9da6-611865683c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:51.333233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e5b2f-bde9-42eb-9da6-611865683c55 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:51.333515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e5b2f-bde9-42eb-9da6-611865683c55 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:51.333789 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e5b2f-bde9-42eb-9da6-611865683c55 None admin] PATH_INFO: `/v3/users/e1479d0bca1a48089e8b1371a6733811` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:51.334940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e5b2f-bde9-42eb-9da6-611865683c55 None admin] RBAC: Authorizing `identity:get_user(user_id=e1479d0bca1a48089e8b1371a6733811)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:51.336387 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e5b2f-bde9-42eb-9da6-611865683c55 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:51.337981 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 587/1158] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:33:51 2022] GET /identity/v3/users/e1479d0bca1a48089e8b1371a6733811 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:51.344343 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d1638-0cc7-4f1e-870e-dab86073a916 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:51.425733 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:51.444112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d1638-0cc7-4f1e-870e-dab86073a916 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:51.477218 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54572c-7d08-48a5-b411-44eff7200453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:51.477855 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54572c-7d08-48a5-b411-44eff7200453 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:51.478142 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54572c-7d08-48a5-b411-44eff7200453 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:51.478422 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54572c-7d08-48a5-b411-44eff7200453 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:51.545085 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54572c-7d08-48a5-b411-44eff7200453 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:51.546506 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54572c-7d08-48a5-b411-44eff7200453 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:51.623903 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:51.643585 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 572/1159] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:33:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 08:33:51.649413 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e5b2f-bde9-42eb-9da6-611865683c55 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:51.726300 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:51.748171 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e5b2f-bde9-42eb-9da6-611865683c55 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:51.780554 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef787a-f32f-49ef-a94f-5d2803cb4c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:51.781397 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef787a-f32f-49ef-a94f-5d2803cb4c90 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:51.781928 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef787a-f32f-49ef-a94f-5d2803cb4c90 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:51.782214 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef787a-f32f-49ef-a94f-5d2803cb4c90 None admin] PATH_INFO: `/v3/projects/ee964cb7007d4b7983ea8124d352d372` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:51.783386 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef787a-f32f-49ef-a94f-5d2803cb4c90 None admin] RBAC: Authorizing `identity:get_project(project_id=ee964cb7007d4b7983ea8124d352d372)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:51.784954 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef787a-f32f-49ef-a94f-5d2803cb4c90 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:51.786636 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 588/1160] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:33:51 2022] GET /identity/v3/projects/ee964cb7007d4b7983ea8124d352d372 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:51.792740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54572c-7d08-48a5-b411-44eff7200453 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:51.888506 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54572c-7d08-48a5-b411-44eff7200453 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:51.921774 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d499e6-be7f-43fe-ad6f-3a9b8acfb07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:51.922412 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d499e6-be7f-43fe-ad6f-3a9b8acfb07c None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:51.922696 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d499e6-be7f-43fe-ad6f-3a9b8acfb07c None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:51.922973 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d499e6-be7f-43fe-ad6f-3a9b8acfb07c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:51.923828 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d499e6-be7f-43fe-ad6f-3a9b8acfb07c None admin] RBAC: Adding query filter params (role.id=25b0f48c10474bf6b98aad8f093868ee, scope.project.id=ee964cb7007d4b7983ea8124d352d372, user.id=e1479d0bca1a48089e8b1371a6733811) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:51.924144 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d499e6-be7f-43fe-ad6f-3a9b8acfb07c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:51.925545 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d499e6-be7f-43fe-ad6f-3a9b8acfb07c None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:51.931137 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 573/1161] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:33:51 2022] GET /identity/v3/role_assignments?user.id=e1479d0bca1a48089e8b1371a6733811&scope.project.id=ee964cb7007d4b7983ea8124d352d372&role.id=25b0f48c10474bf6b98aad8f093868ee => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:53.928177 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da9c4a-181d-4247-be83-151a9a925828 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:53.928696 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da9c4a-181d-4247-be83-151a9a925828 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:53.928819 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da9c4a-181d-4247-be83-151a9a925828 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:53.930079 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 589/1162] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:53.935704 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5429b-20e6-41ea-b365-34c2c8b09cd4 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:53.936086 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5429b-20e6-41ea-b365-34c2c8b09cd4 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:53.936258 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5429b-20e6-41ea-b365-34c2c8b09cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:53.954440 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-d1c5429b-20e6-41ea-b365-34c2c8b09cd4 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:53.955603 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d1c5429b-20e6-41ea-b365-34c2c8b09cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:53.994025 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:54.020619 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 574/1163] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:54.043163 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da9c4a-181d-4247-be83-151a9a925828 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:54.140065 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da9c4a-181d-4247-be83-151a9a925828 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:54.172837 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36f856-713a-4e5e-b596-deef66de0753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:54.173467 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36f856-713a-4e5e-b596-deef66de0753 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:54.173751 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36f856-713a-4e5e-b596-deef66de0753 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:54.174027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36f856-713a-4e5e-b596-deef66de0753 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:54.189712 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:54.241090 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36f856-713a-4e5e-b596-deef66de0753 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:54.242530 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36f856-713a-4e5e-b596-deef66de0753 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:54.337567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 590/1164] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:33:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 08:33:54.343512 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5429b-20e6-41ea-b365-34c2c8b09cd4 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:54.438933 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5429b-20e6-41ea-b365-34c2c8b09cd4 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:54.472218 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cecf86-8749-48d8-b746-fd6ca394bc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:54.473001 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cecf86-8749-48d8-b746-fd6ca394bc5e None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:54.473282 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cecf86-8749-48d8-b746-fd6ca394bc5e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:54.473555 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cecf86-8749-48d8-b746-fd6ca394bc5e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:54.479979 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cecf86-8749-48d8-b746-fd6ca394bc5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:54.481435 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cecf86-8749-48d8-b746-fd6ca394bc5e None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:54.495369 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-f9cecf86-8749-48d8-b746-fd6ca394bc5e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 25 08:33:54.495369 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:54.495369 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 25 08:33:54.495369 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 25 08:33:54.495369 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:33:54.495369 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:33:54.495369 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:33:54.495369 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:33:54.495369 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 25 08:33:54.495369 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:54.495369 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:33:54.495369 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:54.495369 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:33:54.495369 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:33:54.495369 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:33:54.495369 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:33:54.495369 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:33:54.496579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:33:54.496579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:33:54.496579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:33:54.496579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:33:54.496579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:33:54.496579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:33:54.496579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:33:54.496579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:33:54.496579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:33:54.496579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:33:54.496579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:33:54.496579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:33:54.496579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:33:54.496579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:33:54.496579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:33:54.496579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:33:54.498102 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:33:54.498102 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:33:54.498102 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:33:54.498102 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:33:54.498102 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:33:54.498102 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:33:54.498102 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:33:54.498102 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:33:54.498102 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:33:54.498102 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:33:54.498102 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 25 08:33:54.498102 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:33:54.498102 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 25 08:33:54.498102 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:33:54.498102 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 575/1165] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Jul 25 08:33:54 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:33:54.503036 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36f856-713a-4e5e-b596-deef66de0753 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:54.548808 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:54.600457 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36f856-713a-4e5e-b596-deef66de0753 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:54.633697 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6edd7-a9c8-40cd-a6fc-8b129fe60708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:54.634346 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6edd7-a9c8-40cd-a6fc-8b129fe60708 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:54.634625 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6edd7-a9c8-40cd-a6fc-8b129fe60708 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:54.634897 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6edd7-a9c8-40cd-a6fc-8b129fe60708 None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:54.635633 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6edd7-a9c8-40cd-a6fc-8b129fe60708 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:33:54.635941 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6edd7-a9c8-40cd-a6fc-8b129fe60708 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:54.637302 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6edd7-a9c8-40cd-a6fc-8b129fe60708 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:54.644372 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 591/1166] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Jul 25 08:33:54 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:56.645615 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd9856-aad4-43b3-99a8-94e96d41eb1e None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:56.646171 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd9856-aad4-43b3-99a8-94e96d41eb1e None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:56.646171 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd9856-aad4-43b3-99a8-94e96d41eb1e None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:56.647507 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 576/1167] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:56.652680 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a0a42-1f2c-468c-ad48-ca10c5a2887a None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:56.653080 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a0a42-1f2c-468c-ad48-ca10c5a2887a None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:56.653271 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a0a42-1f2c-468c-ad48-ca10c5a2887a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:56.671405 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-cb6a0a42-1f2c-468c-ad48-ca10c5a2887a None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:56.672619 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-cb6a0a42-1f2c-468c-ad48-ca10c5a2887a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:56.736981 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 592/1168] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 08:33:56.759414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd9856-aad4-43b3-99a8-94e96d41eb1e None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:56.795427 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:56.860170 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd9856-aad4-43b3-99a8-94e96d41eb1e None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:56.893088 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56554890-1257-45a9-a348-61146e2aad44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:56.893733 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56554890-1257-45a9-a348-61146e2aad44 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:56.894018 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56554890-1257-45a9-a348-61146e2aad44 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:56.894297 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56554890-1257-45a9-a348-61146e2aad44 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:56.895027 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56554890-1257-45a9-a348-61146e2aad44 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:56.896468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56554890-1257-45a9-a348-61146e2aad44 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:56.951431 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 577/1169] 10.222.0.18 () {60 vars in 1138 bytes} [Mon Jul 25 08:33:56 2022] POST /identity/v3/domains => generated 267 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:33:58.972578 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c958c-39b6-43e8-b7a2-68b96d5e0813 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:58.973082 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c958c-39b6-43e8-b7a2-68b96d5e0813 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:58.973082 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c958c-39b6-43e8-b7a2-68b96d5e0813 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:58.974427 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 593/1170] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:33:58.979873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224bdbd-d45b-45e5-a63f-aea79c1f199b None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:58.980318 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224bdbd-d45b-45e5-a63f-aea79c1f199b None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:58.980447 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224bdbd-d45b-45e5-a63f-aea79c1f199b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:58.999155 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-7224bdbd-d45b-45e5-a63f-aea79c1f199b None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:33:59.000387 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-7224bdbd-d45b-45e5-a63f-aea79c1f199b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:33:59.065822 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 578/1171] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:33:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:33:59.088749 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c958c-39b6-43e8-b7a2-68b96d5e0813 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:59.130774 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:59.187348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c958c-39b6-43e8-b7a2-68b96d5e0813 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:59.219243 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a452b66-31f2-4183-8093-6ba1b9c45b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:59.220119 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a452b66-31f2-4183-8093-6ba1b9c45b83 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:59.220403 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a452b66-31f2-4183-8093-6ba1b9c45b83 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:59.220678 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a452b66-31f2-4183-8093-6ba1b9c45b83 None admin] PATH_INFO: `/v3/domains/1a3c7ff8ddf842c4a8778ad552c013f9` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:59.230747 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a452b66-31f2-4183-8093-6ba1b9c45b83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1a3c7ff8ddf842c4a8778ad552c013f9)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:59.232760 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a452b66-31f2-4183-8093-6ba1b9c45b83 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:59.234375 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 594/1172] 10.222.0.18 () {56 vars in 1183 bytes} [Mon Jul 25 08:33:59 2022] GET /identity/v3/domains/1a3c7ff8ddf842c4a8778ad552c013f9 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:33:59.240182 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7224bdbd-d45b-45e5-a63f-aea79c1f199b None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:33:59.264431 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:33:59.337633 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7224bdbd-d45b-45e5-a63f-aea79c1f199b None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:33:59.370777 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c1226-3c0f-4b4b-a204-3b327c6255dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:33:59.371431 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c1226-3c0f-4b4b-a204-3b327c6255dd None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:33:59.371750 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c1226-3c0f-4b4b-a204-3b327c6255dd None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:33:59.372624 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c1226-3c0f-4b4b-a204-3b327c6255dd None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:33:59.373525 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c1226-3c0f-4b4b-a204-3b327c6255dd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:33:59.374953 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c1226-3c0f-4b4b-a204-3b327c6255dd None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:33:59.448484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 579/1173] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jul 25 08:33:59 2022] POST /identity/v3/projects => generated 361 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:34:01.496032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41718ca9-c008-4f07-a2bd-970461b0ea04 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:01.496562 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41718ca9-c008-4f07-a2bd-970461b0ea04 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:01.496562 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41718ca9-c008-4f07-a2bd-970461b0ea04 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:01.498023 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 595/1174] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:34:01.503485 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e17f1a-c3d3-4a65-9349-19cbf00593d6 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:01.503915 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e17f1a-c3d3-4a65-9349-19cbf00593d6 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:01.504083 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e17f1a-c3d3-4a65-9349-19cbf00593d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:01.522414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-79e17f1a-c3d3-4a65-9349-19cbf00593d6 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:34:01.523584 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-79e17f1a-c3d3-4a65-9349-19cbf00593d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:34:01.589805 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 580/1175] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:34:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:34:01.615104 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41718ca9-c008-4f07-a2bd-970461b0ea04 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:34:01.712192 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:34:01.716598 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41718ca9-c008-4f07-a2bd-970461b0ea04 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:34:01.749804 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412ee3a-df43-47d1-8aef-ce9f7900c327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:34:01.750599 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412ee3a-df43-47d1-8aef-ce9f7900c327 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:01.750886 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412ee3a-df43-47d1-8aef-ce9f7900c327 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:01.751165 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412ee3a-df43-47d1-8aef-ce9f7900c327 None admin] PATH_INFO: `/v3/domains/1a3c7ff8ddf842c4a8778ad552c013f9` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:01.752367 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412ee3a-df43-47d1-8aef-ce9f7900c327 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1a3c7ff8ddf842c4a8778ad552c013f9)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:34:01.753807 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412ee3a-df43-47d1-8aef-ce9f7900c327 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:34:01.755429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 596/1176] 10.222.0.18 () {56 vars in 1183 bytes} [Mon Jul 25 08:34:01 2022] GET /identity/v3/domains/1a3c7ff8ddf842c4a8778ad552c013f9 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:34:01.761506 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e17f1a-c3d3-4a65-9349-19cbf00593d6 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:34:01.769926 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:34:01.859444 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e17f1a-c3d3-4a65-9349-19cbf00593d6 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:34:01.891841 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38252461-33a3-4fcb-88b2-5a1ff8216dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:34:01.892536 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38252461-33a3-4fcb-88b2-5a1ff8216dc9 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:01.892819 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38252461-33a3-4fcb-88b2-5a1ff8216dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:01.893095 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38252461-33a3-4fcb-88b2-5a1ff8216dc9 None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:01.893795 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38252461-33a3-4fcb-88b2-5a1ff8216dc9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:34:01.895202 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38252461-33a3-4fcb-88b2-5a1ff8216dc9 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:34:01.955985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 581/1177] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jul 25 08:34:01 2022] POST /identity/v3/users => generated 311 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:34:03.962741 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f7ac7-2954-4201-be13-ea6070d3fbe5 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:03.963241 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f7ac7-2954-4201-be13-ea6070d3fbe5 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:03.963241 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f7ac7-2954-4201-be13-ea6070d3fbe5 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:03.964602 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 597/1178] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:34:03.969708 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28234062-77cd-417f-9fcb-5ddc5b1b9d8b None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:03.970089 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28234062-77cd-417f-9fcb-5ddc5b1b9d8b None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:03.970294 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28234062-77cd-417f-9fcb-5ddc5b1b9d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:03.987909 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-28234062-77cd-417f-9fcb-5ddc5b1b9d8b None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:34:03.989123 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-28234062-77cd-417f-9fcb-5ddc5b1b9d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:34:04.043337 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:34:04.053422 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 582/1179] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:34:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:34:04.077079 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f7ac7-2954-4201-be13-ea6070d3fbe5 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:34:04.176616 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f7ac7-2954-4201-be13-ea6070d3fbe5 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:34:04.208563 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7aa2d-8ebf-4b5c-9e10-7c4acbf1e532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:34:04.209343 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7aa2d-8ebf-4b5c-9e10-7c4acbf1e532 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:04.209631 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7aa2d-8ebf-4b5c-9e10-7c4acbf1e532 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:04.209908 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7aa2d-8ebf-4b5c-9e10-7c4acbf1e532 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:04.220527 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a7aa2d-8ebf-4b5c-9e10-7c4acbf1e532 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:34:04.228011 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-46a7aa2d-8ebf-4b5c-9e10-7c4acbf1e532 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:34:04.228011 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:34:04.228011 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:34:04.228011 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:34:04.228011 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:34:04.228011 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:34:04.228011 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:34:04.228011 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:34:04.228011 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:34:04.228011 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:34:04.228011 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:34:04.228011 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:34:04.228011 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:34:04.228011 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:34:04.228011 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:34:04.228011 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:34:04.229083 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:34:04.229083 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:34:04.229083 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:34:04.229083 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:34:04.229083 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:34:04.229083 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:34:04.229083 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:34:04.229083 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:34:04.229083 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:34:04.229083 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:34:04.229083 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:34:04.229083 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:34:04.229083 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:34:04.229083 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:34:04.229083 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:34:04.229083 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:34:04.230311 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:34:04.230311 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:34:04.230311 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:34:04.230311 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:34:04.230311 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:34:04.230311 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:34:04.230311 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:34:04.230311 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:34:04.230311 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:34:04.230311 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:34:04.230311 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:34:04.230311 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:34:04.230311 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 598/1180] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:34:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:34:04.235950 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28234062-77cd-417f-9fcb-5ddc5b1b9d8b None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:34:04.332123 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28234062-77cd-417f-9fcb-5ddc5b1b9d8b None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:34:04.368402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2b479-07fe-4139-8faf-4e7dc7f133da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:34:04.369054 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2b479-07fe-4139-8faf-4e7dc7f133da None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:04.369335 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2b479-07fe-4139-8faf-4e7dc7f133da None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:04.369607 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2b479-07fe-4139-8faf-4e7dc7f133da None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:04.370345 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec2b479-07fe-4139-8faf-4e7dc7f133da None admin] RBAC: Adding query filter params (name=admin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:34:04.370648 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec2b479-07fe-4139-8faf-4e7dc7f133da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:34:04.372264 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec2b479-07fe-4139-8faf-4e7dc7f133da None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:34:04.380127 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 583/1181] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:34:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:34:04.385873 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7aa2d-8ebf-4b5c-9e10-7c4acbf1e532 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:34:04.415127 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:34:04.483793 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7aa2d-8ebf-4b5c-9e10-7c4acbf1e532 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:34:04.515656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c6ebc-a30d-4ebd-8050-b90501c08fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:34:04.516505 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c6ebc-a30d-4ebd-8050-b90501c08fba None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:04.516784 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c6ebc-a30d-4ebd-8050-b90501c08fba None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:04.517055 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c6ebc-a30d-4ebd-8050-b90501c08fba None admin] PATH_INFO: `/v3/users/464f4a22f923474fa836dbf42bd9333f` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:04.530316 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c6ebc-a30d-4ebd-8050-b90501c08fba None admin] RBAC: Authorizing `identity:get_user(user_id=464f4a22f923474fa836dbf42bd9333f)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:34:04.532029 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c6ebc-a30d-4ebd-8050-b90501c08fba None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:34:04.533634 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 599/1182] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:34:04 2022] GET /identity/v3/users/464f4a22f923474fa836dbf42bd9333f => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:34:04.539335 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2b479-07fe-4139-8faf-4e7dc7f133da None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:34:04.593527 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:34:04.710144 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2b479-07fe-4139-8faf-4e7dc7f133da None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:34:04.742185 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b6e30-202b-40aa-be16-a0a7ad5d8587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:34:04.742740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b6e30-202b-40aa-be16-a0a7ad5d8587 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:04.743022 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b6e30-202b-40aa-be16-a0a7ad5d8587 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:04.743295 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b6e30-202b-40aa-be16-a0a7ad5d8587 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:04.807658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b6e30-202b-40aa-be16-a0a7ad5d8587 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:34:04.809116 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b6e30-202b-40aa-be16-a0a7ad5d8587 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:34:04.862391 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:34:04.905662 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 584/1183] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:34:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 08:34:04.911812 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c6ebc-a30d-4ebd-8050-b90501c08fba None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:34:04.992018 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:34:05.006023 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c6ebc-a30d-4ebd-8050-b90501c08fba None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:34:05.039232 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c1d58-1a63-4e4b-9659-3972b51bfb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:34:05.040098 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c1d58-1a63-4e4b-9659-3972b51bfb31 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:05.040378 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c1d58-1a63-4e4b-9659-3972b51bfb31 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:05.040651 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c1d58-1a63-4e4b-9659-3972b51bfb31 None admin] PATH_INFO: `/v3/projects/09f56353462e4c61914820de82645add` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:05.041805 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c1d58-1a63-4e4b-9659-3972b51bfb31 None admin] RBAC: Authorizing `identity:get_project(project_id=09f56353462e4c61914820de82645add)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:34:05.043221 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c1d58-1a63-4e4b-9659-3972b51bfb31 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:34:05.045698 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 600/1184] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:34:04 2022] GET /identity/v3/projects/09f56353462e4c61914820de82645add => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:34:05.051819 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b6e30-202b-40aa-be16-a0a7ad5d8587 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:34:05.146722 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b6e30-202b-40aa-be16-a0a7ad5d8587 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:34:05.179398 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d31fa7-92d0-49a9-b60b-afa93354612c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:34:05.180056 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d31fa7-92d0-49a9-b60b-afa93354612c None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:05.180340 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d31fa7-92d0-49a9-b60b-afa93354612c None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:05.180614 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d31fa7-92d0-49a9-b60b-afa93354612c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:05.181433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d31fa7-92d0-49a9-b60b-afa93354612c None admin] RBAC: Adding query filter params (role.id=25b0f48c10474bf6b98aad8f093868ee, scope.project.id=09f56353462e4c61914820de82645add, user.id=464f4a22f923474fa836dbf42bd9333f) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:34:05.181744 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d31fa7-92d0-49a9-b60b-afa93354612c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:34:05.183143 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d31fa7-92d0-49a9-b60b-afa93354612c None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:34:05.189075 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 585/1185] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:34:05 2022] GET /identity/v3/role_assignments?user.id=464f4a22f923474fa836dbf42bd9333f&scope.project.id=09f56353462e4c61914820de82645add&role.id=25b0f48c10474bf6b98aad8f093868ee => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:34:07.142065 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771adae-f70f-4d7a-9712-f6957bbfa9ec None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:07.142576 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771adae-f70f-4d7a-9712-f6957bbfa9ec None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:07.142576 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771adae-f70f-4d7a-9712-f6957bbfa9ec None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:07.143947 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 601/1186] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:34:07.149040 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecb284-5073-4e41-84f5-d5ff430e29d7 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:07.149462 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecb284-5073-4e41-84f5-d5ff430e29d7 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:07.149607 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecb284-5073-4e41-84f5-d5ff430e29d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:07.168069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-88ecb284-5073-4e41-84f5-d5ff430e29d7 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:34:07.169819 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-88ecb284-5073-4e41-84f5-d5ff430e29d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:34:07.182414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:34:07.234658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 586/1187] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:34:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:34:07.256627 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771adae-f70f-4d7a-9712-f6957bbfa9ec None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:34:07.353749 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771adae-f70f-4d7a-9712-f6957bbfa9ec None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:34:07.385227 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d863b-bdc8-4aaa-ade7-fa35855e2d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:34:07.385991 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d863b-bdc8-4aaa-ade7-fa35855e2d0b None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:07.386271 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d863b-bdc8-4aaa-ade7-fa35855e2d0b None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:07.386542 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d863b-bdc8-4aaa-ade7-fa35855e2d0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:07.396867 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d863b-bdc8-4aaa-ade7-fa35855e2d0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:34:07.404368 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-b35d863b-bdc8-4aaa-ade7-fa35855e2d0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:34:07.404368 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:34:07.404368 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:34:07.404368 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:34:07.404368 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:34:07.404368 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:34:07.404368 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:34:07.404368 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:34:07.404368 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:34:07.404368 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:34:07.404368 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:34:07.404368 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:34:07.404368 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:34:07.404368 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:34:07.404368 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:34:07.404368 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:34:07.405523 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:34:07.405523 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:34:07.405523 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:34:07.405523 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:34:07.405523 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:34:07.405523 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:34:07.405523 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:34:07.405523 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:34:07.405523 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:34:07.405523 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:34:07.405523 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:34:07.405523 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:34:07.405523 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:34:07.405523 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:34:07.405523 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:34:07.405523 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:34:07.406700 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:34:07.406700 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:34:07.406700 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:34:07.406700 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:34:07.406700 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:34:07.406700 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:34:07.406700 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:34:07.406700 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:34:07.406700 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:34:07.406700 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:34:07.406700 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:34:07.406700 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:34:07.406700 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 602/1188] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:34:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:34:07.411785 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecb284-5073-4e41-84f5-d5ff430e29d7 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:34:07.507239 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecb284-5073-4e41-84f5-d5ff430e29d7 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:34:07.539369 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd690b-e7d5-4e87-9a13-7208fa66e8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:34:07.540051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd690b-e7d5-4e87-9a13-7208fa66e8b2 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:07.540339 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd690b-e7d5-4e87-9a13-7208fa66e8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:07.540615 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd690b-e7d5-4e87-9a13-7208fa66e8b2 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:07.541450 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd690b-e7d5-4e87-9a13-7208fa66e8b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:34:07.541760 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd690b-e7d5-4e87-9a13-7208fa66e8b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:34:07.543149 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd690b-e7d5-4e87-9a13-7208fa66e8b2 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:34:07.551541 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 587/1189] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:34:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:34:07.557138 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d863b-bdc8-4aaa-ade7-fa35855e2d0b None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:34:07.573296 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:34:07.654024 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d863b-bdc8-4aaa-ade7-fa35855e2d0b None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:34:07.685932 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0969a6e-40f9-4c3b-8db5-96be7acd23a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:34:07.686785 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0969a6e-40f9-4c3b-8db5-96be7acd23a0 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:07.687064 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0969a6e-40f9-4c3b-8db5-96be7acd23a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:07.687337 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0969a6e-40f9-4c3b-8db5-96be7acd23a0 None admin] PATH_INFO: `/v3/users/464f4a22f923474fa836dbf42bd9333f` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:07.688523 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0969a6e-40f9-4c3b-8db5-96be7acd23a0 None admin] RBAC: Authorizing `identity:get_user(user_id=464f4a22f923474fa836dbf42bd9333f)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:34:07.689941 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0969a6e-40f9-4c3b-8db5-96be7acd23a0 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:34:07.691534 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 603/1190] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:34:07 2022] GET /identity/v3/users/464f4a22f923474fa836dbf42bd9333f => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:34:07.697286 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd690b-e7d5-4e87-9a13-7208fa66e8b2 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:34:07.710949 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:34:07.796550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd690b-e7d5-4e87-9a13-7208fa66e8b2 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:34:07.830203 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b746b-4301-443d-b37e-5a0b08afd3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:34:07.831052 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b746b-4301-443d-b37e-5a0b08afd3ef None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:07.831333 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b746b-4301-443d-b37e-5a0b08afd3ef None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:07.831604 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b746b-4301-443d-b37e-5a0b08afd3ef None admin] PATH_INFO: `/v3/projects/09f56353462e4c61914820de82645add` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:07.832803 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b746b-4301-443d-b37e-5a0b08afd3ef None admin] RBAC: Authorizing `identity:get_project(project_id=09f56353462e4c61914820de82645add)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:34:07.834212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b746b-4301-443d-b37e-5a0b08afd3ef None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:34:07.835925 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 588/1191] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:34:07 2022] GET /identity/v3/projects/09f56353462e4c61914820de82645add => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:34:07.841863 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0969a6e-40f9-4c3b-8db5-96be7acd23a0 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:34:07.920314 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:34:07.937481 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0969a6e-40f9-4c3b-8db5-96be7acd23a0 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:34:07.969789 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d3f93-0e46-49e9-84c5-ac497d20926d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:34:07.970655 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d3f93-0e46-49e9-84c5-ac497d20926d None admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:07.970935 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d3f93-0e46-49e9-84c5-ac497d20926d None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:07.971205 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d3f93-0e46-49e9-84c5-ac497d20926d None admin] PATH_INFO: `/v3/projects/09f56353462e4c61914820de82645add/users/464f4a22f923474fa836dbf42bd9333f/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:07.973150 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d3f93-0e46-49e9-84c5-ac497d20926d None admin] RBAC: Authorizing `identity:create_grant(project_id=09f56353462e4c61914820de82645add, user_id=464f4a22f923474fa836dbf42bd9333f, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:34:07.974579 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d3f93-0e46-49e9-84c5-ac497d20926d None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:34:08.035865 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 604/1192] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 08:34:07 2022] PUT /identity/v3/projects/09f56353462e4c61914820de82645add/users/464f4a22f923474fa836dbf42bd9333f/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:34:09.982764 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53968dd-7c80-4b9c-a008-ac3e3ba0911b None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:09.983266 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53968dd-7c80-4b9c-a008-ac3e3ba0911b None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:09.983266 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53968dd-7c80-4b9c-a008-ac3e3ba0911b None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:09.984616 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 589/1193] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:34:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:34:09.989860 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd2139-45cb-4e83-b439-c733c90b9d6e None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:09.990282 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd2139-45cb-4e83-b439-c733c90b9d6e None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:09.990427 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd2139-45cb-4e83-b439-c733c90b9d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:10.008369 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-4bbd2139-45cb-4e83-b439-c733c90b9d6e None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:34:10.009568 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-4bbd2139-45cb-4e83-b439-c733c90b9d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:34:10.074104 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 605/1194] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:34:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:34:10.097058 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53968dd-7c80-4b9c-a008-ac3e3ba0911b None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:34:10.176040 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:34:10.197094 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53968dd-7c80-4b9c-a008-ac3e3ba0911b None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:34:10.229918 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a35c1-fbe8-47e3-beaa-38fc1a8dee92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:34:10.230698 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a35c1-fbe8-47e3-beaa-38fc1a8dee92 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:10.231640 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a35c1-fbe8-47e3-beaa-38fc1a8dee92 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:10.231906 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a35c1-fbe8-47e3-beaa-38fc1a8dee92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:10.241823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a35c1-fbe8-47e3-beaa-38fc1a8dee92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:34:10.249508 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-eb5a35c1-fbe8-47e3-beaa-38fc1a8dee92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:34:10.249508 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:34:10.249508 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:34:10.249508 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:34:10.249508 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:34:10.249508 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:34:10.249508 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:34:10.249508 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:34:10.249508 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:34:10.249508 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:34:10.249508 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:34:10.249508 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:34:10.249508 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:34:10.249508 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:34:10.249508 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:34:10.249508 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:34:10.250594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:34:10.250594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:34:10.250594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:34:10.250594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:34:10.250594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:34:10.250594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:34:10.250594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:34:10.250594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:34:10.250594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:34:10.250594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:34:10.250594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:34:10.250594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:34:10.250594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:34:10.250594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:34:10.250594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:34:10.250594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:34:10.256417 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:34:10.256417 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:34:10.256417 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:34:10.256417 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:34:10.256417 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:34:10.256417 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:34:10.256417 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:34:10.256417 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:34:10.256417 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:34:10.256417 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:34:10.256417 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:34:10.256417 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:34:10.256417 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 590/1195] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:34:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:34:10.257272 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd2139-45cb-4e83-b439-c733c90b9d6e None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:34:10.323628 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:34:10.352462 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd2139-45cb-4e83-b439-c733c90b9d6e None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:34:10.384557 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952fcf5-f714-43fc-a5b0-8f61dffe7f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:34:10.385207 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952fcf5-f714-43fc-a5b0-8f61dffe7f7a None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:10.385490 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952fcf5-f714-43fc-a5b0-8f61dffe7f7a None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:10.385771 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952fcf5-f714-43fc-a5b0-8f61dffe7f7a None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:10.386512 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952fcf5-f714-43fc-a5b0-8f61dffe7f7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:34:10.386817 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952fcf5-f714-43fc-a5b0-8f61dffe7f7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:34:10.388850 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952fcf5-f714-43fc-a5b0-8f61dffe7f7a None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:34:10.396680 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 606/1196] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:34:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:34:10.402533 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a35c1-fbe8-47e3-beaa-38fc1a8dee92 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:34:10.500435 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a35c1-fbe8-47e3-beaa-38fc1a8dee92 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:34:10.533841 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992d6f0-b9b8-4130-a736-a4b3c422545b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:34:10.534697 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992d6f0-b9b8-4130-a736-a4b3c422545b None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:10.534985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992d6f0-b9b8-4130-a736-a4b3c422545b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:10.535267 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992d6f0-b9b8-4130-a736-a4b3c422545b None admin] PATH_INFO: `/v3/users/464f4a22f923474fa836dbf42bd9333f` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:10.536479 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992d6f0-b9b8-4130-a736-a4b3c422545b None admin] RBAC: Authorizing `identity:get_user(user_id=464f4a22f923474fa836dbf42bd9333f)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:34:10.537902 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992d6f0-b9b8-4130-a736-a4b3c422545b None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:34:10.539516 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 591/1197] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 08:34:10 2022] GET /identity/v3/users/464f4a22f923474fa836dbf42bd9333f => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:34:10.545434 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952fcf5-f714-43fc-a5b0-8f61dffe7f7a None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:34:10.644052 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952fcf5-f714-43fc-a5b0-8f61dffe7f7a None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:34:10.681052 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3152c0-b310-451e-9bfa-c19de9857774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:34:10.681690 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3152c0-b310-451e-9bfa-c19de9857774 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:10.681972 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3152c0-b310-451e-9bfa-c19de9857774 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:10.682296 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3152c0-b310-451e-9bfa-c19de9857774 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:10.685838 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:34:10.749807 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3152c0-b310-451e-9bfa-c19de9857774 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:34:10.751293 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3152c0-b310-451e-9bfa-c19de9857774 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:34:10.850571 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 607/1198] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:34:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 08:34:10.857089 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992d6f0-b9b8-4130-a736-a4b3c422545b None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:34:10.866636 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:34:10.956163 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992d6f0-b9b8-4130-a736-a4b3c422545b None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:34:10.989595 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbffda0-5e48-4d55-a4db-3301f486f920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:34:10.990441 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbffda0-5e48-4d55-a4db-3301f486f920 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:10.990724 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbffda0-5e48-4d55-a4db-3301f486f920 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:10.990998 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbffda0-5e48-4d55-a4db-3301f486f920 None admin] PATH_INFO: `/v3/projects/09f56353462e4c61914820de82645add` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:10.992174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbffda0-5e48-4d55-a4db-3301f486f920 None admin] RBAC: Authorizing `identity:get_project(project_id=09f56353462e4c61914820de82645add)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:34:10.993585 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbffda0-5e48-4d55-a4db-3301f486f920 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:34:10.995247 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 592/1199] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 08:34:10 2022] GET /identity/v3/projects/09f56353462e4c61914820de82645add => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:34:11.001423 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3152c0-b310-451e-9bfa-c19de9857774 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:34:11.033808 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:34:11.098014 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3152c0-b310-451e-9bfa-c19de9857774 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:34:11.129917 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66cdf55-fa9c-4f79-8568-001af7b9cca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:34:11.130554 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66cdf55-fa9c-4f79-8568-001af7b9cca5 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:34:11.130838 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66cdf55-fa9c-4f79-8568-001af7b9cca5 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:34:11.131112 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66cdf55-fa9c-4f79-8568-001af7b9cca5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:34:11.131982 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66cdf55-fa9c-4f79-8568-001af7b9cca5 None admin] RBAC: Adding query filter params (role.id=25b0f48c10474bf6b98aad8f093868ee, scope.project.id=09f56353462e4c61914820de82645add, user.id=464f4a22f923474fa836dbf42bd9333f) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:34:11.132296 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66cdf55-fa9c-4f79-8568-001af7b9cca5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:34:11.133720 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66cdf55-fa9c-4f79-8568-001af7b9cca5 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:34:11.139916 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 608/1200] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:34:11 2022] GET /identity/v3/role_assignments?user.id=464f4a22f923474fa836dbf42bd9333f&scope.project.id=09f56353462e4c61914820de82645add&role.id=25b0f48c10474bf6b98aad8f093868ee => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:34:20.985634 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=63 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:34:21.136772 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=51 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:21.219415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4446c98-1244-48ef-9f16-f625d70ab186 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:21.220067 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4446c98-1244-48ef-9f16-f625d70ab186 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:21.220067 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4446c98-1244-48ef-9f16-f625d70ab186 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:21.221409 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 593/1201] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:35:21.227509 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d54bb7-3c7a-4612-99f6-045915eccca3 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:21.229944 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d54bb7-3c7a-4612-99f6-045915eccca3 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:21.229944 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d54bb7-3c7a-4612-99f6-045915eccca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:21.247640 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-a2d54bb7-3c7a-4612-99f6-045915eccca3 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:35:21.248915 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-a2d54bb7-3c7a-4612-99f6-045915eccca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:21.316058 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 609/1202] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:35:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:35:21.340477 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4446c98-1244-48ef-9f16-f625d70ab186 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:21.443544 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4446c98-1244-48ef-9f16-f625d70ab186 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:21.479923 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b7458-bbb0-447c-bbec-e20ef78d0320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:21.480650 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b7458-bbb0-447c-bbec-e20ef78d0320 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:21.480931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b7458-bbb0-447c-bbec-e20ef78d0320 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:21.481206 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b7458-bbb0-447c-bbec-e20ef78d0320 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:21.492607 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b7458-bbb0-447c-bbec-e20ef78d0320 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:21.494054 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b7458-bbb0-447c-bbec-e20ef78d0320 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:21.510687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-f38b7458-bbb0-447c-bbec-e20ef78d0320 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:35:21.510687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:21.510687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:35:21.510687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:35:21.510687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:35:21.510687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:35:21.510687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:35:21.510687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:35:21.510687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:35:21.510687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:35:21.510687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:35:21.510687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:35:21.510687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:35:21.510687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:35:21.510687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:35:21.514691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:35:21.514691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:35:21.514691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:35:21.514691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:35:21.514691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:35:21.514691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:35:21.514691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:35:21.514691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:35:21.514691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:35:21.514691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:35:21.514691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:35:21.514691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:35:21.514691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:35:21.514691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:35:21.514691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:35:21.514691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:35:21.514691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:35:21.515937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:35:21.515937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:35:21.515937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:35:21.515937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:35:21.515937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 594/1203] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:35:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:35:21.518310 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d54bb7-3c7a-4612-99f6-045915eccca3 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:21.616313 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d54bb7-3c7a-4612-99f6-045915eccca3 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:21.644877 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:21.650844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da2938-84e9-403a-8e18-ccd2624b8ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:21.651519 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da2938-84e9-403a-8e18-ccd2624b8ec9 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:21.651849 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da2938-84e9-403a-8e18-ccd2624b8ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:21.652144 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da2938-84e9-403a-8e18-ccd2624b8ec9 None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:21.652862 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da2938-84e9-403a-8e18-ccd2624b8ec9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:21.653191 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da2938-84e9-403a-8e18-ccd2624b8ec9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:21.655151 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da2938-84e9-403a-8e18-ccd2624b8ec9 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:21.668608 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 610/1204] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:21.674839 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b7458-bbb0-447c-bbec-e20ef78d0320 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:21.727819 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:21.775849 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b7458-bbb0-447c-bbec-e20ef78d0320 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:21.808969 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88bc913-0ce9-4092-be94-b39406c73246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:21.809629 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88bc913-0ce9-4092-be94-b39406c73246 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:21.809916 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88bc913-0ce9-4092-be94-b39406c73246 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:21.810195 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88bc913-0ce9-4092-be94-b39406c73246 None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:21.810894 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88bc913-0ce9-4092-be94-b39406c73246 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:21.812477 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88bc913-0ce9-4092-be94-b39406c73246 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:21.954711 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 595/1205] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jul 25 08:35:21 2022] POST /identity/v3/users => generated 251 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:35:23.984767 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fcbc8-09b5-4376-9be5-d1b9fd474753 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:23.985407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fcbc8-09b5-4376-9be5-d1b9fd474753 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:23.985407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fcbc8-09b5-4376-9be5-d1b9fd474753 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:23.986630 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 611/1206] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:35:23.991743 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb087655-3c72-4407-b21d-11ef023034ee None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:23.992151 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb087655-3c72-4407-b21d-11ef023034ee None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:23.992302 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb087655-3c72-4407-b21d-11ef023034ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:24.010668 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-bb087655-3c72-4407-b21d-11ef023034ee None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:35:24.013003 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-bb087655-3c72-4407-b21d-11ef023034ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:24.077788 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 596/1207] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:35:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:35:24.101485 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fcbc8-09b5-4376-9be5-d1b9fd474753 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:24.201967 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fcbc8-09b5-4376-9be5-d1b9fd474753 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:24.234949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f57f6-7bc1-4fb8-baae-223b32bf8ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:24.235702 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f57f6-7bc1-4fb8-baae-223b32bf8ca5 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:24.235988 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f57f6-7bc1-4fb8-baae-223b32bf8ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:24.236263 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f57f6-7bc1-4fb8-baae-223b32bf8ca5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:24.246421 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f57f6-7bc1-4fb8-baae-223b32bf8ca5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:35:24.254126 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-909f57f6-7bc1-4fb8-baae-223b32bf8ca5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:35:24.254126 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:24.254126 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:35:24.254126 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:35:24.254126 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:35:24.254126 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:35:24.254126 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:35:24.254126 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:35:24.254126 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:35:24.254126 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:35:24.254126 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:35:24.254126 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:35:24.254126 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:35:24.254126 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:35:24.254126 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:35:24.254126 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:35:24.255261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:35:24.255261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:35:24.255261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:35:24.255261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:35:24.255261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:35:24.255261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:35:24.255261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:35:24.255261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:35:24.255261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:35:24.255261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:35:24.255261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:35:24.255261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:35:24.255261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:35:24.255261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:35:24.255261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:35:24.255261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:35:24.256347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:35:24.256347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:35:24.256347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:35:24.256347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:35:24.256347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:35:24.256347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:35:24.256347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:35:24.256347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:35:24.256347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:35:24.256347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:35:24.256347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:35:24.256347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:35:24.256347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 612/1208] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 08:35:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:35:24.261555 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb087655-3c72-4407-b21d-11ef023034ee None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:24.301559 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:24.360780 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb087655-3c72-4407-b21d-11ef023034ee None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:24.394922 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5bc05-de28-4581-9914-1826a486f3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:24.395649 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5bc05-de28-4581-9914-1826a486f3a3 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:24.395932 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5bc05-de28-4581-9914-1826a486f3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:24.396207 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5bc05-de28-4581-9914-1826a486f3a3 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:24.396959 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5bc05-de28-4581-9914-1826a486f3a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:24.397264 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5bc05-de28-4581-9914-1826a486f3a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:24.398617 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5bc05-de28-4581-9914-1826a486f3a3 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:24.406747 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 597/1209] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 08:35:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:24.412531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f57f6-7bc1-4fb8-baae-223b32bf8ca5 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:24.461641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:24.509361 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f57f6-7bc1-4fb8-baae-223b32bf8ca5 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:24.544463 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a7e17-8191-41e3-843e-9cf839ffdf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:24.545282 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a7e17-8191-41e3-843e-9cf839ffdf75 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:24.545565 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a7e17-8191-41e3-843e-9cf839ffdf75 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:24.545842 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a7e17-8191-41e3-843e-9cf839ffdf75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:24.556534 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a7e17-8191-41e3-843e-9cf839ffdf75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:24.557986 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a7e17-8191-41e3-843e-9cf839ffdf75 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:24.575548 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-1f2a7e17-8191-41e3-843e-9cf839ffdf75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:35:24.575548 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:24.575548 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:35:24.575548 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:35:24.575548 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:35:24.575548 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:35:24.575548 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:35:24.575548 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:35:24.575548 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:35:24.575548 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:35:24.575548 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:35:24.575548 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:35:24.575548 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:35:24.575548 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:35:24.575548 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:35:24.576640 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:35:24.576640 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:35:24.576640 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:35:24.576640 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:35:24.576640 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:35:24.576640 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:35:24.576640 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:35:24.576640 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:35:24.576640 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:35:24.576640 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:35:24.576640 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:35:24.576640 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:35:24.576640 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:35:24.576640 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:35:24.576640 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:35:24.576640 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:35:24.576640 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:35:24.577759 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:35:24.577759 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:35:24.577759 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:35:24.577759 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:35:24.577759 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 613/1210] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:35:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:35:24.582681 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5bc05-de28-4581-9914-1826a486f3a3 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:24.680889 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:24.683805 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5bc05-de28-4581-9914-1826a486f3a3 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:24.717846 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2724c-b0fb-409b-a076-40d4b6a2c5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:24.718538 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2724c-b0fb-409b-a076-40d4b6a2c5ca None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:24.718799 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2724c-b0fb-409b-a076-40d4b6a2c5ca None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:24.719075 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2724c-b0fb-409b-a076-40d4b6a2c5ca None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:24.719854 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2724c-b0fb-409b-a076-40d4b6a2c5ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:24.720163 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2724c-b0fb-409b-a076-40d4b6a2c5ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:24.721512 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2724c-b0fb-409b-a076-40d4b6a2c5ca None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:24.733192 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 598/1211] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:24.739179 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a7e17-8191-41e3-843e-9cf839ffdf75 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:24.840650 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a7e17-8191-41e3-843e-9cf839ffdf75 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:24.842072 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:24.873795 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafb7a8-181b-4565-9d61-3137211ec91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:24.874592 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafb7a8-181b-4565-9d61-3137211ec91a None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:24.874880 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafb7a8-181b-4565-9d61-3137211ec91a None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:24.875161 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafb7a8-181b-4565-9d61-3137211ec91a None admin] PATH_INFO: `/v3/users/placement` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:24.884447 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cafb7a8-181b-4565-9d61-3137211ec91a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:24.885882 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cafb7a8-181b-4565-9d61-3137211ec91a None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:24.900383 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-5cafb7a8-181b-4565-9d61-3137211ec91a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 08:35:24.900383 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:24.900383 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:35:24.900383 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:35:24.900383 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:35:24.900383 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:35:24.900383 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:35:24.900383 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:35:24.900383 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:35:24.900383 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:35:24.900383 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:35:24.900383 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:35:24.900383 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:35:24.900383 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:35:24.900383 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:35:24.900383 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:35:24.901612 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:35:24.901612 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:35:24.901612 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:35:24.901612 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:35:24.901612 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:35:24.901612 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:35:24.901612 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:35:24.901612 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:35:24.901612 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:35:24.901612 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:35:24.901612 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:35:24.901612 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:35:24.901612 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:35:24.901612 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:35:24.901612 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:35:24.901612 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:35:24.901612 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:35:24.901612 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:35:24.902677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:35:24.902677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:35:24.902677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:35:24.902677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:35:24.902677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:35:24.902677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:35:24.902677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:35:24.902677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:35:24.902677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 08:35:24.902677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:35:24.902677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 614/1212] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:35:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:35:24.907859 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2724c-b0fb-409b-a076-40d4b6a2c5ca None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:25.011912 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2724c-b0fb-409b-a076-40d4b6a2c5ca None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:25.046443 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bebdb-d239-4251-9aa3-beeee67d5cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:25.047107 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bebdb-d239-4251-9aa3-beeee67d5cb0 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:25.047397 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bebdb-d239-4251-9aa3-beeee67d5cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:25.047851 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bebdb-d239-4251-9aa3-beeee67d5cb0 None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:25.048690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32bebdb-d239-4251-9aa3-beeee67d5cb0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:25.049004 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32bebdb-d239-4251-9aa3-beeee67d5cb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:25.050491 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32bebdb-d239-4251-9aa3-beeee67d5cb0 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:25.067263 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 599/1213] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Jul 25 08:35:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:25.073105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafb7a8-181b-4565-9d61-3137211ec91a None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:25.171090 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafb7a8-181b-4565-9d61-3137211ec91a None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:25.205641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9320d1-6d24-4fbc-adac-b239c9045113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:25.209527 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9320d1-6d24-4fbc-adac-b239c9045113 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:25.209527 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9320d1-6d24-4fbc-adac-b239c9045113 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:25.209527 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9320d1-6d24-4fbc-adac-b239c9045113 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:25.236065 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:25.273453 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9320d1-6d24-4fbc-adac-b239c9045113 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:25.274908 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9320d1-6d24-4fbc-adac-b239c9045113 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:25.378480 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 615/1214] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:35:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 08:35:25.384577 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bebdb-d239-4251-9aa3-beeee67d5cb0 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:25.404176 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:25.484244 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bebdb-d239-4251-9aa3-beeee67d5cb0 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:25.518682 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539901c-971a-4040-b399-ca28e9303771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:25.519467 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539901c-971a-4040-b399-ca28e9303771 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:25.519781 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539901c-971a-4040-b399-ca28e9303771 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:25.520056 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539901c-971a-4040-b399-ca28e9303771 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:25.530054 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0539901c-971a-4040-b399-ca28e9303771 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:25.531522 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0539901c-971a-4040-b399-ca28e9303771 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:25.548935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-0539901c-971a-4040-b399-ca28e9303771 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:35:25.548935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:25.548935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:35:25.548935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:35:25.548935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:35:25.548935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:35:25.548935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:35:25.548935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:35:25.548935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:35:25.548935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:35:25.548935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:35:25.548935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:35:25.548935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:35:25.548935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:35:25.548935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:35:25.550010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:35:25.550010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:35:25.550010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:35:25.550010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:35:25.550010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:35:25.550010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:35:25.550010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:35:25.550010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:35:25.550010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:35:25.550010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:35:25.550010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:35:25.550010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:35:25.550010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:35:25.550010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:35:25.550010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:35:25.550010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:35:25.550010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:35:25.551123 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:35:25.551123 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:35:25.551123 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:35:25.551123 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:35:25.551123 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 600/1215] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:35:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:35:25.556019 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9320d1-6d24-4fbc-adac-b239c9045113 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:25.617212 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:25.654815 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9320d1-6d24-4fbc-adac-b239c9045113 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:25.689617 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ebc7e-bde6-4207-991b-a7da105a5770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:25.690382 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ebc7e-bde6-4207-991b-a7da105a5770 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:25.690922 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ebc7e-bde6-4207-991b-a7da105a5770 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:25.691379 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ebc7e-bde6-4207-991b-a7da105a5770 None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:25.692610 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ebc7e-bde6-4207-991b-a7da105a5770 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:25.692919 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ebc7e-bde6-4207-991b-a7da105a5770 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:25.694328 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ebc7e-bde6-4207-991b-a7da105a5770 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:25.706501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 616/1216] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:25.712332 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539901c-971a-4040-b399-ca28e9303771 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:25.781080 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:25.812809 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539901c-971a-4040-b399-ca28e9303771 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:25.848250 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a9d52-3bf1-427c-9576-f552668ecd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:25.849025 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a9d52-3bf1-427c-9576-f552668ecd8c None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:25.849302 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a9d52-3bf1-427c-9576-f552668ecd8c None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:25.849573 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a9d52-3bf1-427c-9576-f552668ecd8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:25.856067 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a9d52-3bf1-427c-9576-f552668ecd8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:25.857487 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a9d52-3bf1-427c-9576-f552668ecd8c None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:25.871421 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-274a9d52-3bf1-427c-9576-f552668ecd8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:35:25.871421 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:25.871421 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:35:25.871421 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:35:25.871421 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:35:25.871421 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:35:25.871421 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:35:25.871421 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:35:25.871421 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:35:25.871421 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:35:25.871421 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:35:25.871421 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:35:25.871421 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:35:25.871421 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:35:25.871421 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:35:25.872545 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:35:25.872545 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:35:25.872545 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:35:25.872545 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:35:25.872545 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:35:25.872545 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:35:25.872545 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:35:25.872545 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:35:25.872545 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:35:25.872545 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:35:25.872545 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:35:25.872545 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:35:25.872545 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:35:25.872545 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:35:25.872545 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:35:25.872545 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:35:25.872545 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:35:25.873487 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:35:25.873487 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:35:25.873487 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:35:25.873487 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:35:25.873487 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:35:25.873487 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:35:25.873487 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:35:25.873487 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:35:25.873487 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 601/1217] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:35:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:35:25.878950 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ebc7e-bde6-4207-991b-a7da105a5770 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:25.977222 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ebc7e-bde6-4207-991b-a7da105a5770 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:25.998522 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:26.010211 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7468b-6e27-4cd3-aac3-781243f55597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:26.010867 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7468b-6e27-4cd3-aac3-781243f55597 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:26.011156 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7468b-6e27-4cd3-aac3-781243f55597 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:26.011434 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7468b-6e27-4cd3-aac3-781243f55597 None admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:26.012257 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7468b-6e27-4cd3-aac3-781243f55597 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:26.012567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7468b-6e27-4cd3-aac3-781243f55597 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:26.014006 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7468b-6e27-4cd3-aac3-781243f55597 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:26.026146 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 617/1218] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:35:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:26.039772 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a9d52-3bf1-427c-9576-f552668ecd8c None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:26.130981 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a9d52-3bf1-427c-9576-f552668ecd8c None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:26.159563 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:26.165344 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333240b5-a4c5-4b83-a916-ebf193a1493d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:26.166001 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333240b5-a4c5-4b83-a916-ebf193a1493d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:26.166302 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333240b5-a4c5-4b83-a916-ebf193a1493d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:26.166566 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333240b5-a4c5-4b83-a916-ebf193a1493d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:26.167413 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333240b5-a4c5-4b83-a916-ebf193a1493d None admin] RBAC: Adding query filter params (role.id=a0a4f5f9b3264740a55056fed8fd7a33, scope.project.id=be349194440449209f19f6b535ffd4f6, user.id=dfb4be75496444dd897b880c2ac3e67e) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:26.167766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333240b5-a4c5-4b83-a916-ebf193a1493d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:26.169206 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333240b5-a4c5-4b83-a916-ebf193a1493d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:26.175276 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 602/1219] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:35:26 2022] GET /identity/v3/role_assignments?user.id=dfb4be75496444dd897b880c2ac3e67e&scope.project.id=be349194440449209f19f6b535ffd4f6&role.id=a0a4f5f9b3264740a55056fed8fd7a33 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:28.167507 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da82d61-e677-40f4-b27d-f7084737e51d None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:28.168099 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da82d61-e677-40f4-b27d-f7084737e51d None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:28.168099 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da82d61-e677-40f4-b27d-f7084737e51d None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:28.169430 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 618/1220] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:35:28.174805 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9137f8-fad8-432a-817b-ddc8ea463976 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:28.175212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9137f8-fad8-432a-817b-ddc8ea463976 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:28.175388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9137f8-fad8-432a-817b-ddc8ea463976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:28.194432 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-2c9137f8-fad8-432a-817b-ddc8ea463976 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:35:28.195602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-2c9137f8-fad8-432a-817b-ddc8ea463976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:28.261187 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 603/1221] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:35:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:35:28.285030 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da82d61-e677-40f4-b27d-f7084737e51d None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:28.387189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da82d61-e677-40f4-b27d-f7084737e51d None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:28.424868 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e0748-d1f1-4720-a9f2-b8b0a2faf320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:28.425588 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e0748-d1f1-4720-a9f2-b8b0a2faf320 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:28.425869 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e0748-d1f1-4720-a9f2-b8b0a2faf320 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:28.426142 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e0748-d1f1-4720-a9f2-b8b0a2faf320 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:28.436557 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e0748-d1f1-4720-a9f2-b8b0a2faf320 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:35:28.445121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-3c8e0748-d1f1-4720-a9f2-b8b0a2faf320 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:35:28.445121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:28.445121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:35:28.445121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:35:28.445121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:35:28.445121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:35:28.445121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:35:28.445121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:35:28.445121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:35:28.445121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:35:28.445121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:35:28.445121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:35:28.445121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:35:28.445121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:35:28.445121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:35:28.445121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:35:28.446266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:35:28.446266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:35:28.446266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:35:28.446266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:35:28.446266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:35:28.446266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:35:28.446266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:35:28.446266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:35:28.446266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:35:28.446266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:35:28.446266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:35:28.446266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:35:28.446266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:35:28.446266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:35:28.446266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:35:28.446266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:35:28.447442 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:35:28.447442 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:35:28.447442 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:35:28.447442 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:35:28.447442 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:35:28.447442 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:35:28.447442 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:35:28.447442 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:35:28.447442 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:35:28.447442 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:35:28.447442 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:35:28.447442 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:35:28.447442 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 619/1222] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 08:35:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:35:28.452594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9137f8-fad8-432a-817b-ddc8ea463976 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:28.549974 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9137f8-fad8-432a-817b-ddc8ea463976 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:28.573331 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:28.584909 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c3caa-0b48-46bc-b519-af0cb7bb3e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:28.585572 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c3caa-0b48-46bc-b519-af0cb7bb3e6a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:28.585902 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c3caa-0b48-46bc-b519-af0cb7bb3e6a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:28.586182 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c3caa-0b48-46bc-b519-af0cb7bb3e6a None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:28.586930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c3caa-0b48-46bc-b519-af0cb7bb3e6a None admin] RBAC: Adding query filter params (name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:28.587237 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c3caa-0b48-46bc-b519-af0cb7bb3e6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:28.588678 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c3caa-0b48-46bc-b519-af0cb7bb3e6a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:28.596429 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 604/1223] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 08:35:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:28.602217 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e0748-d1f1-4720-a9f2-b8b0a2faf320 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:28.644671 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:28.698972 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e0748-d1f1-4720-a9f2-b8b0a2faf320 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:28.734311 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698865bc-b59d-432b-9f0b-959645c795cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:28.735139 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698865bc-b59d-432b-9f0b-959645c795cc None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:28.735388 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698865bc-b59d-432b-9f0b-959645c795cc None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:28.735783 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698865bc-b59d-432b-9f0b-959645c795cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:28.745951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698865bc-b59d-432b-9f0b-959645c795cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:28.747376 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698865bc-b59d-432b-9f0b-959645c795cc None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:28.763781 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-698865bc-b59d-432b-9f0b-959645c795cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:35:28.763781 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:28.763781 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:35:28.763781 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:35:28.763781 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:35:28.763781 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:35:28.763781 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:35:28.763781 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:35:28.763781 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:35:28.763781 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:35:28.763781 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:35:28.763781 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:35:28.763781 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:35:28.763781 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:35:28.763781 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:35:28.764844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:35:28.764844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:35:28.764844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:35:28.764844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:35:28.764844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:35:28.764844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:35:28.764844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:35:28.764844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:35:28.764844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:35:28.764844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:35:28.764844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:35:28.764844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:35:28.764844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:35:28.764844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:35:28.764844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:35:28.764844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:35:28.764844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:35:28.765948 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:35:28.765948 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:35:28.765948 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:35:28.765948 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:35:28.765948 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 620/1224] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:35:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:35:28.771452 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c3caa-0b48-46bc-b519-af0cb7bb3e6a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:28.870021 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c3caa-0b48-46bc-b519-af0cb7bb3e6a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:28.903523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d293ad-a131-41e0-a338-47ac08454384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:28.904197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d293ad-a131-41e0-a338-47ac08454384 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:28.904784 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d293ad-a131-41e0-a338-47ac08454384 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:28.905012 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d293ad-a131-41e0-a338-47ac08454384 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:28.905724 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d293ad-a131-41e0-a338-47ac08454384 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:28.906029 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d293ad-a131-41e0-a338-47ac08454384 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:28.908019 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d293ad-a131-41e0-a338-47ac08454384 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:28.919405 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 605/1225] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:28.925175 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698865bc-b59d-432b-9f0b-959645c795cc None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:29.021377 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:29.027820 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698865bc-b59d-432b-9f0b-959645c795cc None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:29.060254 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5a4d3-73f6-48c0-a1bb-a8914e8f13cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:29.061041 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5a4d3-73f6-48c0-a1bb-a8914e8f13cc None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:29.061322 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5a4d3-73f6-48c0-a1bb-a8914e8f13cc None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:29.061602 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5a4d3-73f6-48c0-a1bb-a8914e8f13cc None admin] PATH_INFO: `/v3/users/placement` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:29.069528 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5a4d3-73f6-48c0-a1bb-a8914e8f13cc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:29.070951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5a4d3-73f6-48c0-a1bb-a8914e8f13cc None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:29.085277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-62c5a4d3-73f6-48c0-a1bb-a8914e8f13cc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 08:35:29.085277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:29.085277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:35:29.085277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:35:29.085277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:35:29.085277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:35:29.085277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:35:29.085277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:35:29.085277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:35:29.085277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:35:29.085277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:35:29.085277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:35:29.085277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:35:29.085277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:35:29.085277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:35:29.085277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:35:29.089906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:35:29.089906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:35:29.089906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:35:29.089906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:35:29.089906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:35:29.089906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:35:29.089906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:35:29.089906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:35:29.089906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:35:29.089906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:35:29.089906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:35:29.089906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:35:29.089906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:35:29.089906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:35:29.089906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:35:29.089906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:35:29.089906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:35:29.089906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:35:29.091111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:35:29.091111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:35:29.091111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:35:29.091111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:35:29.091111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:35:29.091111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:35:29.091111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:35:29.091111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:35:29.091111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 08:35:29.091111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:35:29.091111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 621/1226] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:35:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:35:29.093621 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d293ad-a131-41e0-a338-47ac08454384 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:29.140037 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:29.192511 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d293ad-a131-41e0-a338-47ac08454384 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:29.226215 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17895fcf-6ddb-45eb-a094-83a5a0625740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:29.226875 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17895fcf-6ddb-45eb-a094-83a5a0625740 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:29.227164 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17895fcf-6ddb-45eb-a094-83a5a0625740 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:29.227448 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17895fcf-6ddb-45eb-a094-83a5a0625740 None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:29.228317 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17895fcf-6ddb-45eb-a094-83a5a0625740 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:29.228631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17895fcf-6ddb-45eb-a094-83a5a0625740 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:29.230049 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17895fcf-6ddb-45eb-a094-83a5a0625740 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:29.247310 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 606/1227] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Jul 25 08:35:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:29.253227 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5a4d3-73f6-48c0-a1bb-a8914e8f13cc None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:29.351505 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5a4d3-73f6-48c0-a1bb-a8914e8f13cc None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:29.385548 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021eddc-e653-49dd-8419-787bf7abad16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:29.386335 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021eddc-e653-49dd-8419-787bf7abad16 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:29.386622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021eddc-e653-49dd-8419-787bf7abad16 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:29.386898 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021eddc-e653-49dd-8419-787bf7abad16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:29.398694 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021eddc-e653-49dd-8419-787bf7abad16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:29.401020 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021eddc-e653-49dd-8419-787bf7abad16 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:29.417641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-7021eddc-e653-49dd-8419-787bf7abad16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:35:29.417641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:29.417641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:35:29.417641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:35:29.417641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:35:29.417641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:35:29.417641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:35:29.417641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:35:29.417641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:35:29.417641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:35:29.417641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:35:29.417641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:35:29.417641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:35:29.417641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:35:29.417641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:35:29.418749 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:35:29.418749 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:35:29.418749 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:35:29.418749 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:35:29.418749 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:35:29.418749 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:35:29.418749 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:35:29.418749 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:35:29.418749 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:35:29.418749 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:35:29.418749 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:35:29.418749 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:35:29.418749 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:35:29.418749 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:35:29.418749 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:35:29.418749 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:35:29.418749 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:35:29.419890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:35:29.419890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:35:29.419890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:35:29.419890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:35:29.419890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 622/1228] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:35:29.424694 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17895fcf-6ddb-45eb-a094-83a5a0625740 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:29.521980 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17895fcf-6ddb-45eb-a094-83a5a0625740 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:29.524364 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:29.555588 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0f663-684a-4c59-bf66-c0280b0f042a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:29.556280 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0f663-684a-4c59-bf66-c0280b0f042a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:29.556564 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0f663-684a-4c59-bf66-c0280b0f042a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:29.556842 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0f663-684a-4c59-bf66-c0280b0f042a None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:29.557567 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0f663-684a-4c59-bf66-c0280b0f042a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:29.557874 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0f663-684a-4c59-bf66-c0280b0f042a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:29.559229 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0f663-684a-4c59-bf66-c0280b0f042a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:29.574255 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 607/1229] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:29.577686 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021eddc-e653-49dd-8419-787bf7abad16 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:29.586447 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:29.676671 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021eddc-e653-49dd-8419-787bf7abad16 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:29.712965 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae89413-507f-4aa3-af85-3925640daea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:29.713754 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae89413-507f-4aa3-af85-3925640daea5 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:29.714033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae89413-507f-4aa3-af85-3925640daea5 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:29.714307 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae89413-507f-4aa3-af85-3925640daea5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:29.721381 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae89413-507f-4aa3-af85-3925640daea5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:29.722812 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae89413-507f-4aa3-af85-3925640daea5 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:29.738233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-dae89413-507f-4aa3-af85-3925640daea5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:35:29.738233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:29.738233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:35:29.738233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:35:29.738233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:35:29.738233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:35:29.738233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:35:29.738233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:35:29.738233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:35:29.738233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:35:29.738233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:35:29.738233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:35:29.738233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:35:29.738233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:35:29.738233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:35:29.739293 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:35:29.739293 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:35:29.739293 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:35:29.739293 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:35:29.739293 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:35:29.739293 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:35:29.739293 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:35:29.739293 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:35:29.739293 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:35:29.739293 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:35:29.739293 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:35:29.739293 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:35:29.739293 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:35:29.739293 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:35:29.739293 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:35:29.739293 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:35:29.739293 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:35:29.744507 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:35:29.744507 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:35:29.744507 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:35:29.744507 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:35:29.744507 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:35:29.744507 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:35:29.744507 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:35:29.744507 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:35:29.744507 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 623/1230] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:35:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:35:29.745390 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0f663-684a-4c59-bf66-c0280b0f042a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:29.846798 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0f663-684a-4c59-bf66-c0280b0f042a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:29.880105 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a93b5-4ee0-43f1-bd60-a659c6cfdcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:29.880781 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a93b5-4ee0-43f1-bd60-a659c6cfdcff None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:29.881064 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a93b5-4ee0-43f1-bd60-a659c6cfdcff None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:29.881337 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a93b5-4ee0-43f1-bd60-a659c6cfdcff None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:29.882112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a93b5-4ee0-43f1-bd60-a659c6cfdcff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:29.882416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a93b5-4ee0-43f1-bd60-a659c6cfdcff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:29.883894 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a93b5-4ee0-43f1-bd60-a659c6cfdcff None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:29.896442 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 608/1231] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:35:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:29.902571 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae89413-507f-4aa3-af85-3925640daea5 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:29.968249 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:30.001648 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae89413-507f-4aa3-af85-3925640daea5 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:30.035120 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e23623-c805-4d49-b11b-b9b7a526f48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:30.036023 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e23623-c805-4d49-b11b-b9b7a526f48a None admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:30.036301 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e23623-c805-4d49-b11b-b9b7a526f48a None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:30.036572 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e23623-c805-4d49-b11b-b9b7a526f48a None admin] PATH_INFO: `/v3/projects/be349194440449209f19f6b535ffd4f6/users/dfb4be75496444dd897b880c2ac3e67e/roles/a0a4f5f9b3264740a55056fed8fd7a33` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:30.050734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e23623-c805-4d49-b11b-b9b7a526f48a None admin] RBAC: Authorizing `identity:create_grant(project_id=be349194440449209f19f6b535ffd4f6, user_id=dfb4be75496444dd897b880c2ac3e67e, role_id=a0a4f5f9b3264740a55056fed8fd7a33)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:30.057314 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e23623-c805-4d49-b11b-b9b7a526f48a None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:30.153245 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 624/1232] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 08:35:29 2022] PUT /identity/v3/projects/be349194440449209f19f6b535ffd4f6/users/dfb4be75496444dd897b880c2ac3e67e/roles/a0a4f5f9b3264740a55056fed8fd7a33 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:35:32.148223 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ea784-89c8-4d3c-a6c7-2d53befddced None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:32.148740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ea784-89c8-4d3c-a6c7-2d53befddced None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:32.148740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ea784-89c8-4d3c-a6c7-2d53befddced None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:32.150083 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 609/1233] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:35:32.155391 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fe8cf-808a-44b8-bddc-a0978dcb1814 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:32.155811 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fe8cf-808a-44b8-bddc-a0978dcb1814 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:32.155974 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fe8cf-808a-44b8-bddc-a0978dcb1814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:32.173704 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-273fe8cf-808a-44b8-bddc-a0978dcb1814 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:35:32.174925 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-273fe8cf-808a-44b8-bddc-a0978dcb1814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:32.238887 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 625/1234] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:35:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:35:32.262564 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ea784-89c8-4d3c-a6c7-2d53befddced None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:32.288704 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:32.362583 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ea784-89c8-4d3c-a6c7-2d53befddced None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:32.396368 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df02d2-c3ce-4fb1-813a-dec8deaace9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:32.397146 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df02d2-c3ce-4fb1-813a-dec8deaace9d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:32.397462 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df02d2-c3ce-4fb1-813a-dec8deaace9d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:32.397741 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df02d2-c3ce-4fb1-813a-dec8deaace9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:32.408549 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df02d2-c3ce-4fb1-813a-dec8deaace9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:35:32.416217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-51df02d2-c3ce-4fb1-813a-dec8deaace9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:35:32.416217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:32.416217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:35:32.416217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:35:32.416217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:35:32.416217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:35:32.416217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:35:32.416217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:35:32.416217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:35:32.416217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:35:32.416217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:35:32.416217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:35:32.416217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:35:32.416217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:35:32.416217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:35:32.416217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:35:32.417352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:35:32.417352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:35:32.417352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:35:32.417352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:35:32.417352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:35:32.417352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:35:32.417352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:35:32.417352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:35:32.417352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:35:32.417352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:35:32.417352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:35:32.417352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:35:32.417352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:35:32.417352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:35:32.417352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:35:32.417352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:35:32.418416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:35:32.418416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:35:32.418416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:35:32.418416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:35:32.418416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:35:32.418416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:35:32.418416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:35:32.418416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:35:32.418416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:35:32.418416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:35:32.418416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 08:35:32.418416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:35:32.418416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 610/1235] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 08:35:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:35:32.425531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fe8cf-808a-44b8-bddc-a0978dcb1814 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:32.470449 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:32.522067 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fe8cf-808a-44b8-bddc-a0978dcb1814 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:32.556134 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51522ff2-d759-4d63-9828-1a64dee11681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:32.556807 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51522ff2-d759-4d63-9828-1a64dee11681 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:32.557093 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51522ff2-d759-4d63-9828-1a64dee11681 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:32.557371 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51522ff2-d759-4d63-9828-1a64dee11681 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:32.558121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51522ff2-d759-4d63-9828-1a64dee11681 None admin] RBAC: Adding query filter params (name=service) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:32.558439 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51522ff2-d759-4d63-9828-1a64dee11681 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:32.559836 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51522ff2-d759-4d63-9828-1a64dee11681 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:32.568018 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 626/1236] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 08:35:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:32.573691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df02d2-c3ce-4fb1-813a-dec8deaace9d None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:32.658813 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:32.674938 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df02d2-c3ce-4fb1-813a-dec8deaace9d None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:32.708322 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97116f10-6275-41b6-8d18-188863133bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:32.709114 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97116f10-6275-41b6-8d18-188863133bf3 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:32.709402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97116f10-6275-41b6-8d18-188863133bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:32.709681 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97116f10-6275-41b6-8d18-188863133bf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:32.721406 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97116f10-6275-41b6-8d18-188863133bf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:32.722905 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97116f10-6275-41b6-8d18-188863133bf3 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:32.739790 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-97116f10-6275-41b6-8d18-188863133bf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:35:32.739790 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:32.739790 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:35:32.739790 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:35:32.739790 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:35:32.739790 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:35:32.739790 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:35:32.739790 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:35:32.739790 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:35:32.739790 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:35:32.739790 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:35:32.739790 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:35:32.739790 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:35:32.739790 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:35:32.739790 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:35:32.740822 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:35:32.740822 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:35:32.740822 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:35:32.740822 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:35:32.740822 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:35:32.740822 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:35:32.740822 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:35:32.740822 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:35:32.740822 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:35:32.740822 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:35:32.740822 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:35:32.740822 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:35:32.740822 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:35:32.740822 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:35:32.740822 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:35:32.740822 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:35:32.740822 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:35:32.741718 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:35:32.741718 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:35:32.741718 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:35:32.741718 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:35:32.741718 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 611/1237] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:35:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:35:32.746800 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51522ff2-d759-4d63-9828-1a64dee11681 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:32.846897 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51522ff2-d759-4d63-9828-1a64dee11681 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:32.855407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:32.879137 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b1f98-6267-4627-96c2-5c6584537e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:32.879822 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b1f98-6267-4627-96c2-5c6584537e32 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:32.880108 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b1f98-6267-4627-96c2-5c6584537e32 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:32.880381 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b1f98-6267-4627-96c2-5c6584537e32 None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:32.881091 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b1f98-6267-4627-96c2-5c6584537e32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:32.881395 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b1f98-6267-4627-96c2-5c6584537e32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:32.882753 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b1f98-6267-4627-96c2-5c6584537e32 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:32.894969 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 627/1238] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:32.900751 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97116f10-6275-41b6-8d18-188863133bf3 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:33.005321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97116f10-6275-41b6-8d18-188863133bf3 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:33.038441 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef767178-d4c9-4866-82a3-87446a14eb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:33.039228 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef767178-d4c9-4866-82a3-87446a14eb87 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:33.039511 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef767178-d4c9-4866-82a3-87446a14eb87 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:33.039817 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef767178-d4c9-4866-82a3-87446a14eb87 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:33.042539 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:33.047430 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef767178-d4c9-4866-82a3-87446a14eb87 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:33.048988 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef767178-d4c9-4866-82a3-87446a14eb87 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:33.063905 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-ef767178-d4c9-4866-82a3-87446a14eb87 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 08:35:33.063905 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:33.063905 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:35:33.063905 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:35:33.063905 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:35:33.063905 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:35:33.063905 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:35:33.063905 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:35:33.063905 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:35:33.063905 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:35:33.063905 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:35:33.063905 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:35:33.063905 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:35:33.063905 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:35:33.063905 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:35:33.063905 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:35:33.065767 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:35:33.065767 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:35:33.065767 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:35:33.065767 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:35:33.065767 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:35:33.065767 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:35:33.065767 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:35:33.065767 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:35:33.065767 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:35:33.065767 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:35:33.065767 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:35:33.065767 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:35:33.065767 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:35:33.065767 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:35:33.065767 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:35:33.065767 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:35:33.065767 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:35:33.065767 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:35:33.067029 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:35:33.067029 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:35:33.067029 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:35:33.067029 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:35:33.067029 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:35:33.067029 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:35:33.067029 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:35:33.067029 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:35:33.067029 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 08:35:33.067029 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:35:33.067029 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 612/1239] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:35:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:35:33.071025 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b1f98-6267-4627-96c2-5c6584537e32 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:33.170263 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b1f98-6267-4627-96c2-5c6584537e32 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:33.204978 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0004d-7593-4dcb-a757-b1fca4a0e7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:33.205638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0004d-7593-4dcb-a757-b1fca4a0e7bf None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:33.205922 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0004d-7593-4dcb-a757-b1fca4a0e7bf None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:33.206196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0004d-7593-4dcb-a757-b1fca4a0e7bf None admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:33.207031 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0004d-7593-4dcb-a757-b1fca4a0e7bf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:33.207343 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0004d-7593-4dcb-a757-b1fca4a0e7bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:33.208868 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0004d-7593-4dcb-a757-b1fca4a0e7bf None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:33.225577 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 628/1240] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Jul 25 08:35:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:35:33.231515 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef767178-d4c9-4866-82a3-87446a14eb87 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:33.334977 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef767178-d4c9-4866-82a3-87446a14eb87 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:33.369097 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a355276-315a-4d11-9f3f-0bdbb7937799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:33.369729 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a355276-315a-4d11-9f3f-0bdbb7937799 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:33.370014 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a355276-315a-4d11-9f3f-0bdbb7937799 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:33.370291 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a355276-315a-4d11-9f3f-0bdbb7937799 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:33.430456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:33.436992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a355276-315a-4d11-9f3f-0bdbb7937799 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:33.439069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a355276-315a-4d11-9f3f-0bdbb7937799 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:33.535244 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 613/1241] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:35:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 08:35:33.541027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0004d-7593-4dcb-a757-b1fca4a0e7bf None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:33.567844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:33.638585 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0004d-7593-4dcb-a757-b1fca4a0e7bf None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:33.671704 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c4939-7882-4181-a749-8f3d5b95efba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:33.673123 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c4939-7882-4181-a749-8f3d5b95efba None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:33.673484 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c4939-7882-4181-a749-8f3d5b95efba None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:33.673763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c4939-7882-4181-a749-8f3d5b95efba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:33.683898 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c4939-7882-4181-a749-8f3d5b95efba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:33.685334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c4939-7882-4181-a749-8f3d5b95efba None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:33.702793 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-2c9c4939-7882-4181-a749-8f3d5b95efba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:35:33.702793 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:33.702793 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:35:33.702793 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:35:33.702793 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:35:33.702793 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:35:33.702793 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:35:33.702793 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:35:33.702793 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:35:33.702793 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:35:33.702793 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:35:33.702793 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:35:33.702793 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:35:33.702793 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:35:33.702793 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:35:33.703856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:35:33.703856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:35:33.703856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:35:33.703856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:35:33.703856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:35:33.703856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:35:33.703856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:35:33.703856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:35:33.703856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:35:33.703856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:35:33.703856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:35:33.703856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:35:33.703856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:35:33.703856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:35:33.703856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:35:33.703856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:35:33.703856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:35:33.704951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:35:33.704951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:35:33.704951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:35:33.704951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:35:33.704951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 629/1242] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:35:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:35:33.710009 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a355276-315a-4d11-9f3f-0bdbb7937799 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:33.802998 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:33.808868 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a355276-315a-4d11-9f3f-0bdbb7937799 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:33.843056 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2857b7-3f15-4898-97f0-4e9f83dcc178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:33.843739 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2857b7-3f15-4898-97f0-4e9f83dcc178 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:33.844029 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2857b7-3f15-4898-97f0-4e9f83dcc178 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:33.844399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2857b7-3f15-4898-97f0-4e9f83dcc178 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:33.845319 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2857b7-3f15-4898-97f0-4e9f83dcc178 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:33.845631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2857b7-3f15-4898-97f0-4e9f83dcc178 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:33.846983 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2857b7-3f15-4898-97f0-4e9f83dcc178 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:33.858082 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 614/1243] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:33.864634 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c4939-7882-4181-a749-8f3d5b95efba None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:33.942893 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:33.963588 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c4939-7882-4181-a749-8f3d5b95efba None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:33.998350 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c5c99-b25f-4a83-afd3-0581b9c18217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:33.999147 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c5c99-b25f-4a83-afd3-0581b9c18217 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:33.999433 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c5c99-b25f-4a83-afd3-0581b9c18217 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:33.999752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c5c99-b25f-4a83-afd3-0581b9c18217 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:34.006462 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c5c99-b25f-4a83-afd3-0581b9c18217 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:34.007938 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c5c99-b25f-4a83-afd3-0581b9c18217 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:34.022235 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-9b1c5c99-b25f-4a83-afd3-0581b9c18217 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:35:34.022235 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:34.022235 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:35:34.022235 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:35:34.022235 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:35:34.022235 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:35:34.022235 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:35:34.022235 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:35:34.022235 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:35:34.022235 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:35:34.022235 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:35:34.022235 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:35:34.022235 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:35:34.022235 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:35:34.022235 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:35:34.023281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:35:34.023281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:35:34.023281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:35:34.023281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:35:34.023281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:35:34.023281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:35:34.023281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:35:34.023281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:35:34.023281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:35:34.023281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:35:34.023281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:35:34.023281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:35:34.023281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:35:34.023281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:35:34.023281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:35:34.023281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:35:34.023281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:35:34.024230 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:35:34.024230 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:35:34.024230 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:35:34.024230 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:35:34.024230 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:35:34.024230 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:35:34.024230 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:35:34.024230 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:35:34.024230 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 630/1244] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:35:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:35:34.029614 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2857b7-3f15-4898-97f0-4e9f83dcc178 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:34.129819 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2857b7-3f15-4898-97f0-4e9f83dcc178 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:34.163164 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546cfa2-dee7-4409-b210-18494109aa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:34.163857 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546cfa2-dee7-4409-b210-18494109aa23 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:34.164140 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546cfa2-dee7-4409-b210-18494109aa23 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:34.164422 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546cfa2-dee7-4409-b210-18494109aa23 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:34.165203 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4546cfa2-dee7-4409-b210-18494109aa23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:34.165509 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4546cfa2-dee7-4409-b210-18494109aa23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:34.166911 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4546cfa2-dee7-4409-b210-18494109aa23 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:34.179007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 615/1245] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:35:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:34.185151 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c5c99-b25f-4a83-afd3-0581b9c18217 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:34.284596 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c5c99-b25f-4a83-afd3-0581b9c18217 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:34.318902 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55222e6-5af6-4b16-a0e9-0d9cf9b1b605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:34.319544 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55222e6-5af6-4b16-a0e9-0d9cf9b1b605 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:34.319855 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55222e6-5af6-4b16-a0e9-0d9cf9b1b605 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:34.320127 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55222e6-5af6-4b16-a0e9-0d9cf9b1b605 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:34.320948 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55222e6-5af6-4b16-a0e9-0d9cf9b1b605 None admin] RBAC: Adding query filter params (role.id=a0a4f5f9b3264740a55056fed8fd7a33, scope.project.id=be349194440449209f19f6b535ffd4f6, user.id=dfb4be75496444dd897b880c2ac3e67e) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:34.321256 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55222e6-5af6-4b16-a0e9-0d9cf9b1b605 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:34.322679 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55222e6-5af6-4b16-a0e9-0d9cf9b1b605 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:34.328450 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 631/1246] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:35:34 2022] GET /identity/v3/role_assignments?user.id=dfb4be75496444dd897b880c2ac3e67e&scope.project.id=be349194440449209f19f6b535ffd4f6&role.id=a0a4f5f9b3264740a55056fed8fd7a33 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:36.381443 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc12b1-7ec0-4b3e-89f8-0b38f7c5722b None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:36.381995 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc12b1-7ec0-4b3e-89f8-0b38f7c5722b None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:36.381995 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc12b1-7ec0-4b3e-89f8-0b38f7c5722b None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:36.383369 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 616/1247] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:35:36.388710 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249074e-5f8b-417d-a6d5-8426c1499a16 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:36.389085 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249074e-5f8b-417d-a6d5-8426c1499a16 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:36.389273 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249074e-5f8b-417d-a6d5-8426c1499a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:36.396304 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:36.409019 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-c249074e-5f8b-417d-a6d5-8426c1499a16 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:35:36.410217 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-c249074e-5f8b-417d-a6d5-8426c1499a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:36.476594 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 632/1248] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:35:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:35:36.499430 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc12b1-7ec0-4b3e-89f8-0b38f7c5722b None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:36.519106 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:36.602976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc12b1-7ec0-4b3e-89f8-0b38f7c5722b None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:36.637078 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927808ef-e866-47c1-be70-4b4064a9ed03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:36.637797 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927808ef-e866-47c1-be70-4b4064a9ed03 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:36.638078 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927808ef-e866-47c1-be70-4b4064a9ed03 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:36.638352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927808ef-e866-47c1-be70-4b4064a9ed03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:36.649791 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927808ef-e866-47c1-be70-4b4064a9ed03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:35:36.657873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-927808ef-e866-47c1-be70-4b4064a9ed03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:35:36.657873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:36.657873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:35:36.657873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:35:36.657873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:35:36.657873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:35:36.657873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:35:36.657873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:35:36.657873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:35:36.657873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:35:36.657873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:35:36.657873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:35:36.657873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:35:36.657873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:35:36.657873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:35:36.657873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:35:36.665890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:35:36.665890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:35:36.665890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:35:36.665890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:35:36.665890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:35:36.665890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:35:36.665890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:35:36.665890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:35:36.665890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:35:36.665890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:35:36.665890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:35:36.665890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:35:36.665890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:35:36.665890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:35:36.665890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:35:36.665890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:35:36.667463 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:35:36.667463 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:35:36.667463 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:35:36.667463 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:35:36.667463 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:35:36.667463 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:35:36.667463 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:35:36.667463 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:35:36.667463 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:35:36.667463 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:35:36.667463 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:35:36.667463 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:35:36.667463 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 617/1249] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:35:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:35:36.668775 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249074e-5f8b-417d-a6d5-8426c1499a16 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:36.765320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249074e-5f8b-417d-a6d5-8426c1499a16 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:36.795467 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:36.800485 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab3754-83c6-483e-8833-6e7b28398ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:36.801145 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab3754-83c6-483e-8833-6e7b28398ca2 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:36.801427 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab3754-83c6-483e-8833-6e7b28398ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:36.801702 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab3754-83c6-483e-8833-6e7b28398ca2 None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:36.802445 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab3754-83c6-483e-8833-6e7b28398ca2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:36.802751 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab3754-83c6-483e-8833-6e7b28398ca2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:36.804169 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab3754-83c6-483e-8833-6e7b28398ca2 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:36.812281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 633/1250] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:35:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:36.818676 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927808ef-e866-47c1-be70-4b4064a9ed03 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:36.896812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:36.919977 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927808ef-e866-47c1-be70-4b4064a9ed03 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:36.952834 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b0bc9-4725-4146-8d07-c7d76f7cedbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:36.953905 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b0bc9-4725-4146-8d07-c7d76f7cedbe None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:36.954254 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b0bc9-4725-4146-8d07-c7d76f7cedbe None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:36.954534 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b0bc9-4725-4146-8d07-c7d76f7cedbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:36.964849 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b0bc9-4725-4146-8d07-c7d76f7cedbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:36.966367 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b0bc9-4725-4146-8d07-c7d76f7cedbe None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:36.983353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-0d7b0bc9-4725-4146-8d07-c7d76f7cedbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:35:36.983353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:36.983353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:35:36.983353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:35:36.983353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:35:36.983353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:35:36.983353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:35:36.983353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:35:36.983353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:35:36.983353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:35:36.983353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:35:36.983353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:35:36.983353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:35:36.983353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:35:36.983353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:35:36.984281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:35:36.984281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:35:36.984281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:35:36.984281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:35:36.984281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:35:36.984281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:35:36.984281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:35:36.984281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:35:36.984281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:35:36.984281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:35:36.984281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:35:36.984281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:35:36.984281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:35:36.984281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:35:36.984281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:35:36.984281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:35:36.984281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:35:36.985721 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:35:36.985721 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:35:36.985721 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:35:36.985721 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:35:36.985721 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 618/1251] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:35:36.991019 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab3754-83c6-483e-8833-6e7b28398ca2 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:37.095532 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab3754-83c6-483e-8833-6e7b28398ca2 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:37.128673 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84f282-84ac-413c-95d0-509da84f7ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:37.129433 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84f282-84ac-413c-95d0-509da84f7ba7 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:37.129714 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84f282-84ac-413c-95d0-509da84f7ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:37.129988 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84f282-84ac-413c-95d0-509da84f7ba7 None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:37.130700 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f84f282-84ac-413c-95d0-509da84f7ba7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:37.131010 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f84f282-84ac-413c-95d0-509da84f7ba7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:37.132395 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f84f282-84ac-413c-95d0-509da84f7ba7 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:37.144089 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 634/1252] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:37.150031 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b0bc9-4725-4146-8d07-c7d76f7cedbe None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:37.252299 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b0bc9-4725-4146-8d07-c7d76f7cedbe None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:37.277578 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:37.286678 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055b05f-7acc-4221-a92e-865277518580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:37.287486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055b05f-7acc-4221-a92e-865277518580 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:37.287802 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055b05f-7acc-4221-a92e-865277518580 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:37.288080 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055b05f-7acc-4221-a92e-865277518580 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:37.296238 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055b05f-7acc-4221-a92e-865277518580 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:37.298265 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055b05f-7acc-4221-a92e-865277518580 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:37.312217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-6055b05f-7acc-4221-a92e-865277518580 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 08:35:37.312217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:37.312217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:35:37.312217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:35:37.312217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:35:37.312217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:35:37.312217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:35:37.312217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:35:37.312217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:35:37.312217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:35:37.312217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:35:37.312217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:35:37.312217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:35:37.312217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:35:37.312217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:35:37.312217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:35:37.314003 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:35:37.314003 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:35:37.314003 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:35:37.314003 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:35:37.314003 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:35:37.314003 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:35:37.314003 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:35:37.314003 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:35:37.314003 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:35:37.314003 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:35:37.314003 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:35:37.314003 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:35:37.314003 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:35:37.314003 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:35:37.314003 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:35:37.314003 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:35:37.314003 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:35:37.314003 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:35:37.315069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:35:37.315069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:35:37.315069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:35:37.315069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:35:37.315069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:35:37.315069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:35:37.315069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:35:37.315069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:35:37.315069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 08:35:37.315069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:35:37.315069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 619/1253] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:35:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:35:37.319972 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84f282-84ac-413c-95d0-509da84f7ba7 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:37.375196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:37.419204 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84f282-84ac-413c-95d0-509da84f7ba7 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:37.451949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b4610-2477-41f0-8173-018f850f14a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:37.452619 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b4610-2477-41f0-8173-018f850f14a5 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:37.452902 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b4610-2477-41f0-8173-018f850f14a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:37.453183 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b4610-2477-41f0-8173-018f850f14a5 None admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:37.454774 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b4610-2477-41f0-8173-018f850f14a5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:37.455080 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b4610-2477-41f0-8173-018f850f14a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:37.456541 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b4610-2477-41f0-8173-018f850f14a5 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:37.473897 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 635/1254] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Jul 25 08:35:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:37.479573 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055b05f-7acc-4221-a92e-865277518580 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:37.576573 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055b05f-7acc-4221-a92e-865277518580 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:37.608798 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb36cd-d51b-4b03-b87e-fe9ac61fd11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:37.609424 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb36cd-d51b-4b03-b87e-fe9ac61fd11f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:37.610236 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb36cd-d51b-4b03-b87e-fe9ac61fd11f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:37.610519 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb36cd-d51b-4b03-b87e-fe9ac61fd11f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:37.663731 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:37.675642 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb36cd-d51b-4b03-b87e-fe9ac61fd11f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:37.677015 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb36cd-d51b-4b03-b87e-fe9ac61fd11f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:37.776020 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 620/1255] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:35:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 08:35:37.783105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b4610-2477-41f0-8173-018f850f14a5 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:37.880026 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b4610-2477-41f0-8173-018f850f14a5 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:37.893245 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:37.913880 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec416f9-de86-4f59-9686-c04cee865dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:37.917291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec416f9-de86-4f59-9686-c04cee865dfc None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:37.917291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec416f9-de86-4f59-9686-c04cee865dfc None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:37.917291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec416f9-de86-4f59-9686-c04cee865dfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:37.925124 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec416f9-de86-4f59-9686-c04cee865dfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:37.926614 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec416f9-de86-4f59-9686-c04cee865dfc None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:37.944487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-2ec416f9-de86-4f59-9686-c04cee865dfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:35:37.944487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:37.944487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:35:37.944487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:35:37.944487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:35:37.944487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:35:37.944487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:35:37.944487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:35:37.944487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:35:37.944487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:35:37.944487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:35:37.944487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:35:37.944487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:35:37.944487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:35:37.944487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:35:37.945564 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:35:37.945564 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:35:37.945564 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:35:37.945564 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:35:37.945564 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:35:37.945564 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:35:37.945564 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:35:37.945564 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:35:37.945564 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:35:37.945564 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:35:37.945564 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:35:37.945564 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:35:37.945564 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:35:37.945564 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:35:37.945564 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:35:37.945564 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:35:37.945564 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:35:37.946726 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:35:37.946726 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:35:37.946726 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:35:37.946726 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:35:37.946726 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 636/1256] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:35:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:35:37.951488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb36cd-d51b-4b03-b87e-fe9ac61fd11f None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:38.038198 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:38.049558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb36cd-d51b-4b03-b87e-fe9ac61fd11f None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:38.084216 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30b82d-016f-47b3-aa4d-4ace0009d3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:38.084904 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30b82d-016f-47b3-aa4d-4ace0009d3ee None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:38.085192 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30b82d-016f-47b3-aa4d-4ace0009d3ee None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:38.085474 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30b82d-016f-47b3-aa4d-4ace0009d3ee None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:38.086196 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30b82d-016f-47b3-aa4d-4ace0009d3ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:38.086514 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30b82d-016f-47b3-aa4d-4ace0009d3ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:38.087944 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30b82d-016f-47b3-aa4d-4ace0009d3ee None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:38.099734 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 621/1257] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:38.105583 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec416f9-de86-4f59-9686-c04cee865dfc None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:38.202979 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec416f9-de86-4f59-9686-c04cee865dfc None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:38.236534 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ace762-ebae-4ef9-a4b2-14f1d5965768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:38.237320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ace762-ebae-4ef9-a4b2-14f1d5965768 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:38.237655 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ace762-ebae-4ef9-a4b2-14f1d5965768 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:38.237929 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ace762-ebae-4ef9-a4b2-14f1d5965768 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:38.244606 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ace762-ebae-4ef9-a4b2-14f1d5965768 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:38.246048 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ace762-ebae-4ef9-a4b2-14f1d5965768 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:38.260325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-79ace762-ebae-4ef9-a4b2-14f1d5965768 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:35:38.260325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:38.260325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:35:38.260325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:35:38.260325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:35:38.260325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:35:38.260325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:35:38.260325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:35:38.260325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:35:38.260325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:35:38.260325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:35:38.260325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:35:38.260325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:35:38.260325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:35:38.260325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:35:38.261374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:35:38.261374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:35:38.261374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:35:38.261374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:35:38.261374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:35:38.261374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:35:38.261374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:35:38.261374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:35:38.261374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:35:38.261374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:35:38.261374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:35:38.261374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:35:38.261374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:35:38.261374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:35:38.261374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:35:38.261374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:35:38.261374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:35:38.262480 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:35:38.262480 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:35:38.262480 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:35:38.262480 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:35:38.262480 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:35:38.262480 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:35:38.262480 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:35:38.262480 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:35:38.262480 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 637/1258] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:35:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:35:38.268300 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30b82d-016f-47b3-aa4d-4ace0009d3ee None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:38.371095 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30b82d-016f-47b3-aa4d-4ace0009d3ee None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:38.404056 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0b033-0df1-4db1-aa58-05a7dd0ad242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:38.404999 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0b033-0df1-4db1-aa58-05a7dd0ad242 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:38.405285 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0b033-0df1-4db1-aa58-05a7dd0ad242 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:38.405559 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0b033-0df1-4db1-aa58-05a7dd0ad242 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:38.406362 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0b033-0df1-4db1-aa58-05a7dd0ad242 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:38.406699 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0b033-0df1-4db1-aa58-05a7dd0ad242 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:38.408404 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0b033-0df1-4db1-aa58-05a7dd0ad242 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:38.419992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 622/1259] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:35:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:38.426878 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ace762-ebae-4ef9-a4b2-14f1d5965768 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:38.453559 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:38.527056 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ace762-ebae-4ef9-a4b2-14f1d5965768 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:38.559836 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d341c5-3691-45ca-b7da-4a62e0ad2704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:38.560493 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d341c5-3691-45ca-b7da-4a62e0ad2704 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:38.560776 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d341c5-3691-45ca-b7da-4a62e0ad2704 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:38.561050 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d341c5-3691-45ca-b7da-4a62e0ad2704 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:38.561879 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d341c5-3691-45ca-b7da-4a62e0ad2704 None admin] RBAC: Adding query filter params (role.id=25b0f48c10474bf6b98aad8f093868ee, scope.project.id=be349194440449209f19f6b535ffd4f6, user.id=dfb4be75496444dd897b880c2ac3e67e) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:38.562192 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d341c5-3691-45ca-b7da-4a62e0ad2704 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:38.564320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d341c5-3691-45ca-b7da-4a62e0ad2704 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:38.569669 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 638/1260] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:35:38 2022] GET /identity/v3/role_assignments?user.id=dfb4be75496444dd897b880c2ac3e67e&scope.project.id=be349194440449209f19f6b535ffd4f6&role.id=25b0f48c10474bf6b98aad8f093868ee => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:40.583740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc20b2-62f1-456b-8f48-2464e721a05c None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:40.584291 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc20b2-62f1-456b-8f48-2464e721a05c None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:40.584291 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc20b2-62f1-456b-8f48-2464e721a05c None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:40.585690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 623/1261] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:35:40.590947 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9e2f5-821d-4b0b-bd5f-668a5ddc73dc None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:40.591344 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9e2f5-821d-4b0b-bd5f-668a5ddc73dc None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:40.591506 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9e2f5-821d-4b0b-bd5f-668a5ddc73dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:40.609954 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-f4c9e2f5-821d-4b0b-bd5f-668a5ddc73dc None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:35:40.611136 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-f4c9e2f5-821d-4b0b-bd5f-668a5ddc73dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:40.676335 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 639/1262] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:35:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:35:40.698594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc20b2-62f1-456b-8f48-2464e721a05c None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:40.710339 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:40.808615 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc20b2-62f1-456b-8f48-2464e721a05c None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:40.845370 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416051b-f129-4e4e-8e87-9037c583f651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:40.846108 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416051b-f129-4e4e-8e87-9037c583f651 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:40.846389 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416051b-f129-4e4e-8e87-9037c583f651 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:40.846663 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416051b-f129-4e4e-8e87-9037c583f651 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:40.856872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416051b-f129-4e4e-8e87-9037c583f651 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:35:40.868631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-7416051b-f129-4e4e-8e87-9037c583f651 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:35:40.868631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:40.868631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:35:40.868631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:35:40.868631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:35:40.868631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:35:40.868631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:35:40.868631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:35:40.868631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:35:40.868631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:35:40.868631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:35:40.868631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:35:40.868631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:35:40.868631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:35:40.868631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:35:40.868631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:35:40.870384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:35:40.870384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:35:40.870384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:35:40.870384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:35:40.870384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:35:40.870384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:35:40.870384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:35:40.870384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:35:40.870384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:35:40.870384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:35:40.870384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:35:40.870384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:35:40.870384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:35:40.870384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:35:40.870384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:35:40.870384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:35:40.872497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:35:40.872497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:35:40.872497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:35:40.872497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:35:40.872497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:35:40.872497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:35:40.872497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:35:40.872497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:35:40.872497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:35:40.872497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:35:40.872497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:35:40.872497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:35:40.872497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 624/1263] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:35:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:35:40.878150 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9e2f5-821d-4b0b-bd5f-668a5ddc73dc None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:40.899838 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:40.994259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9e2f5-821d-4b0b-bd5f-668a5ddc73dc None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:41.030724 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d7117-e3c7-446d-8314-e754a4d4896e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:41.031382 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d7117-e3c7-446d-8314-e754a4d4896e None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:41.031947 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d7117-e3c7-446d-8314-e754a4d4896e None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:41.032232 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d7117-e3c7-446d-8314-e754a4d4896e None admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:41.032975 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d7117-e3c7-446d-8314-e754a4d4896e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:41.033280 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d7117-e3c7-446d-8314-e754a4d4896e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:41.034701 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d7117-e3c7-446d-8314-e754a4d4896e None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:41.042621 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 640/1264] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:35:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:35:41.049134 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416051b-f129-4e4e-8e87-9037c583f651 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:41.120768 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:41.154437 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416051b-f129-4e4e-8e87-9037c583f651 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:41.187471 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63301206-0cf8-4f2d-97d4-8aaad5b7c612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:41.188908 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63301206-0cf8-4f2d-97d4-8aaad5b7c612 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:41.189577 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63301206-0cf8-4f2d-97d4-8aaad5b7c612 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:41.189860 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63301206-0cf8-4f2d-97d4-8aaad5b7c612 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:41.200497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63301206-0cf8-4f2d-97d4-8aaad5b7c612 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:41.201924 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63301206-0cf8-4f2d-97d4-8aaad5b7c612 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:41.219920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-63301206-0cf8-4f2d-97d4-8aaad5b7c612 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:35:41.219920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:41.219920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:35:41.219920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:35:41.219920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:35:41.219920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:35:41.219920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:35:41.219920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:35:41.219920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:35:41.219920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:35:41.219920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:35:41.219920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:35:41.219920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:35:41.219920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:35:41.219920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:35:41.221055 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:35:41.221055 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:35:41.221055 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:35:41.221055 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:35:41.221055 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:35:41.221055 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:35:41.221055 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:35:41.221055 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:35:41.221055 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:35:41.221055 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:35:41.221055 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:35:41.221055 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:35:41.221055 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:35:41.221055 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:35:41.221055 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:35:41.221055 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:35:41.221055 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:35:41.222160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:35:41.222160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:35:41.222160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:35:41.222160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:35:41.222160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 625/1265] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:35:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:35:41.226937 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d7117-e3c7-446d-8314-e754a4d4896e None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:41.309659 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:41.329177 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d7117-e3c7-446d-8314-e754a4d4896e None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:41.362761 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea3298-1c3f-4df1-9a41-e05dcb4e0dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:41.363446 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea3298-1c3f-4df1-9a41-e05dcb4e0dbe None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:41.363757 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea3298-1c3f-4df1-9a41-e05dcb4e0dbe None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:41.364038 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea3298-1c3f-4df1-9a41-e05dcb4e0dbe None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:41.364747 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea3298-1c3f-4df1-9a41-e05dcb4e0dbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:41.365052 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea3298-1c3f-4df1-9a41-e05dcb4e0dbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:41.366412 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea3298-1c3f-4df1-9a41-e05dcb4e0dbe None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:41.378880 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 641/1266] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:41.384642 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63301206-0cf8-4f2d-97d4-8aaad5b7c612 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:41.490831 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63301206-0cf8-4f2d-97d4-8aaad5b7c612 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:41.511448 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:41.525983 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ac65d-ed82-4586-8e29-bb8826f3e753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:41.526776 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ac65d-ed82-4586-8e29-bb8826f3e753 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:41.527054 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ac65d-ed82-4586-8e29-bb8826f3e753 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:41.527334 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ac65d-ed82-4586-8e29-bb8826f3e753 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:41.536304 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ac65d-ed82-4586-8e29-bb8826f3e753 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:41.537729 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ac65d-ed82-4586-8e29-bb8826f3e753 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:41.551947 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-279ac65d-ed82-4586-8e29-bb8826f3e753 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 08:35:41.551947 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:41.551947 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:35:41.551947 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:35:41.551947 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:35:41.551947 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:35:41.551947 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:35:41.551947 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:35:41.551947 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:35:41.551947 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:35:41.551947 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:35:41.551947 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:35:41.551947 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:35:41.551947 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:35:41.551947 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:35:41.551947 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:35:41.553077 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:35:41.553077 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:35:41.553077 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:35:41.553077 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:35:41.553077 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:35:41.553077 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:35:41.553077 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:35:41.553077 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:35:41.553077 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:35:41.553077 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:35:41.553077 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:35:41.553077 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:35:41.553077 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:35:41.553077 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:35:41.553077 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:35:41.553077 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:35:41.553077 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:35:41.553077 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:35:41.554212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:35:41.554212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:35:41.554212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:35:41.554212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:35:41.554212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:35:41.554212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:35:41.554212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:35:41.554212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:35:41.554212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 08:35:41.554212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:35:41.554212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 626/1267] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:35:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:35:41.558959 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea3298-1c3f-4df1-9a41-e05dcb4e0dbe None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:41.658184 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea3298-1c3f-4df1-9a41-e05dcb4e0dbe None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:41.692202 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d789900-20f6-4626-a8fd-94f4bf1c1124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:41.692862 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d789900-20f6-4626-a8fd-94f4bf1c1124 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:41.693144 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d789900-20f6-4626-a8fd-94f4bf1c1124 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:41.693416 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d789900-20f6-4626-a8fd-94f4bf1c1124 None admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:41.694293 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d789900-20f6-4626-a8fd-94f4bf1c1124 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:41.694601 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d789900-20f6-4626-a8fd-94f4bf1c1124 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:41.696065 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d789900-20f6-4626-a8fd-94f4bf1c1124 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:41.705867 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:41.714760 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 642/1268] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Jul 25 08:35:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:41.720793 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ac65d-ed82-4586-8e29-bb8826f3e753 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:41.825728 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ac65d-ed82-4586-8e29-bb8826f3e753 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:41.859300 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c7232-406f-4196-a3b8-64ceec7846dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:41.860210 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c7232-406f-4196-a3b8-64ceec7846dc None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:41.860502 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c7232-406f-4196-a3b8-64ceec7846dc None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:41.860798 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c7232-406f-4196-a3b8-64ceec7846dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:41.871100 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c7232-406f-4196-a3b8-64ceec7846dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:41.872604 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c7232-406f-4196-a3b8-64ceec7846dc None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:41.889760 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-7b1c7232-406f-4196-a3b8-64ceec7846dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:35:41.889760 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:41.889760 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:35:41.889760 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:35:41.889760 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:35:41.889760 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:35:41.889760 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:35:41.889760 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:35:41.889760 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:35:41.889760 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:35:41.889760 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:35:41.889760 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:35:41.889760 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:35:41.889760 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:35:41.889760 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:35:41.891458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:35:41.891458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:35:41.891458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:35:41.891458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:35:41.891458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:35:41.891458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:35:41.891458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:35:41.891458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:35:41.891458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:35:41.891458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:35:41.891458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:35:41.891458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:35:41.891458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:35:41.891458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:35:41.891458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:35:41.891458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:35:41.891458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:35:41.892962 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:35:41.892962 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:35:41.892962 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:35:41.892962 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:35:41.892962 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 627/1269] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:35:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:35:41.897464 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d789900-20f6-4626-a8fd-94f4bf1c1124 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:41.999965 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d789900-20f6-4626-a8fd-94f4bf1c1124 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:42.034075 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fa74e-3a86-4e5a-b7b0-fca8616775e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:42.034729 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fa74e-3a86-4e5a-b7b0-fca8616775e1 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:42.035011 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fa74e-3a86-4e5a-b7b0-fca8616775e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:42.035285 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fa74e-3a86-4e5a-b7b0-fca8616775e1 None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:42.036031 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79fa74e-3a86-4e5a-b7b0-fca8616775e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:42.036339 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79fa74e-3a86-4e5a-b7b0-fca8616775e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:42.037707 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79fa74e-3a86-4e5a-b7b0-fca8616775e1 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:42.048968 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 643/1270] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:42.054619 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c7232-406f-4196-a3b8-64ceec7846dc None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:42.087171 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:42.157205 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c7232-406f-4196-a3b8-64ceec7846dc None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:42.190672 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c7d17-3d85-4f41-875e-29631f946a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:42.191553 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c7d17-3d85-4f41-875e-29631f946a78 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:42.191866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c7d17-3d85-4f41-875e-29631f946a78 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:42.192146 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c7d17-3d85-4f41-875e-29631f946a78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:42.198647 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c7d17-3d85-4f41-875e-29631f946a78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:42.200122 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c7d17-3d85-4f41-875e-29631f946a78 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:42.214355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-fe6c7d17-3d85-4f41-875e-29631f946a78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:35:42.214355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:42.214355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:35:42.214355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:35:42.214355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:35:42.214355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:35:42.214355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:35:42.214355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:35:42.214355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:35:42.214355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:35:42.214355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:35:42.214355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:35:42.214355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:35:42.214355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:35:42.214355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:35:42.215403 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:35:42.215403 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:35:42.215403 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:35:42.215403 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:35:42.215403 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:35:42.215403 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:35:42.215403 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:35:42.215403 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:35:42.215403 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:35:42.215403 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:35:42.215403 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:35:42.215403 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:35:42.215403 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:35:42.215403 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:35:42.215403 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:35:42.215403 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:35:42.215403 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:35:42.216553 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:35:42.216553 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:35:42.216553 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:35:42.216553 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:35:42.216553 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:35:42.216553 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:35:42.216553 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:35:42.216553 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:35:42.216553 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 628/1271] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:35:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:35:42.221520 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fa74e-3a86-4e5a-b7b0-fca8616775e1 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:42.279433 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:42.322290 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fa74e-3a86-4e5a-b7b0-fca8616775e1 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:42.353752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a59e0b-f05a-4885-9177-40d244717d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:42.354402 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a59e0b-f05a-4885-9177-40d244717d78 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:42.354686 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a59e0b-f05a-4885-9177-40d244717d78 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:42.354964 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a59e0b-f05a-4885-9177-40d244717d78 None admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:42.355779 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a59e0b-f05a-4885-9177-40d244717d78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:42.356098 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a59e0b-f05a-4885-9177-40d244717d78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:42.357533 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a59e0b-f05a-4885-9177-40d244717d78 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:42.369651 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 644/1272] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:35:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:42.376326 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c7d17-3d85-4f41-875e-29631f946a78 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:42.465091 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:42.474167 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c7d17-3d85-4f41-875e-29631f946a78 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:42.508497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1d2a8-f526-405d-83de-135f131bdcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:42.509372 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1d2a8-f526-405d-83de-135f131bdcd8 None admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:42.509652 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1d2a8-f526-405d-83de-135f131bdcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:42.509925 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1d2a8-f526-405d-83de-135f131bdcd8 None admin] PATH_INFO: `/v3/projects/be349194440449209f19f6b535ffd4f6/users/dfb4be75496444dd897b880c2ac3e67e/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:42.511866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1d2a8-f526-405d-83de-135f131bdcd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=be349194440449209f19f6b535ffd4f6, user_id=dfb4be75496444dd897b880c2ac3e67e, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:42.513279 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1d2a8-f526-405d-83de-135f131bdcd8 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:42.656227 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 629/1273] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 08:35:42 2022] PUT /identity/v3/projects/be349194440449209f19f6b535ffd4f6/users/dfb4be75496444dd897b880c2ac3e67e/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:35:44.658995 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721d0e3-deb1-48ae-bff3-97a8890dcb5d None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:44.659546 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721d0e3-deb1-48ae-bff3-97a8890dcb5d None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:44.659690 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721d0e3-deb1-48ae-bff3-97a8890dcb5d None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:44.660988 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 645/1274] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:35:44.666216 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f52d68-8403-4d32-ab6e-02b080d0afff None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:44.670145 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f52d68-8403-4d32-ab6e-02b080d0afff None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:44.670145 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f52d68-8403-4d32-ab6e-02b080d0afff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:44.685054 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-74f52d68-8403-4d32-ab6e-02b080d0afff None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:35:44.686233 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-74f52d68-8403-4d32-ab6e-02b080d0afff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:44.754962 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 630/1275] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:35:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:35:44.778588 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721d0e3-deb1-48ae-bff3-97a8890dcb5d None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:44.878889 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721d0e3-deb1-48ae-bff3-97a8890dcb5d None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:44.896294 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:44.912936 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2869fa-9635-40df-9793-1492bc5ce67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:44.913657 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2869fa-9635-40df-9793-1492bc5ce67c None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:44.913936 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2869fa-9635-40df-9793-1492bc5ce67c None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:44.914208 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2869fa-9635-40df-9793-1492bc5ce67c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:44.924315 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2869fa-9635-40df-9793-1492bc5ce67c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 08:35:44.931820 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-aa2869fa-9635-40df-9793-1492bc5ce67c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:35:44.931820 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:44.931820 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:35:44.931820 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:35:44.931820 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:35:44.931820 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:35:44.931820 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:35:44.931820 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:35:44.931820 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:35:44.931820 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:35:44.931820 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:35:44.931820 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:35:44.931820 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 08:35:44.931820 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 08:35:44.931820 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 08:35:44.931820 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 08:35:44.933048 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 08:35:44.933048 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 08:35:44.933048 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 08:35:44.933048 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 08:35:44.933048 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:35:44.933048 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:35:44.933048 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:35:44.933048 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:35:44.933048 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:35:44.933048 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:35:44.933048 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:35:44.933048 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:35:44.933048 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:35:44.933048 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:35:44.933048 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:35:44.933048 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:35:44.933919 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:35:44.933919 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:35:44.933919 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:35:44.933919 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:35:44.933919 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 08:35:44.933919 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 08:35:44.933919 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 08:35:44.933919 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 08:35:44.933919 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 08:35:44.933919 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 08:35:44.933919 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 08:35:44.933919 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:35:44.933919 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 646/1276] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 08:35:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:35:44.939759 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f52d68-8403-4d32-ab6e-02b080d0afff None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:45.020573 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:45.037964 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f52d68-8403-4d32-ab6e-02b080d0afff None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:45.071498 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bb731-1635-443a-b497-7da389c008c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:45.072195 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bb731-1635-443a-b497-7da389c008c9 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:45.072680 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bb731-1635-443a-b497-7da389c008c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:45.073123 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bb731-1635-443a-b497-7da389c008c9 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:45.074207 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bb731-1635-443a-b497-7da389c008c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:45.074569 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bb731-1635-443a-b497-7da389c008c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:45.076007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bb731-1635-443a-b497-7da389c008c9 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:45.084626 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 631/1277] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 08:35:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:45.090600 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2869fa-9635-40df-9793-1492bc5ce67c None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:45.186989 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2869fa-9635-40df-9793-1492bc5ce67c None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:45.219701 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709fd13-e089-489a-a645-a6d3c47cfe17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:45.220478 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709fd13-e089-489a-a645-a6d3c47cfe17 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:45.220761 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709fd13-e089-489a-a645-a6d3c47cfe17 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:45.221033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709fd13-e089-489a-a645-a6d3c47cfe17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:45.231083 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709fd13-e089-489a-a645-a6d3c47cfe17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:45.232540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709fd13-e089-489a-a645-a6d3c47cfe17 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:45.249401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-d709fd13-e089-489a-a645-a6d3c47cfe17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:35:45.249401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:45.249401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:35:45.249401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:35:45.249401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:35:45.249401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:35:45.249401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:35:45.249401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:35:45.249401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:35:45.249401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:35:45.249401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:35:45.249401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:35:45.249401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:35:45.249401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:35:45.249401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:35:45.251047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:35:45.251047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:35:45.251047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:35:45.251047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:35:45.251047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:35:45.251047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:35:45.251047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:35:45.251047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:35:45.251047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:35:45.251047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:35:45.251047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:35:45.251047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:35:45.251047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:35:45.251047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:35:45.251047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:35:45.251047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:35:45.251047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:35:45.252071 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:35:45.252071 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:35:45.252071 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:35:45.252071 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:35:45.252071 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 647/1278] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:35:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:35:45.257162 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bb731-1635-443a-b497-7da389c008c9 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:45.355751 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bb731-1635-443a-b497-7da389c008c9 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:45.387875 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398efdc-379e-4300-a2d4-29d9ed6ab2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:45.388531 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398efdc-379e-4300-a2d4-29d9ed6ab2df None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:45.388813 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398efdc-379e-4300-a2d4-29d9ed6ab2df None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:45.389088 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398efdc-379e-4300-a2d4-29d9ed6ab2df None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:45.389805 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398efdc-379e-4300-a2d4-29d9ed6ab2df None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:45.390137 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398efdc-379e-4300-a2d4-29d9ed6ab2df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:45.392200 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398efdc-379e-4300-a2d4-29d9ed6ab2df None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:45.403673 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 632/1279] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:45.410471 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709fd13-e089-489a-a645-a6d3c47cfe17 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:45.445858 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:45.513698 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709fd13-e089-489a-a645-a6d3c47cfe17 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:45.547928 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d954ff1-71fe-461a-9857-dae007a2af18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:45.548721 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d954ff1-71fe-461a-9857-dae007a2af18 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:45.549006 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d954ff1-71fe-461a-9857-dae007a2af18 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:45.549280 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d954ff1-71fe-461a-9857-dae007a2af18 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:45.557629 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d954ff1-71fe-461a-9857-dae007a2af18 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:45.559081 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d954ff1-71fe-461a-9857-dae007a2af18 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:45.574081 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-7d954ff1-71fe-461a-9857-dae007a2af18 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 08:35:45.574081 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:45.574081 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:35:45.574081 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:35:45.574081 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:35:45.574081 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:35:45.574081 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:35:45.574081 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:35:45.574081 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:35:45.574081 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:35:45.574081 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:35:45.574081 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:35:45.574081 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 08:35:45.574081 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 08:35:45.574081 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 08:35:45.574081 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 08:35:45.575196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:35:45.575196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:35:45.575196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 08:35:45.575196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:35:45.575196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 08:35:45.575196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 08:35:45.575196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:35:45.575196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:35:45.575196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:35:45.575196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:35:45.575196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:35:45.575196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:35:45.575196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:35:45.575196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:35:45.575196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:35:45.575196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:35:45.575196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:35:45.575196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:35:45.576410 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:35:45.576410 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:35:45.576410 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 08:35:45.576410 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 08:35:45.576410 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 08:35:45.576410 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 08:35:45.576410 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 08:35:45.576410 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 08:35:45.576410 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 08:35:45.576410 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:35:45.576410 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 648/1280] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:35:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:35:45.581830 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398efdc-379e-4300-a2d4-29d9ed6ab2df None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:45.585766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:45.679635 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398efdc-379e-4300-a2d4-29d9ed6ab2df None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:45.715320 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ff02c-5a6b-4131-b40b-9b75eac9c9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:45.716021 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ff02c-5a6b-4131-b40b-9b75eac9c9b1 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:45.716303 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ff02c-5a6b-4131-b40b-9b75eac9c9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:45.716578 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ff02c-5a6b-4131-b40b-9b75eac9c9b1 None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:45.717415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ff02c-5a6b-4131-b40b-9b75eac9c9b1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:45.717721 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ff02c-5a6b-4131-b40b-9b75eac9c9b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:45.719720 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ff02c-5a6b-4131-b40b-9b75eac9c9b1 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:45.736946 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 633/1281] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Jul 25 08:35:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:45.742806 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d954ff1-71fe-461a-9857-dae007a2af18 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:45.833685 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:45.843103 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d954ff1-71fe-461a-9857-dae007a2af18 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:45.876030 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33714bfe-3adb-4d0a-aaee-5e6a583e0732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:45.876668 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33714bfe-3adb-4d0a-aaee-5e6a583e0732 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:45.876954 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33714bfe-3adb-4d0a-aaee-5e6a583e0732 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:45.877243 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33714bfe-3adb-4d0a-aaee-5e6a583e0732 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:45.952746 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33714bfe-3adb-4d0a-aaee-5e6a583e0732 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:45.954411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33714bfe-3adb-4d0a-aaee-5e6a583e0732 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:46.040007 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:46.050307 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 649/1282] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 08:35:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 08:35:46.056274 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ff02c-5a6b-4131-b40b-9b75eac9c9b1 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:46.117080 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:46.153532 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ff02c-5a6b-4131-b40b-9b75eac9c9b1 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:46.192107 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045dbd4f-0272-48da-a7c0-e9e3202e34e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:46.192883 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045dbd4f-0272-48da-a7c0-e9e3202e34e4 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:46.193168 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045dbd4f-0272-48da-a7c0-e9e3202e34e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:46.193445 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045dbd4f-0272-48da-a7c0-e9e3202e34e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:46.203831 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045dbd4f-0272-48da-a7c0-e9e3202e34e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:46.205034 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045dbd4f-0272-48da-a7c0-e9e3202e34e4 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:46.222890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-045dbd4f-0272-48da-a7c0-e9e3202e34e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:35:46.222890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:46.222890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:35:46.222890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:35:46.222890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:35:46.222890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:35:46.222890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:35:46.222890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:35:46.222890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:35:46.222890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:35:46.222890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:35:46.222890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:35:46.222890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 08:35:46.222890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 08:35:46.222890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 08:35:46.223967 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 08:35:46.223967 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:35:46.223967 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:35:46.223967 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:35:46.223967 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:35:46.223967 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:35:46.223967 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:35:46.223967 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:35:46.223967 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:35:46.223967 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:35:46.223967 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:35:46.223967 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:35:46.223967 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:35:46.223967 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:35:46.223967 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:35:46.223967 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:35:46.223967 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:35:46.225029 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 08:35:46.225029 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 08:35:46.225029 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 08:35:46.225029 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:35:46.225029 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 634/1283] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:35:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:35:46.229896 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33714bfe-3adb-4d0a-aaee-5e6a583e0732 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:46.326590 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33714bfe-3adb-4d0a-aaee-5e6a583e0732 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:46.361335 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f76bc4-c445-4d49-9a45-392bfe93ff27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:46.361992 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f76bc4-c445-4d49-9a45-392bfe93ff27 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:46.362278 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f76bc4-c445-4d49-9a45-392bfe93ff27 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:46.362552 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f76bc4-c445-4d49-9a45-392bfe93ff27 None admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:46.363267 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f76bc4-c445-4d49-9a45-392bfe93ff27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:46.363575 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f76bc4-c445-4d49-9a45-392bfe93ff27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:46.364964 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f76bc4-c445-4d49-9a45-392bfe93ff27 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:46.376002 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 650/1284] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 08:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:46.381900 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045dbd4f-0272-48da-a7c0-e9e3202e34e4 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:46.479954 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045dbd4f-0272-48da-a7c0-e9e3202e34e4 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:46.494519 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:46.514028 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b71ce0-9c7b-4aaf-a22e-c37b375ffe10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:46.514812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b71ce0-9c7b-4aaf-a22e-c37b375ffe10 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:46.515098 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b71ce0-9c7b-4aaf-a22e-c37b375ffe10 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:46.515372 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b71ce0-9c7b-4aaf-a22e-c37b375ffe10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:46.522325 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b71ce0-9c7b-4aaf-a22e-c37b375ffe10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:46.523819 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b71ce0-9c7b-4aaf-a22e-c37b375ffe10 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:46.539402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-95b71ce0-9c7b-4aaf-a22e-c37b375ffe10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:35:46.539402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:46.539402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:35:46.539402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:35:46.539402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:35:46.539402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:35:46.539402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:35:46.539402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:35:46.539402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:35:46.539402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:35:46.539402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:35:46.539402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:35:46.539402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 08:35:46.539402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 08:35:46.539402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 08:35:46.540477 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 08:35:46.540477 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:35:46.540477 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:35:46.540477 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:35:46.540477 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:35:46.540477 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:35:46.540477 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:35:46.540477 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:35:46.540477 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jul 25 08:35:46.540477 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:35:46.540477 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:35:46.540477 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:35:46.540477 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:35:46.540477 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:35:46.540477 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:35:46.540477 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:35:46.540477 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:35:46.541585 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 08:35:46.541585 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 08:35:46.541585 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 08:35:46.541585 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 08:35:46.541585 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 08:35:46.541585 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 08:35:46.541585 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 08:35:46.541585 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jul 25 08:35:46.541585 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 635/1285] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 08:35:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 08:35:46.546698 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f76bc4-c445-4d49-9a45-392bfe93ff27 None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:46.597828 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:46.649261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f76bc4-c445-4d49-9a45-392bfe93ff27 None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:46.682358 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdcfc6b-08d1-4fce-b3ee-64400e2e504b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:46.683056 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcfc6b-08d1-4fce-b3ee-64400e2e504b None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:46.683341 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcfc6b-08d1-4fce-b3ee-64400e2e504b None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:46.683644 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcfc6b-08d1-4fce-b3ee-64400e2e504b None admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:46.684422 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdcfc6b-08d1-4fce-b3ee-64400e2e504b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:46.684729 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdcfc6b-08d1-4fce-b3ee-64400e2e504b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:46.686155 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdcfc6b-08d1-4fce-b3ee-64400e2e504b None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:46.700578 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 651/1286] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 08:35:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:46.707146 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b71ce0-9c7b-4aaf-a22e-c37b375ffe10 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:46.805892 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b71ce0-9c7b-4aaf-a22e-c37b375ffe10 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:46.840787 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa665824-5703-4503-8c01-20a749860059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:46.841429 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa665824-5703-4503-8c01-20a749860059 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:46.841712 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa665824-5703-4503-8c01-20a749860059 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:46.841983 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa665824-5703-4503-8c01-20a749860059 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:46.842811 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa665824-5703-4503-8c01-20a749860059 None admin] RBAC: Adding query filter params (role.id=25b0f48c10474bf6b98aad8f093868ee, scope.project.id=be349194440449209f19f6b535ffd4f6, user.id=dfb4be75496444dd897b880c2ac3e67e) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:46.843243 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa665824-5703-4503-8c01-20a749860059 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:46.845302 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa665824-5703-4503-8c01-20a749860059 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:46.852880 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 636/1287] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 08:35:46 2022] GET /identity/v3/role_assignments?user.id=dfb4be75496444dd897b880c2ac3e67e&scope.project.id=be349194440449209f19f6b535ffd4f6&role.id=25b0f48c10474bf6b98aad8f093868ee => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:35:48.897545 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f34b1b-dff6-440d-ae22-645e296a25d8 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:48.898077 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f34b1b-dff6-440d-ae22-645e296a25d8 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:48.898165 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f34b1b-dff6-440d-ae22-645e296a25d8 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:48.899498 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 652/1288] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:35:48.905026 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322c662-3f72-4d3f-8582-30cf7842284d None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:48.905463 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322c662-3f72-4d3f-8582-30cf7842284d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:48.905575 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322c662-3f72-4d3f-8582-30cf7842284d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:48.924264 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-2322c662-3f72-4d3f-8582-30cf7842284d None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:35:48.925496 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-2322c662-3f72-4d3f-8582-30cf7842284d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:48.954971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:48.991791 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 637/1289] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:35:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:35:49.013682 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f34b1b-dff6-440d-ae22-645e296a25d8 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:49.114825 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f34b1b-dff6-440d-ae22-645e296a25d8 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:49.126086 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:49.149174 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af536c5-920f-45b5-b781-4bc9c1d6ff7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:49.149958 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af536c5-920f-45b5-b781-4bc9c1d6ff7f None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:49.150241 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af536c5-920f-45b5-b781-4bc9c1d6ff7f None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:49.150519 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af536c5-920f-45b5-b781-4bc9c1d6ff7f None admin] PATH_INFO: `/v3/services/placement` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:49.151161 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af536c5-920f-45b5-b781-4bc9c1d6ff7f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:49.152547 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af536c5-920f-45b5-b781-4bc9c1d6ff7f None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:49.165844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-6af536c5-920f-45b5-b781-4bc9c1d6ff7f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 08:35:49.165844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:49.165844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:35:49.165844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:35:49.165844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:35:49.165844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:35:49.165844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:35:49.165844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:35:49.165844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 08:35:49.165844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:35:49.165844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:35:49.165844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:35:49.165844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:49.165844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:35:49.165844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:35:49.165844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:35:49.165844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:35:49.169451 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:35:49.169451 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:35:49.169451 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:35:49.169451 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:35:49.169451 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:35:49.169451 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:35:49.169451 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:35:49.169451 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:35:49.169451 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:35:49.169451 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:35:49.169451 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:35:49.169451 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:35:49.169451 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:35:49.169451 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:35:49.169451 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:35:49.169451 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:35:49.170515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:35:49.170515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:35:49.170515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:35:49.170515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:35:49.170515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:35:49.170515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:35:49.170515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:35:49.170515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:35:49.170515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:35:49.170515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:35:49.170515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:35:49.170515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:35:49.170515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 08:35:49.170515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:35:49.170515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 653/1290] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Jul 25 08:35:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:35:49.173654 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322c662-3f72-4d3f-8582-30cf7842284d None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:49.269362 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322c662-3f72-4d3f-8582-30cf7842284d None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:49.302546 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a66a1-fde9-4449-a293-967e03d82a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:49.303202 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a66a1-fde9-4449-a293-967e03d82a0a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:49.303490 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a66a1-fde9-4449-a293-967e03d82a0a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:49.303796 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a66a1-fde9-4449-a293-967e03d82a0a None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:49.304506 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a66a1-fde9-4449-a293-967e03d82a0a None admin] RBAC: Adding query filter params (name=placement) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:49.304813 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a66a1-fde9-4449-a293-967e03d82a0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:49.306170 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a66a1-fde9-4449-a293-967e03d82a0a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:49.310924 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 638/1291] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Jul 25 08:35:49 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:49.317480 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af536c5-920f-45b5-b781-4bc9c1d6ff7f None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:49.421275 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af536c5-920f-45b5-b781-4bc9c1d6ff7f None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:49.455307 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab9e1a-dd83-49f1-b48e-d50d3aaee975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:49.455993 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab9e1a-dd83-49f1-b48e-d50d3aaee975 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:49.456283 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab9e1a-dd83-49f1-b48e-d50d3aaee975 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:49.456573 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab9e1a-dd83-49f1-b48e-d50d3aaee975 None admin] PATH_INFO: `/v3/services` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:49.457276 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab9e1a-dd83-49f1-b48e-d50d3aaee975 None admin] RBAC: Adding query filter params (type=placement) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:49.457585 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab9e1a-dd83-49f1-b48e-d50d3aaee975 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:49.459059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab9e1a-dd83-49f1-b48e-d50d3aaee975 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:49.463966 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 654/1292] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Jul 25 08:35:49 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:51.477673 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb0013-c87b-4bd8-afb0-6fa146ce40d9 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:51.478206 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb0013-c87b-4bd8-afb0-6fa146ce40d9 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:51.478294 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb0013-c87b-4bd8-afb0-6fa146ce40d9 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:51.479630 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 639/1293] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:35:51.485579 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87ee85-aea4-4fcc-9b1f-cfda5c1b66d8 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:51.486027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87ee85-aea4-4fcc-9b1f-cfda5c1b66d8 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:51.486122 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87ee85-aea4-4fcc-9b1f-cfda5c1b66d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:51.504239 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-7a87ee85-aea4-4fcc-9b1f-cfda5c1b66d8 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:35:51.505444 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-7a87ee85-aea4-4fcc-9b1f-cfda5c1b66d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:51.535393 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:51.571310 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 655/1294] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:35:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:35:51.593192 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb0013-c87b-4bd8-afb0-6fa146ce40d9 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:51.625443 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:51.696176 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb0013-c87b-4bd8-afb0-6fa146ce40d9 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:51.729824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce806fe1-b9d1-474c-80a8-34c128dd6753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:51.730417 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce806fe1-b9d1-474c-80a8-34c128dd6753 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:51.730697 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce806fe1-b9d1-474c-80a8-34c128dd6753 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:51.730972 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce806fe1-b9d1-474c-80a8-34c128dd6753 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:51.731730 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce806fe1-b9d1-474c-80a8-34c128dd6753 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:51.733083 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce806fe1-b9d1-474c-80a8-34c128dd6753 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:51.809682 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 640/1295] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jul 25 08:35:51 2022] POST /identity/v3/services => generated 246 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:35:53.811920 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c018c5-b6e6-4a42-8501-80a022de4c71 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:53.813199 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c018c5-b6e6-4a42-8501-80a022de4c71 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:53.813537 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c018c5-b6e6-4a42-8501-80a022de4c71 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:53.814974 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 656/1296] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:35:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:35:53.820121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c4346-6265-4172-a238-15d808822e38 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:53.820533 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c4346-6265-4172-a238-15d808822e38 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:53.820685 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c4346-6265-4172-a238-15d808822e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:53.839103 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-341c4346-6265-4172-a238-15d808822e38 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:35:53.840330 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-341c4346-6265-4172-a238-15d808822e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:53.917940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 641/1297] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:35:53 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:35:53.941689 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c018c5-b6e6-4a42-8501-80a022de4c71 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:54.042527 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c018c5-b6e6-4a42-8501-80a022de4c71 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:54.075365 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe62c8-4d37-4f3b-85fc-eb7517342aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:54.076187 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe62c8-4d37-4f3b-85fc-eb7517342aff None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:54.076474 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe62c8-4d37-4f3b-85fc-eb7517342aff None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:54.076753 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe62c8-4d37-4f3b-85fc-eb7517342aff None admin] PATH_INFO: `/v3/services/placement` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:54.077403 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe62c8-4d37-4f3b-85fc-eb7517342aff None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:54.079334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe62c8-4d37-4f3b-85fc-eb7517342aff None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:54.091044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-0ebe62c8-4d37-4f3b-85fc-eb7517342aff None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 08:35:54.091044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:54.091044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:35:54.091044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:35:54.091044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:35:54.091044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:35:54.091044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:35:54.091044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:35:54.091044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 08:35:54.091044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:35:54.091044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:35:54.091044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:35:54.091044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:54.091044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:35:54.091044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:35:54.091044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:35:54.091044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:35:54.092325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:35:54.092325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:35:54.092325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:35:54.092325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:35:54.092325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:35:54.092325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:35:54.092325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:35:54.092325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:35:54.092325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:35:54.092325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:35:54.092325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:35:54.092325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:35:54.092325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:35:54.092325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:35:54.092325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:35:54.092325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:35:54.093157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:35:54.093157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:35:54.093157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:35:54.093157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:35:54.093157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:35:54.093157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:35:54.093157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:35:54.093157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:35:54.093157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:35:54.093157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:35:54.093157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:35:54.093157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:35:54.093157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 08:35:54.093157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:35:54.093157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 657/1298] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Jul 25 08:35:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:35:54.099266 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c4346-6265-4172-a238-15d808822e38 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:54.117154 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:54.197204 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c4346-6265-4172-a238-15d808822e38 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:54.231032 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972fe02-a9a4-4274-a629-7f3a5b3ec05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:54.231724 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972fe02-a9a4-4274-a629-7f3a5b3ec05d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:54.232017 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972fe02-a9a4-4274-a629-7f3a5b3ec05d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:54.232300 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972fe02-a9a4-4274-a629-7f3a5b3ec05d None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:54.233011 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6972fe02-a9a4-4274-a629-7f3a5b3ec05d None admin] RBAC: Adding query filter params (name=placement) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:54.233323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6972fe02-a9a4-4274-a629-7f3a5b3ec05d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:54.234747 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6972fe02-a9a4-4274-a629-7f3a5b3ec05d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:54.239753 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 642/1299] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Jul 25 08:35:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:54.245774 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe62c8-4d37-4f3b-85fc-eb7517342aff None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:54.276537 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:54.343835 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe62c8-4d37-4f3b-85fc-eb7517342aff None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:54.377160 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b53a94-3ea6-4353-8180-5f52459876a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:54.377804 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b53a94-3ea6-4353-8180-5f52459876a9 None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:54.378087 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b53a94-3ea6-4353-8180-5f52459876a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:54.378363 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b53a94-3ea6-4353-8180-5f52459876a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:54.379147 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b53a94-3ea6-4353-8180-5f52459876a9 None admin] RBAC: Adding query filter params (interface=public, service_id=612b6dd1ccf44908898d01aa57ef380e, region_id=RegionOne) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:54.379461 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b53a94-3ea6-4353-8180-5f52459876a9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:54.380862 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b53a94-3ea6-4353-8180-5f52459876a9 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:54.385772 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 658/1300] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Jul 25 08:35:54 2022] GET /identity/v3/endpoints?service_id=612b6dd1ccf44908898d01aa57ef380e&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:35:54.391606 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972fe02-a9a4-4274-a629-7f3a5b3ec05d None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:54.473472 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:54.491452 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972fe02-a9a4-4274-a629-7f3a5b3ec05d None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:54.525323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475d6ef-9ef1-443d-ba59-bec914251898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:54.525969 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475d6ef-9ef1-443d-ba59-bec914251898 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:54.526254 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475d6ef-9ef1-443d-ba59-bec914251898 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:54.526531 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475d6ef-9ef1-443d-ba59-bec914251898 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:54.527205 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0475d6ef-9ef1-443d-ba59-bec914251898 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:54.528614 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0475d6ef-9ef1-443d-ba59-bec914251898 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:54.536325 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 643/1301] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Jul 25 08:35:54 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:35:56.534721 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ece5f-d249-42e5-985d-567b063c2c81 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:56.535305 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ece5f-d249-42e5-985d-567b063c2c81 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:56.535305 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ece5f-d249-42e5-985d-567b063c2c81 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:56.536683 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 659/1302] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:35:56.541760 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8cbe0d-4e6e-4264-b6f2-dab5a02f4095 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:56.542169 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8cbe0d-4e6e-4264-b6f2-dab5a02f4095 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:56.547337 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8cbe0d-4e6e-4264-b6f2-dab5a02f4095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:56.560689 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-cc8cbe0d-4e6e-4264-b6f2-dab5a02f4095 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:35:56.561874 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-cc8cbe0d-4e6e-4264-b6f2-dab5a02f4095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:35:56.629861 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 644/1303] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:35:56 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 08:35:56.652617 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ece5f-d249-42e5-985d-567b063c2c81 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:56.748952 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:56.756169 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ece5f-d249-42e5-985d-567b063c2c81 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:56.789253 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb7456-1629-46ae-b5dc-6c154e49172e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:56.789990 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb7456-1629-46ae-b5dc-6c154e49172e None admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:56.790275 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb7456-1629-46ae-b5dc-6c154e49172e None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:56.790551 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb7456-1629-46ae-b5dc-6c154e49172e None admin] PATH_INFO: `/v3/services/placement` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:56.791204 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb7456-1629-46ae-b5dc-6c154e49172e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:56.792616 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb7456-1629-46ae-b5dc-6c154e49172e None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:56.804863 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application [None req-70bb7456-1629-46ae-b5dc-6c154e49172e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 08:35:56.804863 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:56.804863 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 08:35:56.804863 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 08:35:56.804863 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 08:35:56.804863 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 08:35:56.804863 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 08:35:56.804863 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:35:56.804863 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 08:35:56.804863 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:35:56.804863 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 08:35:56.804863 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:35:56.804863 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 08:35:56.804863 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 08:35:56.804863 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 08:35:56.804863 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 08:35:56.804863 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 08:35:56.806042 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 08:35:56.806042 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 08:35:56.806042 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 08:35:56.806042 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 08:35:56.806042 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 08:35:56.806042 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 08:35:56.806042 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 08:35:56.806042 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 08:35:56.806042 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 08:35:56.806042 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 08:35:56.806042 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 08:35:56.806042 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 08:35:56.806042 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 08:35:56.806042 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 08:35:56.806042 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 08:35:56.806042 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 08:35:56.807099 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 08:35:56.807099 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application with Lock( Jul 25 08:35:56.807099 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 08:35:56.807099 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self._enter() Jul 25 08:35:56.807099 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 08:35:56.807099 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 08:35:56.807099 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 08:35:56.807099 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application return self.creator() Jul 25 08:35:56.807099 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 08:35:56.807099 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application created_value = creator( Jul 25 08:35:56.807099 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 08:35:56.807099 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 08:35:56.807099 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 08:35:56.807099 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: ERROR keystone.server.flask.application Jul 25 08:35:56.807099 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 660/1304] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Jul 25 08:35:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 08:35:56.813185 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8cbe0d-4e6e-4264-b6f2-dab5a02f4095 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:56.887099 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:35:56.909608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8cbe0d-4e6e-4264-b6f2-dab5a02f4095 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:56.942787 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79101a12-f6e7-4114-a96a-1e2fc8024c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:56.943446 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79101a12-f6e7-4114-a96a-1e2fc8024c6b None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:56.943769 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79101a12-f6e7-4114-a96a-1e2fc8024c6b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:56.944046 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79101a12-f6e7-4114-a96a-1e2fc8024c6b None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:56.944751 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79101a12-f6e7-4114-a96a-1e2fc8024c6b None admin] RBAC: Adding query filter params (name=placement) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:35:56.945057 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79101a12-f6e7-4114-a96a-1e2fc8024c6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:56.946500 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79101a12-f6e7-4114-a96a-1e2fc8024c6b None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:56.951573 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 645/1305] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Jul 25 08:35:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:35:56.958143 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb7456-1629-46ae-b5dc-6c154e49172e None admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:35:57.054719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb7456-1629-46ae-b5dc-6c154e49172e None admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:35:57.087296 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1de1e-19c4-45bf-ba9c-1f6d858f4003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:35:57.088000 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1de1e-19c4-45bf-ba9c-1f6d858f4003 None admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:35:57.088279 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1de1e-19c4-45bf-ba9c-1f6d858f4003 None admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:35:57.088554 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1de1e-19c4-45bf-ba9c-1f6d858f4003 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:35:57.089286 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1de1e-19c4-45bf-ba9c-1f6d858f4003 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:35:57.090653 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1de1e-19c4-45bf-ba9c-1f6d858f4003 None admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:35:57.180791 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 661/1306] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:35:56 2022] POST /identity/v3/endpoints => generated 331 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:36:06.948526 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=30 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:36:07.176199 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:41:42.989696 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fea10-6b30-4e25-8cc9-8965f77fb7fc None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:42.991477 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fea10-6b30-4e25-8cc9-8965f77fb7fc None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:42.992468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fea10-6b30-4e25-8cc9-8965f77fb7fc None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:43.002472 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3e207-f324-47ec-9310-9855574e63f5 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:43.002903 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3e207-f324-47ec-9310-9855574e63f5 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:43.003301 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3e207-f324-47ec-9310-9855574e63f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:43.006116 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 646/1307] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:41:42 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:41:43.137575 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-fdb3e207-f324-47ec-9310-9855574e63f5 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:41:43.138946 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-fdb3e207-f324-47ec-9310-9855574e63f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:43.272911 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 662/1308] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:41:43.329489 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181b290-0f6d-4f00-bbcf-c832a6cfed49 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:43.330214 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181b290-0f6d-4f00-bbcf-c832a6cfed49 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:43.330745 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181b290-0f6d-4f00-bbcf-c832a6cfed49 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:43.336337 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 647/1309] 10.222.0.18 () {54 vars in 965 bytes} [Mon Jul 25 08:41:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:41:43.346341 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e229d-4aca-4584-9e34-9cf35962c22c None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:43.346637 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e229d-4aca-4584-9e34-9cf35962c22c None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:43.347165 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e229d-4aca-4584-9e34-9cf35962c22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:43.441657 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-b66e229d-4aca-4584-9e34-9cf35962c22c None None] MFA Rules not processed for user `a08bd52110074f11ba56b2f02397062f`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:41:43.442985 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-b66e229d-4aca-4584-9e34-9cf35962c22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:43.468527 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:41:43.531597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 663/1310] 10.222.0.18 () {58 vars in 1062 bytes} [Mon Jul 25 08:41:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:41:43.542381 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181b290-0f6d-4f00-bbcf-c832a6cfed49 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:41:43.544586 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-3181b290-0f6d-4f00-bbcf-c832a6cfed49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:43.676300 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181b290-0f6d-4f00-bbcf-c832a6cfed49 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:41:43.757673 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49c423-153a-4750-aba9-f29560a8bf24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:41:43.759353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49c423-153a-4750-aba9-f29560a8bf24 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:43.759811 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49c423-153a-4750-aba9-f29560a8bf24 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:43.760245 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49c423-153a-4750-aba9-f29560a8bf24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:43.762044 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-2b49c423-153a-4750-aba9-f29560a8bf24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:43.822382 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:41:43.882766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49c423-153a-4750-aba9-f29560a8bf24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:41:43.885377 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49c423-153a-4750-aba9-f29560a8bf24 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:41:43.906485 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 648/1311] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:41:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:41:46.264528 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a8d15-65c1-4170-b43d-ea07b7d20f47 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:46.265189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a8d15-65c1-4170-b43d-ea07b7d20f47 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:46.265189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a8d15-65c1-4170-b43d-ea07b7d20f47 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:46.266653 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 664/1312] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:41:46.271723 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cc3ae-c8f7-4d13-98df-94a384d2c69c None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:46.272191 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cc3ae-c8f7-4d13-98df-94a384d2c69c None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:46.272383 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cc3ae-c8f7-4d13-98df-94a384d2c69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:46.354006 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-e74cc3ae-c8f7-4d13-98df-94a384d2c69c None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:41:46.355209 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-e74cc3ae-c8f7-4d13-98df-94a384d2c69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:46.452279 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 649/1313] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:41:46.491045 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a8d15-65c1-4170-b43d-ea07b7d20f47 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:41:46.492643 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-df9a8d15-65c1-4170-b43d-ea07b7d20f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:46.596389 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a8d15-65c1-4170-b43d-ea07b7d20f47 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:41:46.668903 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:41:46.671187 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3af089-7a9e-4399-8028-915f62e4499d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:41:46.671856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3af089-7a9e-4399-8028-915f62e4499d service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:46.672138 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3af089-7a9e-4399-8028-915f62e4499d service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:46.672409 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3af089-7a9e-4399-8028-915f62e4499d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:46.674029 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-6f3af089-7a9e-4399-8028-915f62e4499d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:46.794610 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3af089-7a9e-4399-8028-915f62e4499d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:41:46.796138 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3af089-7a9e-4399-8028-915f62e4499d service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:41:46.816279 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 665/1314] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:41:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:41:49.341144 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bec1d6-b856-4510-bc75-c48a9726fd51 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:49.341701 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bec1d6-b856-4510-bc75-c48a9726fd51 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:49.341701 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bec1d6-b856-4510-bc75-c48a9726fd51 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:49.343074 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 650/1315] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:41:49.348241 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1655442-6204-4e8f-b350-2412d89ac116 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:49.348664 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1655442-6204-4e8f-b350-2412d89ac116 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:49.348797 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1655442-6204-4e8f-b350-2412d89ac116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:49.412568 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-e1655442-6204-4e8f-b350-2412d89ac116 None None] MFA Rules not processed for user `465479e39e5141f68f4d110bd7aff569`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:41:49.414637 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-e1655442-6204-4e8f-b350-2412d89ac116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:49.465239 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:41:49.509261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 666/1316] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:41:49 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:41:49.549525 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bec1d6-b856-4510-bc75-c48a9726fd51 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:41:49.551061 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d7bec1d6-b856-4510-bc75-c48a9726fd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:49.560774 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:41:49.653539 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bec1d6-b856-4510-bc75-c48a9726fd51 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:41:49.726972 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f629e9e-eda8-462f-9cfb-b46f0be94031 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:41:49.727649 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f629e9e-eda8-462f-9cfb-b46f0be94031 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:49.727942 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f629e9e-eda8-462f-9cfb-b46f0be94031 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:49.728221 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f629e9e-eda8-462f-9cfb-b46f0be94031 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:49.730663 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-1f629e9e-eda8-462f-9cfb-b46f0be94031 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:49.793150 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:41:49.840304 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f629e9e-eda8-462f-9cfb-b46f0be94031 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:41:49.841745 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f629e9e-eda8-462f-9cfb-b46f0be94031 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:41:49.862098 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 651/1317] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:41:49 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:41:52.689390 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a94b90-11bc-4798-8972-faff1bfd5e1d None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:52.689959 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a94b90-11bc-4798-8972-faff1bfd5e1d None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:52.689959 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a94b90-11bc-4798-8972-faff1bfd5e1d None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:52.691312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 667/1318] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:41:52.696376 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c924890-03c1-47a3-b173-8b90efabba4e None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:52.696788 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c924890-03c1-47a3-b173-8b90efabba4e None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:52.696942 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c924890-03c1-47a3-b173-8b90efabba4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:52.762611 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-5c924890-03c1-47a3-b173-8b90efabba4e None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:41:52.763861 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-5c924890-03c1-47a3-b173-8b90efabba4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:52.864837 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 652/1319] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:41:52 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:41:52.903431 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a94b90-11bc-4798-8972-faff1bfd5e1d None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:41:52.904985 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-f6a94b90-11bc-4798-8972-faff1bfd5e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:53.006899 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a94b90-11bc-4798-8972-faff1bfd5e1d None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:41:53.078783 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f97ad-41ce-4500-a2e4-222c777930a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:41:53.079429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f97ad-41ce-4500-a2e4-222c777930a9 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:53.079747 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f97ad-41ce-4500-a2e4-222c777930a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:53.080037 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f97ad-41ce-4500-a2e4-222c777930a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:53.081680 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-688f97ad-41ce-4500-a2e4-222c777930a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:53.090029 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:41:53.190573 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f97ad-41ce-4500-a2e4-222c777930a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:41:53.192081 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f97ad-41ce-4500-a2e4-222c777930a9 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:41:53.209869 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 668/1320] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:41:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:41:56.160897 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dc073-7ede-42d5-80a7-1e9de25de270 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:56.161393 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dc073-7ede-42d5-80a7-1e9de25de270 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:56.161393 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dc073-7ede-42d5-80a7-1e9de25de270 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:56.162776 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 653/1321] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:41:56.169402 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8417c-48f0-4f69-8175-2f549ffa4f0d None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:56.169850 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8417c-48f0-4f69-8175-2f549ffa4f0d None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:56.170100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8417c-48f0-4f69-8175-2f549ffa4f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:56.235291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-20a8417c-48f0-4f69-8175-2f549ffa4f0d None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:41:56.236530 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-20a8417c-48f0-4f69-8175-2f549ffa4f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:56.293465 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:41:56.333982 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 669/1322] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:41:56.370203 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8dc073-7ede-42d5-80a7-1e9de25de270 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:41:56.371818 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-3e8dc073-7ede-42d5-80a7-1e9de25de270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:56.391886 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:41:56.482735 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8dc073-7ede-42d5-80a7-1e9de25de270 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:41:56.559776 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8b26b-de61-4aa1-ab3f-271e822628fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:41:56.560434 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8b26b-de61-4aa1-ab3f-271e822628fb service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:56.560713 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8b26b-de61-4aa1-ab3f-271e822628fb service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:56.560987 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8b26b-de61-4aa1-ab3f-271e822628fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:56.562663 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-aec8b26b-de61-4aa1-ab3f-271e822628fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:56.639482 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:41:56.676597 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8b26b-de61-4aa1-ab3f-271e822628fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:41:56.678035 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8b26b-de61-4aa1-ab3f-271e822628fb service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:41:56.695986 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 654/1323] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:41:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:41:58.765011 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec38351-cbd5-46b0-9fb6-6476c89fbf5d None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:58.765560 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec38351-cbd5-46b0-9fb6-6476c89fbf5d None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:58.765560 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec38351-cbd5-46b0-9fb6-6476c89fbf5d None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:58.767080 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 670/1324] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:41:58.772168 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf4ea2-072b-4ec6-aad5-74b8f9f3a551 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:58.772563 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf4ea2-072b-4ec6-aad5-74b8f9f3a551 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:58.772730 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf4ea2-072b-4ec6-aad5-74b8f9f3a551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:58.842271 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-10cf4ea2-072b-4ec6-aad5-74b8f9f3a551 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:41:58.843533 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-10cf4ea2-072b-4ec6-aad5-74b8f9f3a551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:58.942778 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 655/1325] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:41:58.996154 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec7cbb-c029-49b5-8c38-8668cfdaf9f1 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:58.996443 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec7cbb-c029-49b5-8c38-8668cfdaf9f1 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:58.996720 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec7cbb-c029-49b5-8c38-8668cfdaf9f1 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:58.998094 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 671/1326] 10.222.0.18 () {54 vars in 965 bytes} [Mon Jul 25 08:41:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:41:59.004208 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59721610-29ff-4a30-a621-347a3b436fa4 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:59.004504 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59721610-29ff-4a30-a621-347a3b436fa4 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:59.004839 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59721610-29ff-4a30-a621-347a3b436fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:59.036765 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:41:59.082600 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-59721610-29ff-4a30-a621-347a3b436fa4 None None] MFA Rules not processed for user `a08bd52110074f11ba56b2f02397062f`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:41:59.083852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-59721610-29ff-4a30-a621-347a3b436fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:59.160254 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 656/1327] 10.222.0.18 () {58 vars in 1062 bytes} [Mon Jul 25 08:41:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:41:59.169893 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec7cbb-c029-49b5-8c38-8668cfdaf9f1 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:41:59.171405 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-3cec7cbb-c029-49b5-8c38-8668cfdaf9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:59.277138 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec7cbb-c029-49b5-8c38-8668cfdaf9f1 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:41:59.356180 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35230d5-a744-4d35-9dfb-5e35a8607918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:41:59.356827 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35230d5-a744-4d35-9dfb-5e35a8607918 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:41:59.357111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35230d5-a744-4d35-9dfb-5e35a8607918 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:41:59.357387 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35230d5-a744-4d35-9dfb-5e35a8607918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:41:59.359012 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-f35230d5-a744-4d35-9dfb-5e35a8607918 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:41:59.376230 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:41:59.471108 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35230d5-a744-4d35-9dfb-5e35a8607918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:41:59.472569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35230d5-a744-4d35-9dfb-5e35a8607918 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:41:59.491260 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 672/1328] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:41:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:42:01.744149 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11046f-1e74-4649-a7c6-21592a4a2b2b None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:01.745275 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11046f-1e74-4649-a7c6-21592a4a2b2b None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:01.745416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11046f-1e74-4649-a7c6-21592a4a2b2b None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:01.746982 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 657/1329] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:42:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:42:01.753013 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff3e6b-63c5-4755-a0e8-0e219143973e None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:01.753554 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff3e6b-63c5-4755-a0e8-0e219143973e None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:01.753554 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff3e6b-63c5-4755-a0e8-0e219143973e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:01.826138 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-f1ff3e6b-63c5-4755-a0e8-0e219143973e None None] MFA Rules not processed for user `465479e39e5141f68f4d110bd7aff569`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:42:01.827344 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-f1ff3e6b-63c5-4755-a0e8-0e219143973e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:01.890544 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:01.922526 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 673/1330] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:42:01 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:42:01.960095 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11046f-1e74-4649-a7c6-21592a4a2b2b None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:42:01.961641 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0c11046f-1e74-4649-a7c6-21592a4a2b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:02.069422 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11046f-1e74-4649-a7c6-21592a4a2b2b None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:42:02.089598 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:02.157239 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d47f4-7f0f-4409-93e0-f048bd40a022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:42:02.157902 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d47f4-7f0f-4409-93e0-f048bd40a022 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:02.158187 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d47f4-7f0f-4409-93e0-f048bd40a022 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:02.158466 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d47f4-7f0f-4409-93e0-f048bd40a022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:02.160452 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6d4d47f4-7f0f-4409-93e0-f048bd40a022 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:02.278894 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d47f4-7f0f-4409-93e0-f048bd40a022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:42:02.280357 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d47f4-7f0f-4409-93e0-f048bd40a022 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:42:02.299337 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 658/1331] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:42:01 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:42:04.890408 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc0766-ea6e-4dc5-bd27-7af0c0decaf7 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:04.890961 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc0766-ea6e-4dc5-bd27-7af0c0decaf7 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:04.890961 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc0766-ea6e-4dc5-bd27-7af0c0decaf7 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:04.892414 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 674/1332] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:42:04.897499 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a19fb-faf3-4b63-b23e-864606dbe95f None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:04.897906 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a19fb-faf3-4b63-b23e-864606dbe95f None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:04.898062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a19fb-faf3-4b63-b23e-864606dbe95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:04.961556 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:04.965084 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-c16a19fb-faf3-4b63-b23e-864606dbe95f None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:42:04.966304 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c16a19fb-faf3-4b63-b23e-864606dbe95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:05.060367 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 659/1333] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:42:05.097627 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc0766-ea6e-4dc5-bd27-7af0c0decaf7 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:42:05.099171 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-f2bc0766-ea6e-4dc5-bd27-7af0c0decaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:05.204403 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc0766-ea6e-4dc5-bd27-7af0c0decaf7 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:42:05.277248 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582c30c-d8cf-41b9-a880-52d1b4edc19b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:42:05.277898 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582c30c-d8cf-41b9-a880-52d1b4edc19b service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:05.278179 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582c30c-d8cf-41b9-a880-52d1b4edc19b service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:05.278455 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582c30c-d8cf-41b9-a880-52d1b4edc19b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:05.280133 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-d582c30c-d8cf-41b9-a880-52d1b4edc19b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:05.307504 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:05.390325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582c30c-d8cf-41b9-a880-52d1b4edc19b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:42:05.391822 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582c30c-d8cf-41b9-a880-52d1b4edc19b service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:42:05.410397 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 675/1334] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:42:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:42:07.435356 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6463a-4191-44da-b320-d8ac573df8bb None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:07.435992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6463a-4191-44da-b320-d8ac573df8bb None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:07.435992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6463a-4191-44da-b320-d8ac573df8bb None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:07.437245 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 660/1335] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:42:07.442271 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23be44-0bea-433d-86e5-686d736c67f0 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:07.442662 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23be44-0bea-433d-86e5-686d736c67f0 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:07.442829 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23be44-0bea-433d-86e5-686d736c67f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:07.507621 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-2c23be44-0bea-433d-86e5-686d736c67f0 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:42:07.508831 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-2c23be44-0bea-433d-86e5-686d736c67f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:07.581613 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:07.603362 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 676/1336] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:42:07.644088 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6463a-4191-44da-b320-d8ac573df8bb None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:42:07.645617 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-07d6463a-4191-44da-b320-d8ac573df8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:07.748897 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6463a-4191-44da-b320-d8ac573df8bb None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:42:07.777576 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:07.823403 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07068d2b-280d-4ce3-b31a-a0d323e43ec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:42:07.824099 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07068d2b-280d-4ce3-b31a-a0d323e43ec8 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:07.824386 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07068d2b-280d-4ce3-b31a-a0d323e43ec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:07.824665 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07068d2b-280d-4ce3-b31a-a0d323e43ec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:07.826299 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-07068d2b-280d-4ce3-b31a-a0d323e43ec8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:07.934511 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07068d2b-280d-4ce3-b31a-a0d323e43ec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:42:07.935986 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07068d2b-280d-4ce3-b31a-a0d323e43ec8 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:42:07.955165 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 661/1337] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:42:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:42:10.644136 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32b366-fb27-4da7-959c-7dde38ced766 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:10.644674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32b366-fb27-4da7-959c-7dde38ced766 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:10.644771 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32b366-fb27-4da7-959c-7dde38ced766 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:10.646168 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 677/1338] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:42:10.652239 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2500c94-a1d0-4872-a31a-50066d94609f None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:10.652666 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2500c94-a1d0-4872-a31a-50066d94609f None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:10.652810 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2500c94-a1d0-4872-a31a-50066d94609f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:10.719045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-a2500c94-a1d0-4872-a31a-50066d94609f None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:42:10.720303 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a2500c94-a1d0-4872-a31a-50066d94609f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:10.728505 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:10.815273 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 662/1339] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:42:10 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:42:10.851227 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32b366-fb27-4da7-959c-7dde38ced766 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:42:10.852842 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-3a32b366-fb27-4da7-959c-7dde38ced766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:10.955155 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32b366-fb27-4da7-959c-7dde38ced766 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:42:11.027099 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45382e5-6ec0-4bdc-9e9a-b7ebd2dbf2ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:42:11.027773 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45382e5-6ec0-4bdc-9e9a-b7ebd2dbf2ec service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:11.028086 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45382e5-6ec0-4bdc-9e9a-b7ebd2dbf2ec service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:11.028381 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45382e5-6ec0-4bdc-9e9a-b7ebd2dbf2ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:11.030021 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-a45382e5-6ec0-4bdc-9e9a-b7ebd2dbf2ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:11.064546 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:11.136904 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45382e5-6ec0-4bdc-9e9a-b7ebd2dbf2ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:42:11.138369 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45382e5-6ec0-4bdc-9e9a-b7ebd2dbf2ec service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:42:11.156619 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 678/1340] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:42:10 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:42:15.349923 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4ef33-7996-417c-a66d-7a21b2342654 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:15.350467 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4ef33-7996-417c-a66d-7a21b2342654 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:15.350562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4ef33-7996-417c-a66d-7a21b2342654 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:15.352261 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 663/1341] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:42:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:42:15.358466 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef9553-77bc-452a-869b-0434e93f495b None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:15.358946 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef9553-77bc-452a-869b-0434e93f495b None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:15.359248 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef9553-77bc-452a-869b-0434e93f495b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:15.430163 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-29ef9553-77bc-452a-869b-0434e93f495b None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:42:15.431374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-29ef9553-77bc-452a-869b-0434e93f495b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:15.527074 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:15.538716 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 679/1342] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:42:15.577964 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4ef33-7996-417c-a66d-7a21b2342654 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:42:15.579514 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b0c4ef33-7996-417c-a66d-7a21b2342654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:15.684588 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4ef33-7996-417c-a66d-7a21b2342654 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:42:15.723290 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:15.759286 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ae17d-1c5b-471b-b817-55b5886f7e93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:42:15.760676 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ae17d-1c5b-471b-b817-55b5886f7e93 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:15.760966 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ae17d-1c5b-471b-b817-55b5886f7e93 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:15.761262 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ae17d-1c5b-471b-b817-55b5886f7e93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:15.762954 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-1a8ae17d-1c5b-471b-b817-55b5886f7e93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:15.873127 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ae17d-1c5b-471b-b817-55b5886f7e93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:42:15.874549 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ae17d-1c5b-471b-b817-55b5886f7e93 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:42:15.894321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 664/1343] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:42:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:42:18.974301 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85601350-ce5d-4df4-9f0c-cc2e28995cea None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:18.974852 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85601350-ce5d-4df4-9f0c-cc2e28995cea None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:18.974852 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85601350-ce5d-4df4-9f0c-cc2e28995cea None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:18.976233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 680/1344] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:42:18.982471 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f14279-40bb-41ca-abf3-25c37ded8982 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:18.982942 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f14279-40bb-41ca-abf3-25c37ded8982 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:18.983058 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f14279-40bb-41ca-abf3-25c37ded8982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:19.051279 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-29f14279-40bb-41ca-abf3-25c37ded8982 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:42:19.052433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-29f14279-40bb-41ca-abf3-25c37ded8982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:19.070379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:19.151227 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 665/1345] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:42:18 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:42:19.188412 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85601350-ce5d-4df4-9f0c-cc2e28995cea None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:42:19.190138 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-85601350-ce5d-4df4-9f0c-cc2e28995cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:19.294502 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85601350-ce5d-4df4-9f0c-cc2e28995cea None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:42:19.367520 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c8b1d-333f-45f8-9488-31bfbe170476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:42:19.368216 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c8b1d-333f-45f8-9488-31bfbe170476 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:19.368499 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c8b1d-333f-45f8-9488-31bfbe170476 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:19.368776 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c8b1d-333f-45f8-9488-31bfbe170476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:19.370855 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-218c8b1d-333f-45f8-9488-31bfbe170476 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:19.418268 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:19.486045 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c8b1d-333f-45f8-9488-31bfbe170476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:42:19.487494 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c8b1d-333f-45f8-9488-31bfbe170476 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:42:19.506810 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 681/1346] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:42:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:42:23.667374 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898db61b-c2df-4a8a-ab10-6e332f77df48 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:23.667919 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898db61b-c2df-4a8a-ab10-6e332f77df48 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:23.668042 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898db61b-c2df-4a8a-ab10-6e332f77df48 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:23.669393 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 666/1347] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:42:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:42:23.674839 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44784f0-a7e0-44fa-b298-38afc145fa46 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:23.675328 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44784f0-a7e0-44fa-b298-38afc145fa46 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:23.675408 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44784f0-a7e0-44fa-b298-38afc145fa46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:23.748556 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-f44784f0-a7e0-44fa-b298-38afc145fa46 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:42:23.749782 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-f44784f0-a7e0-44fa-b298-38afc145fa46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:23.850680 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:23.853641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 682/1348] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:42:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:42:23.892860 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898db61b-c2df-4a8a-ab10-6e332f77df48 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:42:23.894442 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-898db61b-c2df-4a8a-ab10-6e332f77df48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:24.003253 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898db61b-c2df-4a8a-ab10-6e332f77df48 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:42:24.052953 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:24.080181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe6f17-01d4-4e45-b8a6-52b6bcc688e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:42:24.080842 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe6f17-01d4-4e45-b8a6-52b6bcc688e3 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:24.081330 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe6f17-01d4-4e45-b8a6-52b6bcc688e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:24.081835 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe6f17-01d4-4e45-b8a6-52b6bcc688e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:24.083868 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-aabe6f17-01d4-4e45-b8a6-52b6bcc688e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:24.191619 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe6f17-01d4-4e45-b8a6-52b6bcc688e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:42:24.193074 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe6f17-01d4-4e45-b8a6-52b6bcc688e3 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:42:24.212014 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 667/1349] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:42:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:42:29.243470 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a9403-0f23-43c8-abed-026590ce09d5 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:29.245825 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a9403-0f23-43c8-abed-026590ce09d5 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:29.245825 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a9403-0f23-43c8-abed-026590ce09d5 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:29.246267 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 683/1350] 10.222.0.18 () {54 vars in 921 bytes} [Mon Jul 25 08:42:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:42:29.252934 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f244d43-b19c-48f9-aec8-d5ddb8e06c5c None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:29.253343 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f244d43-b19c-48f9-aec8-d5ddb8e06c5c None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:29.253504 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f244d43-b19c-48f9-aec8-d5ddb8e06c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:29.386348 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-9f244d43-b19c-48f9-aec8-d5ddb8e06c5c None None] MFA Rules not processed for user `dfb4be75496444dd897b880c2ac3e67e`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:42:29.387810 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9f244d43-b19c-48f9-aec8-d5ddb8e06c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:29.409103 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:29.509967 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 668/1351] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Jul 25 08:42:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:42:33.509166 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bc043-fa0e-4eba-844d-28dae70bb1b2 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:33.510215 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bc043-fa0e-4eba-844d-28dae70bb1b2 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:33.510335 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bc043-fa0e-4eba-844d-28dae70bb1b2 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:33.511805 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 684/1352] 10.222.0.18 () {54 vars in 921 bytes} [Mon Jul 25 08:42:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:42:33.516893 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29acc21-e13c-4507-bdc4-5928537762da None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:33.517323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29acc21-e13c-4507-bdc4-5928537762da None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:33.517512 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29acc21-e13c-4507-bdc4-5928537762da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:33.596999 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-c29acc21-e13c-4507-bdc4-5928537762da None None] MFA Rules not processed for user `dfb4be75496444dd897b880c2ac3e67e`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:42:33.598213 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c29acc21-e13c-4507-bdc4-5928537762da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:33.675574 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:33.716944 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 669/1353] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Jul 25 08:42:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:42:35.083021 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061b979-8ba8-4867-9ef7-a3fbab8270c6 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:35.083515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061b979-8ba8-4867-9ef7-a3fbab8270c6 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:35.083515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061b979-8ba8-4867-9ef7-a3fbab8270c6 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:35.084873 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 685/1354] 10.222.0.18 () {54 vars in 921 bytes} [Mon Jul 25 08:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:42:35.090066 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae3b5d-b1ba-4ffa-84ee-adbd66bbdc1a None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:35.090499 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae3b5d-b1ba-4ffa-84ee-adbd66bbdc1a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:35.090671 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae3b5d-b1ba-4ffa-84ee-adbd66bbdc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:35.171386 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-20ae3b5d-b1ba-4ffa-84ee-adbd66bbdc1a None None] MFA Rules not processed for user `dfb4be75496444dd897b880c2ac3e67e`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:42:35.172628 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-20ae3b5d-b1ba-4ffa-84ee-adbd66bbdc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:35.282852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 670/1355] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Jul 25 08:42:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:42:38.787352 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47b57c-513e-4824-949d-272e9aff56fb None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:38.787926 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47b57c-513e-4824-949d-272e9aff56fb None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:38.787926 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47b57c-513e-4824-949d-272e9aff56fb None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:38.789295 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 686/1356] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:42:38.800150 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0945de2-2e47-4f14-a586-0d99a1c2197c None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:38.800642 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0945de2-2e47-4f14-a586-0d99a1c2197c None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:38.800736 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0945de2-2e47-4f14-a586-0d99a1c2197c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:38.849104 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:38.889087 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-d0945de2-2e47-4f14-a586-0d99a1c2197c None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:42:38.890550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d0945de2-2e47-4f14-a586-0d99a1c2197c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:38.999825 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 671/1357] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:42:39.058253 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ab228-6875-43a4-8862-6402b91b1b2a None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:39.058871 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ab228-6875-43a4-8862-6402b91b1b2a None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:39.059431 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ab228-6875-43a4-8862-6402b91b1b2a None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:39.061839 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 687/1358] 10.222.0.18 () {54 vars in 962 bytes} [Mon Jul 25 08:42:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:42:39.068791 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1ce0d-ef05-405a-9b77-9c78546a6ce7 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:39.069408 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1ce0d-ef05-405a-9b77-9c78546a6ce7 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:39.069873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1ce0d-ef05-405a-9b77-9c78546a6ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:39.155847 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-53b1ce0d-ef05-405a-9b77-9c78546a6ce7 None None] MFA Rules not processed for user `1c1a08d3a76643a9996dc0daa8714ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:42:39.157046 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-53b1ce0d-ef05-405a-9b77-9c78546a6ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:39.209648 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:39.280787 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 672/1359] 10.222.0.18 () {58 vars in 1059 bytes} [Mon Jul 25 08:42:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:42:39.288543 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ab228-6875-43a4-8862-6402b91b1b2a None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:42:39.290251 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-cf2ab228-6875-43a4-8862-6402b91b1b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:39.444875 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ab228-6875-43a4-8862-6402b91b1b2a None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:42:39.519106 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:39.567228 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fff134-101e-4c4b-ad66-2029bb9e93e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:42:39.567228 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fff134-101e-4c4b-ad66-2029bb9e93e1 service nova] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:39.567228 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fff134-101e-4c4b-ad66-2029bb9e93e1 service nova] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:39.567864 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fff134-101e-4c4b-ad66-2029bb9e93e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:39.569620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-12fff134-101e-4c4b-ad66-2029bb9e93e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:39.669218 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fff134-101e-4c4b-ad66-2029bb9e93e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:42:39.670835 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fff134-101e-4c4b-ad66-2029bb9e93e1 service nova] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:42:39.690288 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 688/1360] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:42:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:42:41.920914 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0316c1c-88e7-459e-8d52-9a546701573a None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:41.921378 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0316c1c-88e7-459e-8d52-9a546701573a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:41.921692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0316c1c-88e7-459e-8d52-9a546701573a None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:41.923326 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 673/1361] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:42:41.928521 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48023f-a7ce-4c33-8da9-0ec725a84a0b None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:41.928902 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48023f-a7ce-4c33-8da9-0ec725a84a0b None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:41.929067 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48023f-a7ce-4c33-8da9-0ec725a84a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:42.001714 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-cf48023f-a7ce-4c33-8da9-0ec725a84a0b None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:42:42.002945 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-cf48023f-a7ce-4c33-8da9-0ec725a84a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:42.045423 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:42.115666 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 689/1362] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:42:42.159085 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0316c1c-88e7-459e-8d52-9a546701573a None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:42:42.161332 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d0316c1c-88e7-459e-8d52-9a546701573a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:42.358309 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0316c1c-88e7-459e-8d52-9a546701573a None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:42:42.369162 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:42.485470 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bc223-5a11-48d8-82a5-31ce3f94f371 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:42:42.486757 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bc223-5a11-48d8-82a5-31ce3f94f371 service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:42.487486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bc223-5a11-48d8-82a5-31ce3f94f371 service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:42.487486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bc223-5a11-48d8-82a5-31ce3f94f371 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:42.490526 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-560bc223-5a11-48d8-82a5-31ce3f94f371 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:42.617898 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bc223-5a11-48d8-82a5-31ce3f94f371 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:42:42.620315 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bc223-5a11-48d8-82a5-31ce3f94f371 service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:42:42.639801 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 674/1363] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:42:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:42:45.171252 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f8aea-3556-494b-b1d6-87014c0db97e None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:45.171252 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f8aea-3556-494b-b1d6-87014c0db97e None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:45.171252 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f8aea-3556-494b-b1d6-87014c0db97e None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:45.172723 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 690/1364] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:42:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:42:45.178530 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8bbfc-e016-417b-8719-17ed6240897d None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:45.178997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8bbfc-e016-417b-8719-17ed6240897d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:45.182941 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8bbfc-e016-417b-8719-17ed6240897d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:45.196812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:45.266480 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-d0f8bbfc-e016-417b-8719-17ed6240897d None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:42:45.267820 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d0f8bbfc-e016-417b-8719-17ed6240897d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:45.376791 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 675/1365] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:42:45.424601 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7399917-0d70-4db7-8c63-572557b54599 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:45.424826 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7399917-0d70-4db7-8c63-572557b54599 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:45.425941 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7399917-0d70-4db7-8c63-572557b54599 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:45.427497 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 691/1366] 10.222.0.18 () {54 vars in 962 bytes} [Mon Jul 25 08:42:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:42:45.435055 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477dd95-5b55-4b9a-aa87-70a8477987b2 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:45.435569 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477dd95-5b55-4b9a-aa87-70a8477987b2 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:45.435965 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477dd95-5b55-4b9a-aa87-70a8477987b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:45.525023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-f477dd95-5b55-4b9a-aa87-70a8477987b2 None None] MFA Rules not processed for user `1c1a08d3a76643a9996dc0daa8714ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:42:45.526824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f477dd95-5b55-4b9a-aa87-70a8477987b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:45.569159 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:45.663051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 676/1367] 10.222.0.18 () {58 vars in 1059 bytes} [Mon Jul 25 08:42:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:42:45.671743 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7399917-0d70-4db7-8c63-572557b54599 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:42:45.673683 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-c7399917-0d70-4db7-8c63-572557b54599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:45.838897 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7399917-0d70-4db7-8c63-572557b54599 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:42:45.863443 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:45.962279 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f47c0d-4ab5-413d-bc9d-822043baeded service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:42:45.963468 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f47c0d-4ab5-413d-bc9d-822043baeded service nova] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:45.963900 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f47c0d-4ab5-413d-bc9d-822043baeded service nova] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:45.964180 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f47c0d-4ab5-413d-bc9d-822043baeded service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:45.965808 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-08f47c0d-4ab5-413d-bc9d-822043baeded service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:46.064335 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f47c0d-4ab5-413d-bc9d-822043baeded service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:42:46.065933 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f47c0d-4ab5-413d-bc9d-822043baeded service nova] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:42:46.090161 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 692/1368] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:42:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:42:47.013468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa623e-8c29-4ba2-9b5f-854d060795fd None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:47.013983 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa623e-8c29-4ba2-9b5f-854d060795fd None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:47.013983 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa623e-8c29-4ba2-9b5f-854d060795fd None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:47.015482 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 677/1369] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:42:47.020745 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bad45f-51f0-49b9-bbd9-bcc0a53217e7 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:47.021182 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bad45f-51f0-49b9-bbd9-bcc0a53217e7 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:47.021371 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bad45f-51f0-49b9-bbd9-bcc0a53217e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:47.054786 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:47.091107 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-62bad45f-51f0-49b9-bbd9-bcc0a53217e7 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:42:47.092935 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-62bad45f-51f0-49b9-bbd9-bcc0a53217e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:47.195943 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 693/1370] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:42:47.554195 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f637d-dc44-473f-9669-ba19e17daaa4 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:47.554195 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f637d-dc44-473f-9669-ba19e17daaa4 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:47.554195 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f637d-dc44-473f-9669-ba19e17daaa4 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:47.555677 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 678/1371] 10.222.0.18 () {54 vars in 964 bytes} [Mon Jul 25 08:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:42:47.561553 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e5da4-6aec-4929-92ce-40002173c638 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:47.561847 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e5da4-6aec-4929-92ce-40002173c638 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:47.562127 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e5da4-6aec-4929-92ce-40002173c638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:47.649782 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-317e5da4-6aec-4929-92ce-40002173c638 None None] MFA Rules not processed for user `c53b69c61d9a46bc9e8aa1b4a9fd5fec`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:42:47.651832 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-317e5da4-6aec-4929-92ce-40002173c638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:47.703774 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:47.740059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 694/1372] 10.222.0.18 () {58 vars in 1061 bytes} [Mon Jul 25 08:42:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:42:47.747863 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f637d-dc44-473f-9669-ba19e17daaa4 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:42:47.749512 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-027f637d-dc44-473f-9669-ba19e17daaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:47.861801 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f637d-dc44-473f-9669-ba19e17daaa4 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:42:47.906393 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:47.940729 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a969f4-fe3c-4d5d-991e-089adcf3841d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:42:47.941386 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a969f4-fe3c-4d5d-991e-089adcf3841d service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:47.941675 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a969f4-fe3c-4d5d-991e-089adcf3841d service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:47.941955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a969f4-fe3c-4d5d-991e-089adcf3841d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:47.943592 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-29a969f4-fe3c-4d5d-991e-089adcf3841d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:48.061327 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a969f4-fe3c-4d5d-991e-089adcf3841d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:42:48.063072 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a969f4-fe3c-4d5d-991e-089adcf3841d service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:42:48.083030 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 679/1373] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:42:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:42:48.507532 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc152c9b-4c30-42a0-9690-c6e0d065a931 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:48.508163 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc152c9b-4c30-42a0-9690-c6e0d065a931 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:48.508163 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc152c9b-4c30-42a0-9690-c6e0d065a931 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:48.509521 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 695/1374] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:42:48.516323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d01ec-a26f-4130-b42a-1effacc0fe63 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:48.516629 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d01ec-a26f-4130-b42a-1effacc0fe63 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:48.516915 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d01ec-a26f-4130-b42a-1effacc0fe63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:48.595184 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-3f5d01ec-a26f-4130-b42a-1effacc0fe63 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:42:48.596346 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-3f5d01ec-a26f-4130-b42a-1effacc0fe63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:48.616297 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:48.693501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 680/1375] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:42:48.738540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc152c9b-4c30-42a0-9690-c6e0d065a931 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:42:48.740096 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-dc152c9b-4c30-42a0-9690-c6e0d065a931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:48.893157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc152c9b-4c30-42a0-9690-c6e0d065a931 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:42:48.948712 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:49.009684 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebc40f-9b96-43b5-8958-8e25850af280 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:42:49.010653 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebc40f-9b96-43b5-8958-8e25850af280 service nova] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:49.010940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebc40f-9b96-43b5-8958-8e25850af280 service nova] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:49.011217 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebc40f-9b96-43b5-8958-8e25850af280 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:49.012926 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-38ebc40f-9b96-43b5-8958-8e25850af280 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:49.100346 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ebc40f-9b96-43b5-8958-8e25850af280 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:42:49.102002 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ebc40f-9b96-43b5-8958-8e25850af280 service nova] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:42:49.120342 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 696/1376] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:42:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:42:51.245672 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34879187-3676-4f05-afd6-0ea5053dbb35 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:51.246239 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34879187-3676-4f05-afd6-0ea5053dbb35 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:51.246239 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34879187-3676-4f05-afd6-0ea5053dbb35 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:51.247602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 681/1377] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:42:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:42:51.252793 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb6775-4f39-443b-9b0a-f4eb9c406881 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:51.253224 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb6775-4f39-443b-9b0a-f4eb9c406881 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:51.253408 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb6775-4f39-443b-9b0a-f4eb9c406881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:51.333594 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-2adb6775-4f39-443b-9b0a-f4eb9c406881 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:42:51.334742 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-2adb6775-4f39-443b-9b0a-f4eb9c406881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:51.342421 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:51.432822 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 697/1378] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:42:51.477749 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34879187-3676-4f05-afd6-0ea5053dbb35 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:42:51.479896 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-34879187-3676-4f05-afd6-0ea5053dbb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:51.629514 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34879187-3676-4f05-afd6-0ea5053dbb35 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:42:51.633403 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:51.791120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ee314-e830-455d-840f-a8ba11064d88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:42:51.792574 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ee314-e830-455d-840f-a8ba11064d88 service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:51.792865 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ee314-e830-455d-840f-a8ba11064d88 service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:51.793148 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ee314-e830-455d-840f-a8ba11064d88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:51.794932 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-2f8ee314-e830-455d-840f-a8ba11064d88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:51.897713 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ee314-e830-455d-840f-a8ba11064d88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:42:51.899470 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ee314-e830-455d-840f-a8ba11064d88 service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:42:51.918596 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 682/1379] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:42:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:42:54.069529 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a311c-4b69-49b1-a3f4-778ff6a7e3a2 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:54.070056 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a311c-4b69-49b1-a3f4-778ff6a7e3a2 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:54.070140 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a311c-4b69-49b1-a3f4-778ff6a7e3a2 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:54.071650 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 698/1380] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:42:54.076796 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33c2f8-a9e4-4710-9c7e-c4ca1d945590 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:54.077216 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33c2f8-a9e4-4710-9c7e-c4ca1d945590 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:54.077404 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33c2f8-a9e4-4710-9c7e-c4ca1d945590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:54.089572 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:54.148655 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-6f33c2f8-a9e4-4710-9c7e-c4ca1d945590 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:42:54.149872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6f33c2f8-a9e4-4710-9c7e-c4ca1d945590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:54.252512 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 683/1381] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:42:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:42:54.297908 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a311c-4b69-49b1-a3f4-778ff6a7e3a2 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:42:54.299526 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-e80a311c-4b69-49b1-a3f4-778ff6a7e3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:54.444727 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:54.455886 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a311c-4b69-49b1-a3f4-778ff6a7e3a2 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:42:54.576462 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0186a-a42c-42d2-8a88-03ad2b5e0e0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:42:54.577045 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0186a-a42c-42d2-8a88-03ad2b5e0e0f service nova] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:54.577329 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0186a-a42c-42d2-8a88-03ad2b5e0e0f service nova] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:54.577605 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0186a-a42c-42d2-8a88-03ad2b5e0e0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:54.579366 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-96c0186a-a42c-42d2-8a88-03ad2b5e0e0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:54.687098 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0186a-a42c-42d2-8a88-03ad2b5e0e0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:42:54.689324 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0186a-a42c-42d2-8a88-03ad2b5e0e0f service nova] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:42:54.705627 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:54.718527 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 699/1382] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:42:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:42:56.910219 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29779d6-e555-4ba4-b914-b2b154b2883a None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:56.910774 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29779d6-e555-4ba4-b914-b2b154b2883a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:56.910774 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29779d6-e555-4ba4-b914-b2b154b2883a None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:56.912209 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 684/1383] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:42:56.917649 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa682a3-3485-4ec5-a9fc-53ef8db37dc0 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:56.918096 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa682a3-3485-4ec5-a9fc-53ef8db37dc0 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:56.918192 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa682a3-3485-4ec5-a9fc-53ef8db37dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:56.992518 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-caa682a3-3485-4ec5-a9fc-53ef8db37dc0 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:42:56.994519 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-caa682a3-3485-4ec5-a9fc-53ef8db37dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:57.106942 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 700/1384] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:42:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:42:57.150723 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29779d6-e555-4ba4-b914-b2b154b2883a None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:42:57.152811 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d29779d6-e555-4ba4-b914-b2b154b2883a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:57.259596 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:57.322361 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29779d6-e555-4ba4-b914-b2b154b2883a None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:42:57.440134 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0422f-250e-48ca-8707-350377a2ca8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:42:57.440806 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0422f-250e-48ca-8707-350377a2ca8a service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:57.441078 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0422f-250e-48ca-8707-350377a2ca8a service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:57.441365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0422f-250e-48ca-8707-350377a2ca8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:57.443028 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4da0422f-250e-48ca-8707-350377a2ca8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:57.500872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:42:57.541752 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0422f-250e-48ca-8707-350377a2ca8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:42:57.544035 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0422f-250e-48ca-8707-350377a2ca8a service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:42:57.563447 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 685/1385] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:42:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:42:59.631572 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d0ec8-2bf9-4833-8947-a602a8f8d0da None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:59.632138 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d0ec8-2bf9-4833-8947-a602a8f8d0da None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:59.632230 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d0ec8-2bf9-4833-8947-a602a8f8d0da None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:59.633569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 701/1386] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:42:59.639550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e80069-2e8e-4df9-b514-595361c143a9 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:42:59.640149 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e80069-2e8e-4df9-b514-595361c143a9 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:42:59.640149 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e80069-2e8e-4df9-b514-595361c143a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:42:59.719259 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-24e80069-2e8e-4df9-b514-595361c143a9 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:42:59.719259 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-24e80069-2e8e-4df9-b514-595361c143a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:59.818217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 686/1387] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:42:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:42:59.863483 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d0ec8-2bf9-4833-8947-a602a8f8d0da None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:42:59.865034 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-a77d0ec8-2bf9-4833-8947-a602a8f8d0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:42:59.955116 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:00.043490 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d0ec8-2bf9-4833-8947-a602a8f8d0da None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:00.178221 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69cf2a-53cc-41be-bad5-456f4579c173 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:00.178982 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69cf2a-53cc-41be-bad5-456f4579c173 service nova] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:00.179268 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69cf2a-53cc-41be-bad5-456f4579c173 service nova] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:00.179541 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69cf2a-53cc-41be-bad5-456f4579c173 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:00.181219 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-9c69cf2a-53cc-41be-bad5-456f4579c173 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:00.223931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:00.281110 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69cf2a-53cc-41be-bad5-456f4579c173 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:00.283431 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69cf2a-53cc-41be-bad5-456f4579c173 service nova] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:00.307196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 702/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:42:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:02.646665 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f2b9d-b010-44d9-b67a-dbc7ac928bab None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:02.647206 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f2b9d-b010-44d9-b67a-dbc7ac928bab None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:02.647206 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f2b9d-b010-44d9-b67a-dbc7ac928bab None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:02.648658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 687/1389] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:43:02.654636 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7f39d-dbad-4e48-afac-15331cbcb9b5 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:02.655047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7f39d-dbad-4e48-afac-15331cbcb9b5 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:02.655200 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7f39d-dbad-4e48-afac-15331cbcb9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:02.725393 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-6dc7f39d-dbad-4e48-afac-15331cbcb9b5 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:02.726591 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-6dc7f39d-dbad-4e48-afac-15331cbcb9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:02.829573 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 703/1390] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:43:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:02.878943 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f2b9d-b010-44d9-b67a-dbc7ac928bab None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:02.880573 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-3d7f2b9d-b010-44d9-b67a-dbc7ac928bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:02.912824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:03.058638 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f2b9d-b010-44d9-b67a-dbc7ac928bab None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:03.165682 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:03.179311 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53ea1f-05e1-4d09-afb7-d2ba9dd3d2c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:03.194319 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53ea1f-05e1-4d09-afb7-d2ba9dd3d2c8 service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:03.194319 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53ea1f-05e1-4d09-afb7-d2ba9dd3d2c8 service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:03.194319 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53ea1f-05e1-4d09-afb7-d2ba9dd3d2c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:03.194319 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9b53ea1f-05e1-4d09-afb7-d2ba9dd3d2c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:03.276668 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53ea1f-05e1-4d09-afb7-d2ba9dd3d2c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:03.278562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53ea1f-05e1-4d09-afb7-d2ba9dd3d2c8 service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:03.296890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 688/1391] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:03.735110 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376ee2e-3c90-482b-bcdf-3c0fca7af56d None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:03.735670 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376ee2e-3c90-482b-bcdf-3c0fca7af56d None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:03.735670 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376ee2e-3c90-482b-bcdf-3c0fca7af56d None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:03.737019 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 704/1392] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:43:03.742494 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1af46-e9ad-4e0a-b1e6-2ed67dbd551c None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:03.742931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1af46-e9ad-4e0a-b1e6-2ed67dbd551c None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:03.743038 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1af46-e9ad-4e0a-b1e6-2ed67dbd551c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:03.811347 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-6da1af46-e9ad-4e0a-b1e6-2ed67dbd551c None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:03.812596 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6da1af46-e9ad-4e0a-b1e6-2ed67dbd551c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:03.871887 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:03.910981 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 689/1393] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:03.966499 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe68d8e-933e-4de6-a359-8306cb5f7f54 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:03.966869 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe68d8e-933e-4de6-a359-8306cb5f7f54 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:03.967253 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe68d8e-933e-4de6-a359-8306cb5f7f54 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:03.968761 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 705/1394] 10.222.0.18 () {54 vars in 966 bytes} [Mon Jul 25 08:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:43:03.973822 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a4e07-6738-43af-b88a-26ea60abed09 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:03.974122 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a4e07-6738-43af-b88a-26ea60abed09 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:03.974405 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a4e07-6738-43af-b88a-26ea60abed09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:04.053639 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-f15a4e07-6738-43af-b88a-26ea60abed09 None None] MFA Rules not processed for user `dd75a24363c14e86b0fbbb782b372646`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:04.054773 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f15a4e07-6738-43af-b88a-26ea60abed09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:04.132793 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 690/1395] 10.222.0.18 () {58 vars in 1063 bytes} [Mon Jul 25 08:43:03 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:04.140961 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe68d8e-933e-4de6-a359-8306cb5f7f54 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:04.142757 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-bfe68d8e-933e-4de6-a359-8306cb5f7f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:04.161784 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:04.251840 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe68d8e-933e-4de6-a359-8306cb5f7f54 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:04.324530 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5b177-e050-41bc-9ab0-46e208793f03 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd75a24363c14e86b0fbbb782b372646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:04.325102 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5b177-e050-41bc-9ab0-46e208793f03 service glance] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:04.325385 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5b177-e050-41bc-9ab0-46e208793f03 service glance] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:04.325660 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5b177-e050-41bc-9ab0-46e208793f03 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:04.327298 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-d9a5b177-e050-41bc-9ab0-46e208793f03 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:04.396088 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:04.439114 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5b177-e050-41bc-9ab0-46e208793f03 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:04.440606 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5b177-e050-41bc-9ab0-46e208793f03 service glance] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:04.459478 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 706/1396] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:43:05.314509 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d70f49-45d1-4e5d-a0ff-8ad0a130df4e None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:05.315007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d70f49-45d1-4e5d-a0ff-8ad0a130df4e None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:05.315107 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d70f49-45d1-4e5d-a0ff-8ad0a130df4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:05.380523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-73d70f49-45d1-4e5d-a0ff-8ad0a130df4e None None] MFA Rules not processed for user `b3c1d56bc0a64411a68f97a4417b0379`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:05.381722 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-73d70f49-45d1-4e5d-a0ff-8ad0a130df4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:05.390677 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:05.450917 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430923e-f491-40f8-823e-39fe2c444cfd None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:05.451538 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430923e-f491-40f8-823e-39fe2c444cfd None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:05.451855 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430923e-f491-40f8-823e-39fe2c444cfd None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:05.453261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 707/1397] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:43:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:43:05.458350 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95630197-a016-474a-8a42-3daec0c66487 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:05.458630 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95630197-a016-474a-8a42-3daec0c66487 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:05.458904 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95630197-a016-474a-8a42-3daec0c66487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:05.469341 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 691/1398] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Jul 25 08:43:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:05.516764 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86983abd-3754-417f-b2b0-9eae34d5457e None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:05.517060 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86983abd-3754-417f-b2b0-9eae34d5457e None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:05.517339 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86983abd-3754-417f-b2b0-9eae34d5457e None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:05.518719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 692/1399] 10.222.0.18 () {54 vars in 943 bytes} [Mon Jul 25 08:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:43:05.524711 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94d3bc-916a-4ae5-b068-a01d20200a2e None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:05.525002 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94d3bc-916a-4ae5-b068-a01d20200a2e None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:05.525283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94d3bc-916a-4ae5-b068-a01d20200a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:05.529622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-95630197-a016-474a-8a42-3daec0c66487 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:05.530862 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-95630197-a016-474a-8a42-3daec0c66487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:05.604737 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-9e94d3bc-916a-4ae5-b068-a01d20200a2e None None] MFA Rules not processed for user `2763e540681547d3a6677567b3be86ea`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:05.606179 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9e94d3bc-916a-4ae5-b068-a01d20200a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:05.629770 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 708/1400] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:43:05.676643 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95630197-a016-474a-8a42-3daec0c66487 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:05.677862 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-95630197-a016-474a-8a42-3daec0c66487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:05.690644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:05.711078 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:05.716735 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 693/1401] 10.222.0.18 () {58 vars in 1040 bytes} [Mon Jul 25 08:43:05 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:43:05.726592 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94d3bc-916a-4ae5-b068-a01d20200a2e None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:05.737250 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94d3bc-916a-4ae5-b068-a01d20200a2e None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:05.796044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95630197-a016-474a-8a42-3daec0c66487 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:05.845012 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153db9bc-9b35-40ed-ab91-64405bda4e57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2763e540681547d3a6677567b3be86ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:05.845707 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153db9bc-9b35-40ed-ab91-64405bda4e57 service swift] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:05.845992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153db9bc-9b35-40ed-ab91-64405bda4e57 service swift] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:05.846271 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153db9bc-9b35-40ed-ab91-64405bda4e57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:05.847994 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-153db9bc-9b35-40ed-ab91-64405bda4e57 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:05.910731 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916e927-61df-4752-8c4d-b0741dcd1a07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:05.911772 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916e927-61df-4752-8c4d-b0741dcd1a07 service nova] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:05.912057 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916e927-61df-4752-8c4d-b0741dcd1a07 service nova] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:05.912353 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916e927-61df-4752-8c4d-b0741dcd1a07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:05.914449 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-8916e927-61df-4752-8c4d-b0741dcd1a07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:05.932946 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:05.933486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153db9bc-9b35-40ed-ab91-64405bda4e57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:05.935074 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153db9bc-9b35-40ed-ab91-64405bda4e57 service swift] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:05.943082 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 694/1402] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Jul 25 08:43:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 08:43:06.007574 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916e927-61df-4752-8c4d-b0741dcd1a07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:06.009128 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916e927-61df-4752-8c4d-b0741dcd1a07 service nova] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:06.028320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 709/1403] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:43:08.312293 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbff255-2c48-4302-b08e-da1612cd5de8 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:08.312857 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbff255-2c48-4302-b08e-da1612cd5de8 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:08.312857 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbff255-2c48-4302-b08e-da1612cd5de8 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:08.314275 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 695/1404] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:43:08.319829 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2eb67d-d54a-4fb6-a61f-2ab0a3bc0b67 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:08.320260 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2eb67d-d54a-4fb6-a61f-2ab0a3bc0b67 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:08.320580 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2eb67d-d54a-4fb6-a61f-2ab0a3bc0b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:08.410332 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-eb2eb67d-d54a-4fb6-a61f-2ab0a3bc0b67 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:08.411876 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-eb2eb67d-d54a-4fb6-a61f-2ab0a3bc0b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:08.527910 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:08.547863 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 710/1405] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:08.629574 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbff255-2c48-4302-b08e-da1612cd5de8 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:08.629574 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-fdbff255-2c48-4302-b08e-da1612cd5de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:08.629574 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:08.826998 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbff255-2c48-4302-b08e-da1612cd5de8 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:08.925102 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db025fdd-3d6a-4ba2-9923-c9b167299e40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:08.925886 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db025fdd-3d6a-4ba2-9923-c9b167299e40 service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:08.926168 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db025fdd-3d6a-4ba2-9923-c9b167299e40 service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:08.926465 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db025fdd-3d6a-4ba2-9923-c9b167299e40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:08.928276 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-db025fdd-3d6a-4ba2-9923-c9b167299e40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:09.020523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:09.022691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db025fdd-3d6a-4ba2-9923-c9b167299e40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:09.024359 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db025fdd-3d6a-4ba2-9923-c9b167299e40 service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:09.045600 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 696/1406] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:11.488622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131788d-238c-4d9e-9ea8-5ea81bf3e753 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:11.489184 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131788d-238c-4d9e-9ea8-5ea81bf3e753 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:11.489184 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131788d-238c-4d9e-9ea8-5ea81bf3e753 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:11.490702 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 711/1407] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:43:11.496636 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e19e0-a39a-423b-99c0-9cfe41aec6c3 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:11.497100 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e19e0-a39a-423b-99c0-9cfe41aec6c3 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:11.497243 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e19e0-a39a-423b-99c0-9cfe41aec6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:11.570109 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-365e19e0-a39a-423b-99c0-9cfe41aec6c3 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:11.575792 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-365e19e0-a39a-423b-99c0-9cfe41aec6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:11.625260 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:11.687677 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 697/1408] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:11.735306 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131788d-238c-4d9e-9ea8-5ea81bf3e753 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:11.736859 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-4131788d-238c-4d9e-9ea8-5ea81bf3e753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:11.902143 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131788d-238c-4d9e-9ea8-5ea81bf3e753 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:11.977824 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:12.028922 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7b286-66b8-4913-8681-696f046f69f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:12.029568 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7b286-66b8-4913-8681-696f046f69f4 service nova] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:12.029851 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7b286-66b8-4913-8681-696f046f69f4 service nova] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:12.030126 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7b286-66b8-4913-8681-696f046f69f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:12.031824 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-71f7b286-66b8-4913-8681-696f046f69f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:12.132164 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7b286-66b8-4913-8681-696f046f69f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:12.133934 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7b286-66b8-4913-8681-696f046f69f4 service nova] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:12.154418 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 712/1409] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:21.684175 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=23 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:22.151295 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=64 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:29.707223 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb41f1-9937-450b-8a1e-4685d66e8fec None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:29.707813 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb41f1-9937-450b-8a1e-4685d66e8fec None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:29.707813 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb41f1-9937-450b-8a1e-4685d66e8fec None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:29.709186 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 698/1410] 10.222.0.18 () {54 vars in 918 bytes} [Mon Jul 25 08:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:43:29.714528 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfa55f-427f-4c5b-8ac7-7dd78c8aa01b None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:29.714932 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfa55f-427f-4c5b-8ac7-7dd78c8aa01b None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:29.715084 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfa55f-427f-4c5b-8ac7-7dd78c8aa01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:29.790431 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-9ddfa55f-427f-4c5b-8ac7-7dd78c8aa01b None None] MFA Rules not processed for user `dfb4be75496444dd897b880c2ac3e67e`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:29.791669 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-9ddfa55f-427f-4c5b-8ac7-7dd78c8aa01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:29.897459 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 713/1411] 10.222.0.18 () {58 vars in 1015 bytes} [Mon Jul 25 08:43:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:29.912850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1a0bf-5ca1-42f1-bd0e-7d0bfd1a2867 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:29.913145 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1a0bf-5ca1-42f1-bd0e-7d0bfd1a2867 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:29.913429 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1a0bf-5ca1-42f1-bd0e-7d0bfd1a2867 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:29.914796 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 699/1412] 10.222.0.18 () {54 vars in 918 bytes} [Mon Jul 25 08:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:43:29.919659 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da244014-559d-4603-af10-a7f4c79e7b4b None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:29.919950 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da244014-559d-4603-af10-a7f4c79e7b4b None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:29.920224 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da244014-559d-4603-af10-a7f4c79e7b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:29.992865 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:29.995915 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-da244014-559d-4603-af10-a7f4c79e7b4b None None] MFA Rules not processed for user `1c1a08d3a76643a9996dc0daa8714ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:29.997643 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-da244014-559d-4603-af10-a7f4c79e7b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:30.111093 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 714/1413] 10.222.0.18 () {58 vars in 1015 bytes} [Mon Jul 25 08:43:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:43:32.579138 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718125d6-23ee-4caa-80f9-e602e3fc7907 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:32.579735 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718125d6-23ee-4caa-80f9-e602e3fc7907 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:32.579735 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718125d6-23ee-4caa-80f9-e602e3fc7907 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:32.581120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 700/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 08:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:43:32.586411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237a6c1-10c3-427d-b4e3-0b11f8ed5c8a None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:32.586799 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237a6c1-10c3-427d-b4e3-0b11f8ed5c8a None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:32.586969 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237a6c1-10c3-427d-b4e3-0b11f8ed5c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:32.651482 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-9237a6c1-10c3-427d-b4e3-0b11f8ed5c8a None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:32.652712 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-9237a6c1-10c3-427d-b4e3-0b11f8ed5c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:32.707523 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:32.748674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 715/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 08:43:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:32.791941 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718125d6-23ee-4caa-80f9-e602e3fc7907 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:32.793456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-718125d6-23ee-4caa-80f9-e602e3fc7907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:32.937093 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718125d6-23ee-4caa-80f9-e602e3fc7907 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:33.009551 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:33.049991 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bcdf30-3556-4a05-b6b0-3a9754b155d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:33.050633 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcdf30-3556-4a05-b6b0-3a9754b155d5 service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:33.050914 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcdf30-3556-4a05-b6b0-3a9754b155d5 service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:33.051189 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcdf30-3556-4a05-b6b0-3a9754b155d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:33.052856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-90bcdf30-3556-4a05-b6b0-3a9754b155d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:33.139800 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bcdf30-3556-4a05-b6b0-3a9754b155d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:33.141375 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bcdf30-3556-4a05-b6b0-3a9754b155d5 service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:33.159825 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 701/1416] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:34.054143 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb92989-c57f-4d3e-b229-2c94e5d2e175 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:34.054672 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb92989-c57f-4d3e-b229-2c94e5d2e175 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:34.054672 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb92989-c57f-4d3e-b229-2c94e5d2e175 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:34.056092 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 716/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 08:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:43:34.061842 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b31112-3bfa-4d28-b821-2e1eaf2b3c44 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:34.062250 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b31112-3bfa-4d28-b821-2e1eaf2b3c44 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:34.062445 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b31112-3bfa-4d28-b821-2e1eaf2b3c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:34.138841 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-e2b31112-3bfa-4d28-b821-2e1eaf2b3c44 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:34.140084 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-e2b31112-3bfa-4d28-b821-2e1eaf2b3c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:34.166901 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:34.237055 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 702/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 08:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:34.391009 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb92989-c57f-4d3e-b229-2c94e5d2e175 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:34.392466 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-6cb92989-c57f-4d3e-b229-2c94e5d2e175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:34.542024 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb92989-c57f-4d3e-b229-2c94e5d2e175 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:34.581711 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:34.655661 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c2b93-c0ca-4b2b-a9d4-bb2e1763c377 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:34.656241 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c2b93-c0ca-4b2b-a9d4-bb2e1763c377 service nova] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:34.656528 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c2b93-c0ca-4b2b-a9d4-bb2e1763c377 service nova] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:34.656806 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c2b93-c0ca-4b2b-a9d4-bb2e1763c377 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:34.658478 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-6c8c2b93-c0ca-4b2b-a9d4-bb2e1763c377 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:34.747926 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8c2b93-c0ca-4b2b-a9d4-bb2e1763c377 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:34.749522 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8c2b93-c0ca-4b2b-a9d4-bb2e1763c377 service nova] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:34.767710 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 717/1419] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:35.645825 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0aece9-1f39-49f6-b084-0aa26b9beced None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:35.646405 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0aece9-1f39-49f6-b084-0aa26b9beced None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:35.646405 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0aece9-1f39-49f6-b084-0aa26b9beced None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:35.647836 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 703/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 08:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:43:35.652866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa87275-3ba6-4be7-9687-41a21f51dc9f None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:35.653935 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa87275-3ba6-4be7-9687-41a21f51dc9f None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:35.654040 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa87275-3ba6-4be7-9687-41a21f51dc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:35.708912 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:35.731485 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-2aa87275-3ba6-4be7-9687-41a21f51dc9f None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:35.732880 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-2aa87275-3ba6-4be7-9687-41a21f51dc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:35.830650 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 718/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 08:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:35.984151 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0aece9-1f39-49f6-b084-0aa26b9beced None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:35.985699 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-ef0aece9-1f39-49f6-b084-0aa26b9beced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:36.131953 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0aece9-1f39-49f6-b084-0aa26b9beced None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:36.144328 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:36.241783 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff729e0-5131-4652-952f-b3cc0177ea8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:36.242328 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff729e0-5131-4652-952f-b3cc0177ea8a service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:36.242610 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff729e0-5131-4652-952f-b3cc0177ea8a service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:36.242885 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff729e0-5131-4652-952f-b3cc0177ea8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:36.244545 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9ff729e0-5131-4652-952f-b3cc0177ea8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:36.331818 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff729e0-5131-4652-952f-b3cc0177ea8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:36.333397 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff729e0-5131-4652-952f-b3cc0177ea8a service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:36.350964 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 704/1422] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:37.214546 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78105c95-348d-450a-b486-b7cdc18a69c5 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:37.214969 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78105c95-348d-450a-b486-b7cdc18a69c5 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:37.215082 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78105c95-348d-450a-b486-b7cdc18a69c5 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:37.217110 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 719/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 08:43:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:43:37.221987 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ecf98-77a6-4cbe-b125-7511059a78aa None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:37.222437 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ecf98-77a6-4cbe-b125-7511059a78aa None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:37.222549 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ecf98-77a6-4cbe-b125-7511059a78aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:37.242624 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:37.299918 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-575ecf98-77a6-4cbe-b125-7511059a78aa None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:37.301157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-575ecf98-77a6-4cbe-b125-7511059a78aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:37.396192 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 705/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 08:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:37.546965 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78105c95-348d-450a-b486-b7cdc18a69c5 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:37.548509 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-78105c95-348d-450a-b486-b7cdc18a69c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:37.654450 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:37.689660 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78105c95-348d-450a-b486-b7cdc18a69c5 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:37.802221 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da1278-0f2b-4b3d-b0ba-a121a4977fb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:37.802788 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da1278-0f2b-4b3d-b0ba-a121a4977fb6 service nova] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:37.803068 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da1278-0f2b-4b3d-b0ba-a121a4977fb6 service nova] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:37.803369 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da1278-0f2b-4b3d-b0ba-a121a4977fb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:37.805052 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-e0da1278-0f2b-4b3d-b0ba-a121a4977fb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:37.878880 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:37.892614 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da1278-0f2b-4b3d-b0ba-a121a4977fb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:37.894211 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da1278-0f2b-4b3d-b0ba-a121a4977fb6 service nova] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:37.912763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 720/1425] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:38.791096 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b475031-0393-491d-961b-7d271f8aede0 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:38.791672 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b475031-0393-491d-961b-7d271f8aede0 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:38.791672 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b475031-0393-491d-961b-7d271f8aede0 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:38.793036 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 706/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 08:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:43:38.799015 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd8b13-73f7-4fe1-b9d9-a0161849f230 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:38.799466 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd8b13-73f7-4fe1-b9d9-a0161849f230 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:38.799662 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd8b13-73f7-4fe1-b9d9-a0161849f230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:38.874632 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-3bbd8b13-73f7-4fe1-b9d9-a0161849f230 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:38.875870 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-3bbd8b13-73f7-4fe1-b9d9-a0161849f230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:38.971539 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 721/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 08:43:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:39.124631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b475031-0393-491d-961b-7d271f8aede0 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:39.126274 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9b475031-0393-491d-961b-7d271f8aede0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:39.209432 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:39.270701 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b475031-0393-491d-961b-7d271f8aede0 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:39.382491 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca507d-8aea-4373-b3c9-5d3ed699dfd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:39.383181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca507d-8aea-4373-b3c9-5d3ed699dfd8 service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:39.383464 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca507d-8aea-4373-b3c9-5d3ed699dfd8 service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:39.383776 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca507d-8aea-4373-b3c9-5d3ed699dfd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:39.385406 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0cca507d-8aea-4373-b3c9-5d3ed699dfd8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:39.435741 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:39.477067 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca507d-8aea-4373-b3c9-5d3ed699dfd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:39.478673 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca507d-8aea-4373-b3c9-5d3ed699dfd8 service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:39.496885 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 707/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:40.353995 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c5822-73b7-4b5c-a707-b727982f2018 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:40.354536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c5822-73b7-4b5c-a707-b727982f2018 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:40.354536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c5822-73b7-4b5c-a707-b727982f2018 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:40.356434 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 722/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 08:43:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:43:40.361433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca25e7-332c-4f8d-98d6-1c85da307eb2 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:40.361849 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca25e7-332c-4f8d-98d6-1c85da307eb2 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:40.362026 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca25e7-332c-4f8d-98d6-1c85da307eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:40.439266 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-b8ca25e7-332c-4f8d-98d6-1c85da307eb2 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:40.440517 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b8ca25e7-332c-4f8d-98d6-1c85da307eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:40.535746 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 708/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 08:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:43:40.685521 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c5822-73b7-4b5c-a707-b727982f2018 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:40.687114 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-203c5822-73b7-4b5c-a707-b727982f2018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:40.736461 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:40.832677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c5822-73b7-4b5c-a707-b727982f2018 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:40.946375 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee791d2a-9fec-4966-b863-3bbde2643812 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:40.946944 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee791d2a-9fec-4966-b863-3bbde2643812 service nova] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:40.947225 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee791d2a-9fec-4966-b863-3bbde2643812 service nova] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:40.947498 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee791d2a-9fec-4966-b863-3bbde2643812 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:40.949173 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-ee791d2a-9fec-4966-b863-3bbde2643812 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:40.956041 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:41.036681 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee791d2a-9fec-4966-b863-3bbde2643812 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:41.038281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee791d2a-9fec-4966-b863-3bbde2643812 service nova] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:41.056300 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 723/1431] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:41.905443 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b4bf7-130c-4d02-a69a-1a8a802b9c9d None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:41.905919 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b4bf7-130c-4d02-a69a-1a8a802b9c9d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:41.906034 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b4bf7-130c-4d02-a69a-1a8a802b9c9d None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:41.907403 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 709/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 08:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:43:41.912669 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672d5cb-e3fb-45c8-b4ac-9f6aeb5659e8 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:41.913103 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672d5cb-e3fb-45c8-b4ac-9f6aeb5659e8 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:41.913230 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672d5cb-e3fb-45c8-b4ac-9f6aeb5659e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:41.986728 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-e672d5cb-e3fb-45c8-b4ac-9f6aeb5659e8 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:41.987974 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-e672d5cb-e3fb-45c8-b4ac-9f6aeb5659e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:42.054568 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:42.084106 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 724/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 08:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:42.240400 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b4bf7-130c-4d02-a69a-1a8a802b9c9d None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:42.241923 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-462b4bf7-130c-4d02-a69a-1a8a802b9c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:42.259924 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:42.394442 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b4bf7-130c-4d02-a69a-1a8a802b9c9d None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:42.482882 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:42.508491 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b73f6-bbdc-4426-8ebd-4e47366a0b50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:42.509121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b73f6-bbdc-4426-8ebd-4e47366a0b50 service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:42.509597 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b73f6-bbdc-4426-8ebd-4e47366a0b50 service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:42.510108 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b73f6-bbdc-4426-8ebd-4e47366a0b50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:42.512111 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6b9b73f6-bbdc-4426-8ebd-4e47366a0b50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:42.599896 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b73f6-bbdc-4426-8ebd-4e47366a0b50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:42.601498 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b73f6-bbdc-4426-8ebd-4e47366a0b50 service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:42.619713 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 710/1434] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:43.509940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6a801-807f-4f59-99bc-12f3fc10c70a None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:43.510471 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6a801-807f-4f59-99bc-12f3fc10c70a None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:43.510471 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6a801-807f-4f59-99bc-12f3fc10c70a None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:43.511856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 725/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 08:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:43:43.516863 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87e383-a7a4-404b-9215-0b7ce01ed88b None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:43.517306 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87e383-a7a4-404b-9215-0b7ce01ed88b None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:43.517423 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87e383-a7a4-404b-9215-0b7ce01ed88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:43.594751 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-2e87e383-a7a4-404b-9215-0b7ce01ed88b None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:43.596005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-2e87e383-a7a4-404b-9215-0b7ce01ed88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:43.636919 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:43.691724 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 711/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 08:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:43.843177 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6a801-807f-4f59-99bc-12f3fc10c70a None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:43.844634 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-28f6a801-807f-4f59-99bc-12f3fc10c70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:43.985300 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6a801-807f-4f59-99bc-12f3fc10c70a None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:44.038848 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:44.097364 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29895d7-a73b-4111-9221-ca4cfdf0995c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:44.097932 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29895d7-a73b-4111-9221-ca4cfdf0995c service nova] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:44.098214 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29895d7-a73b-4111-9221-ca4cfdf0995c service nova] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:44.098490 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29895d7-a73b-4111-9221-ca4cfdf0995c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:44.100266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-a29895d7-a73b-4111-9221-ca4cfdf0995c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:44.188222 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29895d7-a73b-4111-9221-ca4cfdf0995c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:44.189811 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29895d7-a73b-4111-9221-ca4cfdf0995c service nova] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:44.208260 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 726/1437] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:45.117752 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295d766-4601-48c8-a2f3-c859bc3a99f9 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:45.118291 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295d766-4601-48c8-a2f3-c859bc3a99f9 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:45.118291 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295d766-4601-48c8-a2f3-c859bc3a99f9 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:45.119822 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 712/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 08:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:43:45.125545 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394feb6-a2f1-4d04-88e2-a4aab06a0b67 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:45.131634 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394feb6-a2f1-4d04-88e2-a4aab06a0b67 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:45.131634 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394feb6-a2f1-4d04-88e2-a4aab06a0b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:45.201071 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-a394feb6-a2f1-4d04-88e2-a4aab06a0b67 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:45.202292 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-a394feb6-a2f1-4d04-88e2-a4aab06a0b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:45.204318 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:45.300656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 727/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 08:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:45.455468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295d766-4601-48c8-a2f3-c859bc3a99f9 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:45.456925 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a295d766-4601-48c8-a2f3-c859bc3a99f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:45.609459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295d766-4601-48c8-a2f3-c859bc3a99f9 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:45.636168 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:45.723394 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4d054-fadc-484e-947b-84c535106a31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:45.724081 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4d054-fadc-484e-947b-84c535106a31 service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:45.724363 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4d054-fadc-484e-947b-84c535106a31 service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:45.724636 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4d054-fadc-484e-947b-84c535106a31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:45.726254 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6ac4d054-fadc-484e-947b-84c535106a31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:45.816753 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac4d054-fadc-484e-947b-84c535106a31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:45.818360 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac4d054-fadc-484e-947b-84c535106a31 service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:45.837033 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 713/1440] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:47.723512 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2973a07-e858-44f6-b92e-1c3815edbc40 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:47.724074 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2973a07-e858-44f6-b92e-1c3815edbc40 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:47.724180 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2973a07-e858-44f6-b92e-1c3815edbc40 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:47.725520 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 728/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 08:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:43:47.730592 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77802245-ea6f-484e-961f-7f2b8691b54e None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:47.731572 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77802245-ea6f-484e-961f-7f2b8691b54e None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:47.731721 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77802245-ea6f-484e-961f-7f2b8691b54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:47.772160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:47.797489 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-77802245-ea6f-484e-961f-7f2b8691b54e None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:47.798700 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-77802245-ea6f-484e-961f-7f2b8691b54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:47.896922 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 714/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 08:43:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:47.936109 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2973a07-e858-44f6-b92e-1c3815edbc40 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:47.937693 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-b2973a07-e858-44f6-b92e-1c3815edbc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:48.039356 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2973a07-e858-44f6-b92e-1c3815edbc40 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:48.070446 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:48.112060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b644f50-89e1-4950-8b03-71231fd6f23c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:48.112702 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b644f50-89e1-4950-8b03-71231fd6f23c service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:48.112981 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b644f50-89e1-4950-8b03-71231fd6f23c service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:48.113250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b644f50-89e1-4950-8b03-71231fd6f23c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:48.114890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-0b644f50-89e1-4950-8b03-71231fd6f23c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:48.219449 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b644f50-89e1-4950-8b03-71231fd6f23c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:48.220907 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b644f50-89e1-4950-8b03-71231fd6f23c service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:48.239203 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 729/1443] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:50.396426 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96186b6a-a661-4678-81d4-cafef661e7e9 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:50.396981 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96186b6a-a661-4678-81d4-cafef661e7e9 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:50.396981 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96186b6a-a661-4678-81d4-cafef661e7e9 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:50.398405 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 715/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 08:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:43:50.404214 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d93d2-4891-4192-89df-9a4e78665d3a None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:50.404623 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d93d2-4891-4192-89df-9a4e78665d3a None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:50.404769 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d93d2-4891-4192-89df-9a4e78665d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:50.470448 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-225d93d2-4891-4192-89df-9a4e78665d3a None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:50.471677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-225d93d2-4891-4192-89df-9a4e78665d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:50.484934 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:50.568170 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 730/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 08:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:50.606824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96186b6a-a661-4678-81d4-cafef661e7e9 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:50.608449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-96186b6a-a661-4678-81d4-cafef661e7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:50.711285 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96186b6a-a661-4678-81d4-cafef661e7e9 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:50.723810 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:50.788572 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb403a86-f71e-42a5-a418-ad1952e4ad9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:50.789225 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb403a86-f71e-42a5-a418-ad1952e4ad9f service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:50.789511 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb403a86-f71e-42a5-a418-ad1952e4ad9f service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:50.789788 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb403a86-f71e-42a5-a418-ad1952e4ad9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:50.791429 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-fb403a86-f71e-42a5-a418-ad1952e4ad9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:50.901554 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb403a86-f71e-42a5-a418-ad1952e4ad9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:50.903528 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb403a86-f71e-42a5-a418-ad1952e4ad9f service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:50.922264 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 716/1446] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:53.298166 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93d06e-9ea3-4f53-bd71-7fe88759aa19 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:53.298975 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93d06e-9ea3-4f53-bd71-7fe88759aa19 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:53.299139 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93d06e-9ea3-4f53-bd71-7fe88759aa19 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:53.300726 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 731/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 08:43:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:43:53.305865 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584020ae-a0d9-4fd6-b820-17e8fb0a64c4 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:53.306319 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584020ae-a0d9-4fd6-b820-17e8fb0a64c4 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:53.306425 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584020ae-a0d9-4fd6-b820-17e8fb0a64c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:53.355086 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:53.372971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-584020ae-a0d9-4fd6-b820-17e8fb0a64c4 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:53.374181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-584020ae-a0d9-4fd6-b820-17e8fb0a64c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:53.469932 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 717/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 08:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:53.509536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93d06e-9ea3-4f53-bd71-7fe88759aa19 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:53.511085 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-7b93d06e-9ea3-4f53-bd71-7fe88759aa19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:53.612350 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93d06e-9ea3-4f53-bd71-7fe88759aa19 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:53.650852 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:53.684348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b59fcb-a4a3-47a5-97e8-d1460b1200ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:53.684994 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b59fcb-a4a3-47a5-97e8-d1460b1200ff service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:53.685278 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b59fcb-a4a3-47a5-97e8-d1460b1200ff service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:53.685555 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b59fcb-a4a3-47a5-97e8-d1460b1200ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:53.687233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-d4b59fcb-a4a3-47a5-97e8-d1460b1200ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:53.796281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b59fcb-a4a3-47a5-97e8-d1460b1200ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:53.797662 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b59fcb-a4a3-47a5-97e8-d1460b1200ff service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:53.815543 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 732/1449] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:55.932465 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7d757-88bb-4d60-9c6b-ddd49f5a416c None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:55.932995 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7d757-88bb-4d60-9c6b-ddd49f5a416c None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:55.933111 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7d757-88bb-4d60-9c6b-ddd49f5a416c None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:55.934537 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 718/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 08:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:43:55.939929 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c72858-bc14-4287-82e3-60523f4bdf3a None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:55.940484 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c72858-bc14-4287-82e3-60523f4bdf3a None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:55.940484 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c72858-bc14-4287-82e3-60523f4bdf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:56.006131 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-f2c72858-bc14-4287-82e3-60523f4bdf3a None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:56.007263 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-f2c72858-bc14-4287-82e3-60523f4bdf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:56.027590 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:56.102599 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 733/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 08:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:56.145722 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e7d757-88bb-4d60-9c6b-ddd49f5a416c None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:56.147283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-e5e7d757-88bb-4d60-9c6b-ddd49f5a416c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:56.252024 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e7d757-88bb-4d60-9c6b-ddd49f5a416c None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:56.272436 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:56.326687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57efaf-33d2-4f21-a26d-7dfb8b722912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:56.327339 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57efaf-33d2-4f21-a26d-7dfb8b722912 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:56.327649 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57efaf-33d2-4f21-a26d-7dfb8b722912 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:56.327935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57efaf-33d2-4f21-a26d-7dfb8b722912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:56.329586 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0a57efaf-33d2-4f21-a26d-7dfb8b722912 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:56.438621 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57efaf-33d2-4f21-a26d-7dfb8b722912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:56.440113 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57efaf-33d2-4f21-a26d-7dfb8b722912 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:56.458439 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 719/1452] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:43:58.520720 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e08b5c-0d21-412d-b803-f454e60ea391 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:58.521308 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e08b5c-0d21-412d-b803-f454e60ea391 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:58.521308 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e08b5c-0d21-412d-b803-f454e60ea391 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:58.522661 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 734/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 08:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:43:58.528076 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c656ac-488a-4bfa-a955-ae8a95b8ad4c None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:58.528501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c656ac-488a-4bfa-a955-ae8a95b8ad4c None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:58.528631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c656ac-488a-4bfa-a955-ae8a95b8ad4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:58.591434 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:58.594120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-55c656ac-488a-4bfa-a955-ae8a95b8ad4c None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:43:58.595314 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-55c656ac-488a-4bfa-a955-ae8a95b8ad4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:58.695544 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 720/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 08:43:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:43:58.734023 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e08b5c-0d21-412d-b803-f454e60ea391 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:43:58.735551 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-58e08b5c-0d21-412d-b803-f454e60ea391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:58.841218 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e08b5c-0d21-412d-b803-f454e60ea391 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:43:58.889854 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:43:58.914846 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9046e60-f345-4819-87a0-e503d1fbf4d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:43:58.915492 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9046e60-f345-4819-87a0-e503d1fbf4d6 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:43:58.915874 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9046e60-f345-4819-87a0-e503d1fbf4d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:43:58.916151 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9046e60-f345-4819-87a0-e503d1fbf4d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:43:58.917788 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-b9046e60-f345-4819-87a0-e503d1fbf4d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:43:59.023867 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9046e60-f345-4819-87a0-e503d1fbf4d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:43:59.025306 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9046e60-f345-4819-87a0-e503d1fbf4d6 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:43:59.045656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 735/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:43:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:01.092477 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9260c-53bb-4ef2-836e-b2d4fe1a4622 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:01.093007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9260c-53bb-4ef2-836e-b2d4fe1a4622 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:01.093007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9260c-53bb-4ef2-836e-b2d4fe1a4622 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:01.094352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 721/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 08:44:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:44:01.099708 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b791ba8-091b-4054-95cc-35b28bccf13f None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:01.100112 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b791ba8-091b-4054-95cc-35b28bccf13f None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:01.100271 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b791ba8-091b-4054-95cc-35b28bccf13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:01.164799 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-7b791ba8-091b-4054-95cc-35b28bccf13f None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:01.166015 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-7b791ba8-091b-4054-95cc-35b28bccf13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:01.194579 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:01.261915 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 736/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 08:44:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:01.300446 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9260c-53bb-4ef2-836e-b2d4fe1a4622 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:01.302067 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-cec9260c-53bb-4ef2-836e-b2d4fe1a4622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:01.407471 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9260c-53bb-4ef2-836e-b2d4fe1a4622 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:01.437580 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:01.483078 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bcba8f-019b-47ff-bcdd-87d4a24c741f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:01.483747 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcba8f-019b-47ff-bcdd-87d4a24c741f service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:01.484038 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcba8f-019b-47ff-bcdd-87d4a24c741f service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:01.484314 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcba8f-019b-47ff-bcdd-87d4a24c741f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:01.485938 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-e8bcba8f-019b-47ff-bcdd-87d4a24c741f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:01.719017 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bcba8f-019b-47ff-bcdd-87d4a24c741f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:01.720494 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bcba8f-019b-47ff-bcdd-87d4a24c741f service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:01.738146 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 722/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:03.791622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248a1ce-8f47-483a-b83f-fee9757023cd None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:03.792158 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248a1ce-8f47-483a-b83f-fee9757023cd None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:03.792266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248a1ce-8f47-483a-b83f-fee9757023cd None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:03.793891 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 737/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 08:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:44:03.799013 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595f19a-1718-4dd5-bd30-edba0c9a97ec None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:03.799424 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595f19a-1718-4dd5-bd30-edba0c9a97ec None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:03.799572 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595f19a-1718-4dd5-bd30-edba0c9a97ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:03.864609 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-f595f19a-1718-4dd5-bd30-edba0c9a97ec None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:03.865810 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f595f19a-1718-4dd5-bd30-edba0c9a97ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:03.874670 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:03.962695 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 723/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 08:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:04.000484 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248a1ce-8f47-483a-b83f-fee9757023cd None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:04.002016 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-8248a1ce-8f47-483a-b83f-fee9757023cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:04.103207 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248a1ce-8f47-483a-b83f-fee9757023cd None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:04.156615 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:04.175358 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5ea16-0b89-4e80-a406-9fccfaa22d78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:04.176081 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5ea16-0b89-4e80-a406-9fccfaa22d78 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:04.176402 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5ea16-0b89-4e80-a406-9fccfaa22d78 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:04.176668 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5ea16-0b89-4e80-a406-9fccfaa22d78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:04.178276 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-bee5ea16-0b89-4e80-a406-9fccfaa22d78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:04.283023 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5ea16-0b89-4e80-a406-9fccfaa22d78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:04.284435 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5ea16-0b89-4e80-a406-9fccfaa22d78 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:04.303171 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 738/1461] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:06.413924 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b24db5-3b2e-45fa-a21d-6ae2f58abe54 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:06.414538 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b24db5-3b2e-45fa-a21d-6ae2f58abe54 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:06.414538 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b24db5-3b2e-45fa-a21d-6ae2f58abe54 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:06.415877 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 724/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 08:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:44:06.421131 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba182f3b-2113-403a-a15c-0a5b9524dae7 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:06.421540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba182f3b-2113-403a-a15c-0a5b9524dae7 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:06.421699 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba182f3b-2113-403a-a15c-0a5b9524dae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:06.493885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-ba182f3b-2113-403a-a15c-0a5b9524dae7 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:06.495106 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-ba182f3b-2113-403a-a15c-0a5b9524dae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:06.535387 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:06.592955 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 739/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 08:44:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:06.629347 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b24db5-3b2e-45fa-a21d-6ae2f58abe54 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:06.630860 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b9b24db5-3b2e-45fa-a21d-6ae2f58abe54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:06.736009 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b24db5-3b2e-45fa-a21d-6ae2f58abe54 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:06.774187 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:06.810473 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37a7fb-e95c-41b9-879d-c026c7ab0465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:06.811119 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37a7fb-e95c-41b9-879d-c026c7ab0465 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:06.811410 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37a7fb-e95c-41b9-879d-c026c7ab0465 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:06.811712 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37a7fb-e95c-41b9-879d-c026c7ab0465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:06.813347 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-5e37a7fb-e95c-41b9-879d-c026c7ab0465 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:06.922288 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37a7fb-e95c-41b9-879d-c026c7ab0465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:06.923785 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37a7fb-e95c-41b9-879d-c026c7ab0465 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:06.941965 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 725/1464] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:09.080339 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e68735-7ad4-45a8-a9c1-f386a592a64d None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:09.080861 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e68735-7ad4-45a8-a9c1-f386a592a64d None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:09.080861 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e68735-7ad4-45a8-a9c1-f386a592a64d None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:09.082198 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 740/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 08:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:44:09.087561 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9a87c-c8f0-4a4d-b4d9-35f96169855f None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:09.088029 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9a87c-c8f0-4a4d-b4d9-35f96169855f None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:09.088132 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9a87c-c8f0-4a4d-b4d9-35f96169855f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:09.153860 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-4dd9a87c-c8f0-4a4d-b4d9-35f96169855f None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:09.155056 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4dd9a87c-c8f0-4a4d-b4d9-35f96169855f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:09.173516 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:09.251025 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 726/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 08:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:09.288413 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e68735-7ad4-45a8-a9c1-f386a592a64d None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:09.289939 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-d3e68735-7ad4-45a8-a9c1-f386a592a64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:09.392529 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e68735-7ad4-45a8-a9c1-f386a592a64d None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:09.458744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:09.466089 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c764633-834b-4466-8d46-7cff89814259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:09.466813 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c764633-834b-4466-8d46-7cff89814259 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:09.469902 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c764633-834b-4466-8d46-7cff89814259 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:09.469902 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c764633-834b-4466-8d46-7cff89814259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:09.469902 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-3c764633-834b-4466-8d46-7cff89814259 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:09.575897 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c764633-834b-4466-8d46-7cff89814259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:09.577321 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c764633-834b-4466-8d46-7cff89814259 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:09.595821 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 741/1467] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:11.620632 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81150b21-a3f9-4449-99ee-aebe4da56c0d None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:11.621198 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81150b21-a3f9-4449-99ee-aebe4da56c0d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:11.621198 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81150b21-a3f9-4449-99ee-aebe4da56c0d None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:11.622827 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 727/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 08:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:44:11.627944 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a40ec1-70e1-49c8-a1f5-b4a46e435f19 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:11.628377 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a40ec1-70e1-49c8-a1f5-b4a46e435f19 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:11.628511 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a40ec1-70e1-49c8-a1f5-b4a46e435f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:11.693633 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-21a40ec1-70e1-49c8-a1f5-b4a46e435f19 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:11.694852 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-21a40ec1-70e1-49c8-a1f5-b4a46e435f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:11.744608 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:11.795084 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 742/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 08:44:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:11.832233 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81150b21-a3f9-4449-99ee-aebe4da56c0d None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:11.833805 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-81150b21-a3f9-4449-99ee-aebe4da56c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:11.936568 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81150b21-a3f9-4449-99ee-aebe4da56c0d None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:11.983676 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:12.009210 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08922fee-04c9-4fff-a2e9-7fe6ad973a66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:12.009850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08922fee-04c9-4fff-a2e9-7fe6ad973a66 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:12.010135 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08922fee-04c9-4fff-a2e9-7fe6ad973a66 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:12.010413 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08922fee-04c9-4fff-a2e9-7fe6ad973a66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:12.012088 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-08922fee-04c9-4fff-a2e9-7fe6ad973a66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:12.120070 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08922fee-04c9-4fff-a2e9-7fe6ad973a66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:12.121617 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08922fee-04c9-4fff-a2e9-7fe6ad973a66 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:12.139753 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 728/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:21.792281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=22 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:22.137541 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=66 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:31.687096 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2aa6c-86cd-4932-b5fb-48b0d71d87de None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:31.687605 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2aa6c-86cd-4932-b5fb-48b0d71d87de None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:31.687605 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2aa6c-86cd-4932-b5fb-48b0d71d87de None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:31.688971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 743/1471] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:44:31.694226 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604290c3-7b80-4021-b3fd-9281a5baf0f7 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:31.694666 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604290c3-7b80-4021-b3fd-9281a5baf0f7 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:31.694866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604290c3-7b80-4021-b3fd-9281a5baf0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:31.761262 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-604290c3-7b80-4021-b3fd-9281a5baf0f7 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:31.763076 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-604290c3-7b80-4021-b3fd-9281a5baf0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:31.860151 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 729/1472] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:44:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:31.952275 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee3373-4422-466d-b5ca-ac1994febb8f None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:31.952569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee3373-4422-466d-b5ca-ac1994febb8f None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:31.952853 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee3373-4422-466d-b5ca-ac1994febb8f None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:31.954215 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 744/1473] 10.222.0.18 () {54 vars in 966 bytes} [Mon Jul 25 08:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:44:31.959025 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30599e46-0483-4cb1-9ade-54a9dfaa31e0 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:31.959323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30599e46-0483-4cb1-9ade-54a9dfaa31e0 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:31.959632 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30599e46-0483-4cb1-9ade-54a9dfaa31e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:32.035791 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-30599e46-0483-4cb1-9ade-54a9dfaa31e0 None None] MFA Rules not processed for user `dd75a24363c14e86b0fbbb782b372646`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:32.036997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-30599e46-0483-4cb1-9ade-54a9dfaa31e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:32.056725 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:32.111096 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 730/1474] 10.222.0.18 () {58 vars in 1063 bytes} [Mon Jul 25 08:44:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:32.118660 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee3373-4422-466d-b5ca-ac1994febb8f None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:32.120268 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-4cee3373-4422-466d-b5ca-ac1994febb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:32.222667 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee3373-4422-466d-b5ca-ac1994febb8f None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:32.294707 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2009dc8-9df5-4c54-809f-285a9fc4f0fe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd75a24363c14e86b0fbbb782b372646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:32.295340 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2009dc8-9df5-4c54-809f-285a9fc4f0fe service glance] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:32.295650 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2009dc8-9df5-4c54-809f-285a9fc4f0fe service glance] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:32.295925 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2009dc8-9df5-4c54-809f-285a9fc4f0fe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:32.297533 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-f2009dc8-9df5-4c54-809f-285a9fc4f0fe service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:32.350919 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:32.404750 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2009dc8-9df5-4c54-809f-285a9fc4f0fe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:32.406185 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2009dc8-9df5-4c54-809f-285a9fc4f0fe service glance] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:32.424796 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 745/1475] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:34.539186 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13961b-3d0a-4a4f-8930-597241b6f7f7 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:34.539776 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13961b-3d0a-4a4f-8930-597241b6f7f7 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:34.539888 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13961b-3d0a-4a4f-8930-597241b6f7f7 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:34.541191 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 731/1476] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:44:34.546737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4f9bd-843a-4c57-ab82-cb9f26da8bf4 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:34.547162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4f9bd-843a-4c57-ab82-cb9f26da8bf4 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:34.547294 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4f9bd-843a-4c57-ab82-cb9f26da8bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:34.612216 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-5eb4f9bd-843a-4c57-ab82-cb9f26da8bf4 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:34.613422 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-5eb4f9bd-843a-4c57-ab82-cb9f26da8bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:34.710782 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 746/1477] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:34.735089 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13961b-3d0a-4a4f-8930-597241b6f7f7 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:34.736640 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-da13961b-3d0a-4a4f-8930-597241b6f7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:34.862143 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13961b-3d0a-4a4f-8930-597241b6f7f7 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:34.911043 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:34.955333 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8568538-7d38-4194-b92d-7870b99ed2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:34.956018 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8568538-7d38-4194-b92d-7870b99ed2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:34.956302 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8568538-7d38-4194-b92d-7870b99ed2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:34.956576 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8568538-7d38-4194-b92d-7870b99ed2a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:34.957312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8568538-7d38-4194-b92d-7870b99ed2a3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:34.959016 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: WARNING py.warnings [None req-e8568538-7d38-4194-b92d-7870b99ed2a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:44:34.959016 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: warnings.warn(msg) Jul 25 08:44:34.959016 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: Jul 25 08:44:34.960238 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8568538-7d38-4194-b92d-7870b99ed2a3 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:34.979043 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 732/1478] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 08:44:34 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:44:36.993017 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1245d7-fc1b-441c-a9b8-da8aa1e01331 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:36.993584 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1245d7-fc1b-441c-a9b8-da8aa1e01331 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:36.993584 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1245d7-fc1b-441c-a9b8-da8aa1e01331 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:36.994922 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 747/1479] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:44:37.001039 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cac6f-8d66-4c5d-a31c-229d7ee39648 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:37.001447 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cac6f-8d66-4c5d-a31c-229d7ee39648 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:37.001600 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cac6f-8d66-4c5d-a31c-229d7ee39648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:37.067017 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-752cac6f-8d66-4c5d-a31c-229d7ee39648 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:37.068250 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-752cac6f-8d66-4c5d-a31c-229d7ee39648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:37.164222 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 733/1480] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:37.207679 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1245d7-fc1b-441c-a9b8-da8aa1e01331 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:37.209186 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-ff1245d7-fc1b-441c-a9b8-da8aa1e01331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:37.219105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:37.354863 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1245d7-fc1b-441c-a9b8-da8aa1e01331 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:37.436252 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:37.468639 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf43914-f33f-4564-a10a-3271ec3eaad7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:37.469385 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf43914-f33f-4564-a10a-3271ec3eaad7 service nova] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:37.469953 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf43914-f33f-4564-a10a-3271ec3eaad7 service nova] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:37.470231 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf43914-f33f-4564-a10a-3271ec3eaad7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:37.471890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-eaf43914-f33f-4564-a10a-3271ec3eaad7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:37.560322 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf43914-f33f-4564-a10a-3271ec3eaad7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:37.561862 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf43914-f33f-4564-a10a-3271ec3eaad7 service nova] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:37.579873 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 748/1481] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:39.760224 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0e6d2-a264-42bf-aa69-339466cda930 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:39.760756 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0e6d2-a264-42bf-aa69-339466cda930 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:39.760858 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0e6d2-a264-42bf-aa69-339466cda930 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:39.762810 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 734/1482] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:44:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:44:39.768134 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a81dc-2a35-4520-bc72-e2dee17f98fe None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:39.768558 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a81dc-2a35-4520-bc72-e2dee17f98fe None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:39.768688 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a81dc-2a35-4520-bc72-e2dee17f98fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:39.834527 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-733a81dc-2a35-4520-bc72-e2dee17f98fe None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:39.835785 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-733a81dc-2a35-4520-bc72-e2dee17f98fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:39.881290 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:39.931161 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 749/1483] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:44:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:39.967765 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0e6d2-a264-42bf-aa69-339466cda930 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:39.969273 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b0b0e6d2-a264-42bf-aa69-339466cda930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:39.992281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:40.077284 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0e6d2-a264-42bf-aa69-339466cda930 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:40.151106 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad5ea7-bf25-4ea7-89db-cf9739286097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:40.151790 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad5ea7-bf25-4ea7-89db-cf9739286097 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:40.152078 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad5ea7-bf25-4ea7-89db-cf9739286097 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:40.152356 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad5ea7-bf25-4ea7-89db-cf9739286097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:40.154007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-e7ad5ea7-bf25-4ea7-89db-cf9739286097 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:40.228698 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:40.263411 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad5ea7-bf25-4ea7-89db-cf9739286097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:40.265226 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad5ea7-bf25-4ea7-89db-cf9739286097 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:40.282977 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 735/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:42.363982 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f728d-3eb9-4d9e-beaf-9966342c0689 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:42.364577 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f728d-3eb9-4d9e-beaf-9966342c0689 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:42.364577 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f728d-3eb9-4d9e-beaf-9966342c0689 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:42.365930 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 750/1485] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:44:42.371871 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9956cb7-8565-48e1-8e0c-d376c94f0b93 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:42.372310 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9956cb7-8565-48e1-8e0c-d376c94f0b93 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:42.372523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9956cb7-8565-48e1-8e0c-d376c94f0b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:42.439773 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-c9956cb7-8565-48e1-8e0c-d376c94f0b93 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:42.440982 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c9956cb7-8565-48e1-8e0c-d376c94f0b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:42.535060 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 736/1486] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:44:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:44:42.573247 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f728d-3eb9-4d9e-beaf-9966342c0689 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:42.574817 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-836f728d-3eb9-4d9e-beaf-9966342c0689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:42.797328 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f728d-3eb9-4d9e-beaf-9966342c0689 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:42.867250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:42.869006 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba410277-2f21-445c-a3de-9395264a64a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:42.869708 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba410277-2f21-445c-a3de-9395264a64a7 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:42.869994 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba410277-2f21-445c-a3de-9395264a64a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:42.870272 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba410277-2f21-445c-a3de-9395264a64a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:42.872506 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-ba410277-2f21-445c-a3de-9395264a64a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:42.977921 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba410277-2f21-445c-a3de-9395264a64a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:42.979291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba410277-2f21-445c-a3de-9395264a64a7 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:42.998297 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 751/1487] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:45.108593 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb22a95-6ca2-4808-92c3-5932714d1c8d None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:45.109145 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb22a95-6ca2-4808-92c3-5932714d1c8d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:45.109145 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb22a95-6ca2-4808-92c3-5932714d1c8d None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:45.110444 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 737/1488] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:44:45.115696 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf273f9-72eb-4f23-8e4a-81807f11421b None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:45.116102 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf273f9-72eb-4f23-8e4a-81807f11421b None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:45.116241 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf273f9-72eb-4f23-8e4a-81807f11421b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:45.185475 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-dcf273f9-72eb-4f23-8e4a-81807f11421b None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:45.186679 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-dcf273f9-72eb-4f23-8e4a-81807f11421b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:45.247711 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:45.290825 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 752/1489] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:44:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:44:45.332595 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb22a95-6ca2-4808-92c3-5932714d1c8d None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:45.334147 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-ebb22a95-6ca2-4808-92c3-5932714d1c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:45.369656 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:45.438679 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb22a95-6ca2-4808-92c3-5932714d1c8d None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:45.514513 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ce249-6d67-4628-bf86-c44f30ec529d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:45.515161 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ce249-6d67-4628-bf86-c44f30ec529d service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:45.515441 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ce249-6d67-4628-bf86-c44f30ec529d service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:45.515748 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ce249-6d67-4628-bf86-c44f30ec529d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:45.517376 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-346ce249-6d67-4628-bf86-c44f30ec529d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:45.598362 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:45.629607 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ce249-6d67-4628-bf86-c44f30ec529d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:45.630975 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ce249-6d67-4628-bf86-c44f30ec529d service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:45.649083 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 738/1490] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:48.029728 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561e851-ef83-4983-ac15-8e77af2e6332 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:48.030254 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561e851-ef83-4983-ac15-8e77af2e6332 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:48.030254 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561e851-ef83-4983-ac15-8e77af2e6332 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:48.031594 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 753/1491] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 08:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 08:44:48.037181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc41272-5f1b-4d1c-98a0-36ca1672a04a None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:48.037584 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc41272-5f1b-4d1c-98a0-36ca1672a04a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:48.037734 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc41272-5f1b-4d1c-98a0-36ca1672a04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:48.101780 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-cfc41272-5f1b-4d1c-98a0-36ca1672a04a None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:44:48.102976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-cfc41272-5f1b-4d1c-98a0-36ca1672a04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:48.198881 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 739/1492] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 08:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:44:48.239103 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561e851-ef83-4983-ac15-8e77af2e6332 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:44:48.240687 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-a561e851-ef83-4983-ac15-8e77af2e6332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:48.343697 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561e851-ef83-4983-ac15-8e77af2e6332 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:44:48.414492 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f51256-1220-489e-a61e-e03a9fbba46c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:44:48.415136 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f51256-1220-489e-a61e-e03a9fbba46c service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:44:48.415409 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f51256-1220-489e-a61e-e03a9fbba46c service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:44:48.415719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f51256-1220-489e-a61e-e03a9fbba46c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:44:48.417332 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-a2f51256-1220-489e-a61e-e03a9fbba46c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:44:48.426705 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:48.522775 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f51256-1220-489e-a61e-e03a9fbba46c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:44:48.524246 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f51256-1220-489e-a61e-e03a9fbba46c service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:44:48.541826 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 754/1493] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:44:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:44:58.197117 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=82 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:44:58.539524 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=50 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:23.732618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea630e7-8a4f-4cfb-bc7f-4c418e44ed9a None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:23.733134 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea630e7-8a4f-4cfb-bc7f-4c418e44ed9a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:23.733237 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea630e7-8a4f-4cfb-bc7f-4c418e44ed9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:23.807685 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-eea630e7-8a4f-4cfb-bc7f-4c418e44ed9a None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:46:23.808915 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-eea630e7-8a4f-4cfb-bc7f-4c418e44ed9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:23.904770 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 740/1494] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:46:23.913083 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6d369-28d1-4eaa-9050-4080ed173b49 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:23.913578 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6d369-28d1-4eaa-9050-4080ed173b49 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:23.913681 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6d369-28d1-4eaa-9050-4080ed173b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:23.987663 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-e9b6d369-28d1-4eaa-9050-4080ed173b49 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:46:23.988814 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-e9b6d369-28d1-4eaa-9050-4080ed173b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:24.082928 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 755/1495] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:46:24.087600 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea630e7-8a4f-4cfb-bc7f-4c418e44ed9a None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:24.089449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-eea630e7-8a4f-4cfb-bc7f-4c418e44ed9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:24.100841 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea630e7-8a4f-4cfb-bc7f-4c418e44ed9a None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:24.161987 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:24.196754 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355455f-cbb0-4be7-98f1-4cd54bcb1c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:24.197416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355455f-cbb0-4be7-98f1-4cd54bcb1c3c admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:24.198279 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355455f-cbb0-4be7-98f1-4cd54bcb1c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:24.198611 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355455f-cbb0-4be7-98f1-4cd54bcb1c3c admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:24.199352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355455f-cbb0-4be7-98f1-4cd54bcb1c3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:46:24.199699 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355455f-cbb0-4be7-98f1-4cd54bcb1c3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:24.200718 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: WARNING py.warnings [None req-1355455f-cbb0-4be7-98f1-4cd54bcb1c3c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:46:24.200718 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: warnings.warn(msg) Jul 25 08:46:24.200718 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: Jul 25 08:46:24.201610 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355455f-cbb0-4be7-98f1-4cd54bcb1c3c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:24.213047 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 741/1496] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:46:24.221154 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6d369-28d1-4eaa-9050-4080ed173b49 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:24.230212 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6d369-28d1-4eaa-9050-4080ed173b49 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:24.290602 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:24.324652 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01871f4b-2e54-4225-b68e-3565de98d7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:24.325310 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01871f4b-2e54-4225-b68e-3565de98d7aa admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:24.325591 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01871f4b-2e54-4225-b68e-3565de98d7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:24.325864 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01871f4b-2e54-4225-b68e-3565de98d7aa admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:24.326544 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01871f4b-2e54-4225-b68e-3565de98d7aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:24.328312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: WARNING py.warnings [None req-01871f4b-2e54-4225-b68e-3565de98d7aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:46:24.328312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: warnings.warn(msg) Jul 25 08:46:24.328312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: Jul 25 08:46:24.329497 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01871f4b-2e54-4225-b68e-3565de98d7aa admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:24.440668 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 756/1497] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:46:24 2022] POST /identity/v3/projects => generated 377 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:46:24.445152 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355455f-cbb0-4be7-98f1-4cd54bcb1c3c admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:24.446825 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-1355455f-cbb0-4be7-98f1-4cd54bcb1c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:24.480876 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355455f-cbb0-4be7-98f1-4cd54bcb1c3c admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:24.574460 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6ec65-40b6-4b55-b3f8-f8304d49b776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:24.575048 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6ec65-40b6-4b55-b3f8-f8304d49b776 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:24.575326 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6ec65-40b6-4b55-b3f8-f8304d49b776 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:24.575597 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6ec65-40b6-4b55-b3f8-f8304d49b776 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:24.576334 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6ec65-40b6-4b55-b3f8-f8304d49b776 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:24.577342 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: WARNING py.warnings [None req-4ce6ec65-40b6-4b55-b3f8-f8304d49b776 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:46:24.577342 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: warnings.warn(msg) Jul 25 08:46:24.577342 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: Jul 25 08:46:24.578566 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6ec65-40b6-4b55-b3f8-f8304d49b776 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:24.711353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 742/1498] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:46:24 2022] POST /identity/v3/users => generated 289 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:46:24.712730 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01871f4b-2e54-4225-b68e-3565de98d7aa admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:24.714842 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-01871f4b-2e54-4225-b68e-3565de98d7aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:24.776191 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01871f4b-2e54-4225-b68e-3565de98d7aa admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:24.856879 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:24.866849 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f8398-a5df-4874-a9cd-c527f82508b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:24.867511 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f8398-a5df-4874-a9cd-c527f82508b6 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:24.867823 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f8398-a5df-4874-a9cd-c527f82508b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:24.868100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f8398-a5df-4874-a9cd-c527f82508b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:24.868823 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f8398-a5df-4874-a9cd-c527f82508b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:24.870382 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: WARNING py.warnings [None req-137f8398-a5df-4874-a9cd-c527f82508b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:46:24.870382 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: warnings.warn(msg) Jul 25 08:46:24.870382 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: Jul 25 08:46:24.871251 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f8398-a5df-4874-a9cd-c527f82508b6 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:24.883852 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 757/1499] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:46:24.888197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6ec65-40b6-4b55-b3f8-f8304d49b776 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:24.889712 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4ce6ec65-40b6-4b55-b3f8-f8304d49b776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:24.901797 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6ec65-40b6-4b55-b3f8-f8304d49b776 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:24.927453 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:24.996308 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f40754-f770-4e26-a87b-de0e7d6832bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:24.996975 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f40754-f770-4e26-a87b-de0e7d6832bf admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:24.997262 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f40754-f770-4e26-a87b-de0e7d6832bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:24.997540 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f40754-f770-4e26-a87b-de0e7d6832bf admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:24.998274 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f40754-f770-4e26-a87b-de0e7d6832bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:24.999288 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: WARNING py.warnings [None req-19f40754-f770-4e26-a87b-de0e7d6832bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:46:24.999288 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: warnings.warn(msg) Jul 25 08:46:24.999288 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: Jul 25 08:46:25.000200 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f40754-f770-4e26-a87b-de0e7d6832bf admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:25.013345 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 743/1500] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:46:25.017514 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f8398-a5df-4874-a9cd-c527f82508b6 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:25.019034 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-137f8398-a5df-4874-a9cd-c527f82508b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:25.052261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f8398-a5df-4874-a9cd-c527f82508b6 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:25.144485 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308a142-3112-442a-884c-1f8ce3c21bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:25.145295 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308a142-3112-442a-884c-1f8ce3c21bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:25.145574 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308a142-3112-442a-884c-1f8ce3c21bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:25.145848 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308a142-3112-442a-884c-1f8ce3c21bbe admin admin] PATH_INFO: `/v3/projects/ea31610131844e118967ef163d076855/users/835534c10601428b8f4dc0cc9b9ba9c7/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:25.169341 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308a142-3112-442a-884c-1f8ce3c21bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea31610131844e118967ef163d076855, user_id=835534c10601428b8f4dc0cc9b9ba9c7, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:25.170424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: WARNING py.warnings [None req-3308a142-3112-442a-884c-1f8ce3c21bbe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:46:25.170424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: warnings.warn(msg) Jul 25 08:46:25.170424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: Jul 25 08:46:25.172378 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308a142-3112-442a-884c-1f8ce3c21bbe admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:25.263712 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 758/1501] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:46:25 2022] PUT /identity/v3/projects/ea31610131844e118967ef163d076855/users/835534c10601428b8f4dc0cc9b9ba9c7/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:46:25.276440 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c90b5-61e9-4cee-97c8-78b26ba3610c None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:25.280416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c90b5-61e9-4cee-97c8-78b26ba3610c None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:25.280416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c90b5-61e9-4cee-97c8-78b26ba3610c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:25.332956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-b80c90b5-61e9-4cee-97c8-78b26ba3610c None None] MFA Rules not processed for user `835534c10601428b8f4dc0cc9b9ba9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:46:25.334188 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b80c90b5-61e9-4cee-97c8-78b26ba3610c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:25.410868 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 744/1502] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:46:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:46:25.424448 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7327e1-c4f6-4e26-9892-82ed4a1ba6e1 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:25.424740 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7327e1-c4f6-4e26-9892-82ed4a1ba6e1 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:25.425020 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7327e1-c4f6-4e26-9892-82ed4a1ba6e1 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:25.426439 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 759/1503] 10.222.0.18 () {54 vars in 964 bytes} [Mon Jul 25 08:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:46:25.431271 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd1a1a-2824-4a6d-84df-520cc0edc17d None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:25.431567 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd1a1a-2824-4a6d-84df-520cc0edc17d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:25.432391 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd1a1a-2824-4a6d-84df-520cc0edc17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:25.463230 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:25.508132 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-92cd1a1a-2824-4a6d-84df-520cc0edc17d None None] MFA Rules not processed for user `c53b69c61d9a46bc9e8aa1b4a9fd5fec`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:46:25.508816 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-92cd1a1a-2824-4a6d-84df-520cc0edc17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:25.585340 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 745/1504] 10.222.0.18 () {58 vars in 1061 bytes} [Mon Jul 25 08:46:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:46:25.593431 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7327e1-c4f6-4e26-9892-82ed4a1ba6e1 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:25.594933 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-5e7327e1-c4f6-4e26-9892-82ed4a1ba6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:25.644716 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:25.698345 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7327e1-c4f6-4e26-9892-82ed4a1ba6e1 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:25.773372 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194a3b3-ec4b-433b-b35e-923f3d768550 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:25.774016 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194a3b3-ec4b-433b-b35e-923f3d768550 service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:25.774296 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194a3b3-ec4b-433b-b35e-923f3d768550 service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:25.774566 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194a3b3-ec4b-433b-b35e-923f3d768550 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:25.776428 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-3194a3b3-ec4b-433b-b35e-923f3d768550 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:25.873704 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194a3b3-ec4b-433b-b35e-923f3d768550 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:25.875141 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194a3b3-ec4b-433b-b35e-923f3d768550 service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:25.878641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:25.892736 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 760/1505] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:46:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:46:25.939408 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a99d6-8652-461b-9806-af2ea1dd8668 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:25.939893 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a99d6-8652-461b-9806-af2ea1dd8668 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:25.940031 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a99d6-8652-461b-9806-af2ea1dd8668 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:25.941322 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 746/1506] 10.222.0.18 () {52 vars in 830 bytes} [Mon Jul 25 08:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:46:25.945004 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194a3b3-ec4b-433b-b35e-923f3d768550 service cinder] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:25.946211 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-3194a3b3-ec4b-433b-b35e-923f3d768550 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:26.042895 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194a3b3-ec4b-433b-b35e-923f3d768550 service cinder] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:26.132892 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bccfd26-a415-45ed-8647-36bfd9b33cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:26.133758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bccfd26-a415-45ed-8647-36bfd9b33cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:26.134038 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bccfd26-a415-45ed-8647-36bfd9b33cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:26.134310 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bccfd26-a415-45ed-8647-36bfd9b33cfa admin admin] PATH_INFO: `/v3/users/835534c10601428b8f4dc0cc9b9ba9c7` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:26.146856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bccfd26-a415-45ed-8647-36bfd9b33cfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=835534c10601428b8f4dc0cc9b9ba9c7)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:26.147925 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: WARNING py.warnings [None req-8bccfd26-a415-45ed-8647-36bfd9b33cfa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:46:26.147925 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: warnings.warn(msg) Jul 25 08:46:26.147925 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: Jul 25 08:46:26.149142 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bccfd26-a415-45ed-8647-36bfd9b33cfa admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:26.159349 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:26.284093 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-8bccfd26-a415-45ed-8647-36bfd9b33cfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '835534c10601428b8f4dc0cc9b9ba9c7'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:46:26.284785 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-8bccfd26-a415-45ed-8647-36bfd9b33cfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '835534c10601428b8f4dc0cc9b9ba9c7'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:46:26.285309 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-8bccfd26-a415-45ed-8647-36bfd9b33cfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '835534c10601428b8f4dc0cc9b9ba9c7'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:46:26.297548 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-8bccfd26-a415-45ed-8647-36bfd9b33cfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '835534c10601428b8f4dc0cc9b9ba9c7'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:46:26.347601 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-8bccfd26-a415-45ed-8647-36bfd9b33cfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '835534c10601428b8f4dc0cc9b9ba9c7'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:46:26.371760 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 761/1507] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:46:25 2022] DELETE /identity/v3/users/835534c10601428b8f4dc0cc9b9ba9c7 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:46:26.376332 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433bf83-b40d-4e27-982e-b5365d420050 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:26.376618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433bf83-b40d-4e27-982e-b5365d420050 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:26.376894 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433bf83-b40d-4e27-982e-b5365d420050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:26.434006 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-8433bf83-b40d-4e27-982e-b5365d420050 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:46:26.435229 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-8433bf83-b40d-4e27-982e-b5365d420050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:26.509633 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:26.522603 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 747/1508] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:46:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:46:26.533056 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bccfd26-a415-45ed-8647-36bfd9b33cfa admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:26.534557 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-8bccfd26-a415-45ed-8647-36bfd9b33cfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:26.634957 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bccfd26-a415-45ed-8647-36bfd9b33cfa admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:26.688574 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:26.708870 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b01ed3-38fd-48bb-99e4-e082ab03dc0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:26.709525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b01ed3-38fd-48bb-99e4-e082ab03dc0c service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:26.709807 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b01ed3-38fd-48bb-99e4-e082ab03dc0c service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:26.710083 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b01ed3-38fd-48bb-99e4-e082ab03dc0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:26.711890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-05b01ed3-38fd-48bb-99e4-e082ab03dc0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:26.819650 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b01ed3-38fd-48bb-99e4-e082ab03dc0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:26.821083 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b01ed3-38fd-48bb-99e4-e082ab03dc0c service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:26.839936 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 762/1509] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:46:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:46:27.269873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433bf83-b40d-4e27-982e-b5365d420050 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:46:27.271184 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-8433bf83-b40d-4e27-982e-b5365d420050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:46:27.283260 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433bf83-b40d-4e27-982e-b5365d420050 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:46:27.386327 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00892992-7500-46fa-8b96-fed97e1b8ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:46:27.387182 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00892992-7500-46fa-8b96-fed97e1b8ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:46:27.387465 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00892992-7500-46fa-8b96-fed97e1b8ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:46:27.387772 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00892992-7500-46fa-8b96-fed97e1b8ba8 admin admin] PATH_INFO: `/v3/projects/ea31610131844e118967ef163d076855` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:46:27.397727 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00892992-7500-46fa-8b96-fed97e1b8ba8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea31610131844e118967ef163d076855)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:46:27.398790 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: WARNING py.warnings [None req-00892992-7500-46fa-8b96-fed97e1b8ba8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:46:27.398790 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: warnings.warn(msg) Jul 25 08:46:27.398790 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: Jul 25 08:46:27.400023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00892992-7500-46fa-8b96-fed97e1b8ba8 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:46:27.494962 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-00892992-7500-46fa-8b96-fed97e1b8ba8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea31610131844e118967ef163d076855', 'request_id': 'req-00892992-7500-46fa-8b96-fed97e1b8ba8'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:46:27.507854 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-00892992-7500-46fa-8b96-fed97e1b8ba8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea31610131844e118967ef163d076855', 'request_id': 'req-00892992-7500-46fa-8b96-fed97e1b8ba8'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:46:27.513988 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-00892992-7500-46fa-8b96-fed97e1b8ba8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea31610131844e118967ef163d076855', 'request_id': 'req-00892992-7500-46fa-8b96-fed97e1b8ba8'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:46:27.592474 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-00892992-7500-46fa-8b96-fed97e1b8ba8 admin admin] The token cache is being invalidate because project ea31610131844e118967ef163d076855 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:46:27.592763 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-00892992-7500-46fa-8b96-fed97e1b8ba8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:46:27.593187 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-00892992-7500-46fa-8b96-fed97e1b8ba8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:46:27.594630 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 748/1510] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:46:27 2022] DELETE /identity/v3/projects/ea31610131844e118967ef163d076855 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:46:36.837012 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=62 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:46:37.590510 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:48:06.987853 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13bb3c-84f5-4b9b-a734-c21921ab0c25 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:06.988441 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13bb3c-84f5-4b9b-a734-c21921ab0c25 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:06.988441 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13bb3c-84f5-4b9b-a734-c21921ab0c25 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:06.989700 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 763/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 08:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:48:06.994526 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf420e2-b4e2-4fe0-b75e-f91fa471adae None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:06.994969 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf420e2-b4e2-4fe0-b75e-f91fa471adae None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:06.995070 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf420e2-b4e2-4fe0-b75e-f91fa471adae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:07.076113 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-dcf420e2-b4e2-4fe0-b75e-f91fa471adae None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:48:07.077858 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-dcf420e2-b4e2-4fe0-b75e-f91fa471adae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:48:07.180023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 749/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 08:48:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:48:07.336290 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13bb3c-84f5-4b9b-a734-c21921ab0c25 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:48:07.338541 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-3c13bb3c-84f5-4b9b-a734-c21921ab0c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:48:07.457677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13bb3c-84f5-4b9b-a734-c21921ab0c25 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:48:07.463182 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6034c-b919-49b0-a933-e442ce0f85fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:48:07.463849 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6034c-b919-49b0-a933-e442ce0f85fd service nova] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:07.464137 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6034c-b919-49b0-a933-e442ce0f85fd service nova] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:07.464410 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6034c-b919-49b0-a933-e442ce0f85fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:07.472681 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6034c-b919-49b0-a933-e442ce0f85fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:48:07.474662 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6034c-b919-49b0-a933-e442ce0f85fd service nova] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:48:07.483596 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 764/1513] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:48:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:48:08.322015 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcfb7a9-3a4c-486a-a502-3299e822fe15 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:08.322549 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcfb7a9-3a4c-486a-a502-3299e822fe15 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:08.322549 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcfb7a9-3a4c-486a-a502-3299e822fe15 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:08.323899 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 750/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 08:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:48:08.328992 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c21c1b-18f3-4d54-bd4b-6f7de49e7f2a None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:08.329399 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c21c1b-18f3-4d54-bd4b-6f7de49e7f2a None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:08.329549 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c21c1b-18f3-4d54-bd4b-6f7de49e7f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:08.349009 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-07c21c1b-18f3-4d54-bd4b-6f7de49e7f2a None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:48:08.350202 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-07c21c1b-18f3-4d54-bd4b-6f7de49e7f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:48:08.357924 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 765/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 08:48:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:48:08.510552 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcfb7a9-3a4c-486a-a502-3299e822fe15 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:48:08.526160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcfb7a9-3a4c-486a-a502-3299e822fe15 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:48:08.532543 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11f628-f9dc-41ac-afea-c878b15150f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:48:08.533419 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11f628-f9dc-41ac-afea-c878b15150f4 service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:08.533710 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11f628-f9dc-41ac-afea-c878b15150f4 service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:08.533986 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11f628-f9dc-41ac-afea-c878b15150f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:08.542121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11f628-f9dc-41ac-afea-c878b15150f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:48:08.543724 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11f628-f9dc-41ac-afea-c878b15150f4 service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:48:08.553118 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 751/1516] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:48:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:48:09.322405 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f05ee2-cd91-4ffb-8179-2e979236d58f None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:09.322831 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f05ee2-cd91-4ffb-8179-2e979236d58f None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:09.323120 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f05ee2-cd91-4ffb-8179-2e979236d58f None None] PATH_INFO: `/v3` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:09.324462 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 766/1517] 10.222.0.59 () {54 vars in 925 bytes} [Mon Jul 25 08:48:09 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:48:09.331004 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad6b8d-1db3-41a1-a4d3-804ee5ab0312 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:09.331416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad6b8d-1db3-41a1-a4d3-804ee5ab0312 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:09.331588 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad6b8d-1db3-41a1-a4d3-804ee5ab0312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:09.392436 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-24ad6b8d-1db3-41a1-a4d3-804ee5ab0312 None None] MFA Rules not processed for user `dfb4be75496444dd897b880c2ac3e67e`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:48:09.393668 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-24ad6b8d-1db3-41a1-a4d3-804ee5ab0312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:48:09.411031 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:48:09.465566 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 752/1518] 10.222.0.59 () {58 vars in 1015 bytes} [Mon Jul 25 08:48:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:48:13.495158 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da765e-0056-4ca2-a062-c16247a3cd22 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:13.495768 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da765e-0056-4ca2-a062-c16247a3cd22 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:13.495768 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da765e-0056-4ca2-a062-c16247a3cd22 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:13.497140 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 767/1519] 10.222.0.18 () {54 vars in 961 bytes} [Mon Jul 25 08:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:48:13.502293 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1db147-0cb1-484e-9ef8-a81dc0bbf768 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:13.502758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1db147-0cb1-484e-9ef8-a81dc0bbf768 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:13.502864 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1db147-0cb1-484e-9ef8-a81dc0bbf768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:13.522004 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-ce1db147-0cb1-484e-9ef8-a81dc0bbf768 None None] MFA Rules not processed for user `dfb4be75496444dd897b880c2ac3e67e`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:48:13.523198 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-ce1db147-0cb1-484e-9ef8-a81dc0bbf768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:48:13.532457 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 753/1520] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Jul 25 08:48:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:48:13.540079 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da765e-0056-4ca2-a062-c16247a3cd22 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:48:13.553849 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da765e-0056-4ca2-a062-c16247a3cd22 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:48:13.558785 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b2ade-a908-4829-b50c-e0e41e1385be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfb4be75496444dd897b880c2ac3e67e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:48:13.559418 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b2ade-a908-4829-b50c-e0e41e1385be service placement] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:13.559732 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b2ade-a908-4829-b50c-e0e41e1385be service placement] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:13.560011 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b2ade-a908-4829-b50c-e0e41e1385be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:13.568229 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b2ade-a908-4829-b50c-e0e41e1385be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:48:13.569805 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b2ade-a908-4829-b50c-e0e41e1385be service placement] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:48:13.579682 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 768/1521] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:48:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:48:19.757336 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a34b8-fd4d-4d21-b69b-da0420055b39 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:19.757884 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a34b8-fd4d-4d21-b69b-da0420055b39 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:19.757884 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a34b8-fd4d-4d21-b69b-da0420055b39 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:19.759300 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 754/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 08:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:48:19.764019 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5e435-3988-4cd2-b580-e5680112cab1 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:19.764404 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5e435-3988-4cd2-b580-e5680112cab1 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:19.764618 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5e435-3988-4cd2-b580-e5680112cab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:19.783988 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-d4b5e435-3988-4cd2-b580-e5680112cab1 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:48:19.785180 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-d4b5e435-3988-4cd2-b580-e5680112cab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:48:19.792952 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 769/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 08:48:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:48:19.949724 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a34b8-fd4d-4d21-b69b-da0420055b39 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:48:19.965582 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a34b8-fd4d-4d21-b69b-da0420055b39 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:48:19.970030 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42377fa3-35b2-4097-ae5b-07b7ed9ce483 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:48:19.970658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42377fa3-35b2-4097-ae5b-07b7ed9ce483 service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:19.970938 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42377fa3-35b2-4097-ae5b-07b7ed9ce483 service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:19.971212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42377fa3-35b2-4097-ae5b-07b7ed9ce483 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:19.979463 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42377fa3-35b2-4097-ae5b-07b7ed9ce483 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:48:19.981127 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42377fa3-35b2-4097-ae5b-07b7ed9ce483 service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:48:19.991134 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 755/1524] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:48:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:48:20.825880 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3499788-8d6d-4715-96da-cccca4d1c03c None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:20.826460 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3499788-8d6d-4715-96da-cccca4d1c03c None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:20.826460 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3499788-8d6d-4715-96da-cccca4d1c03c None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:20.828458 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 770/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 08:48:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:48:20.833208 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb6eb2-3744-4095-9eb0-855033715071 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:20.833634 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb6eb2-3744-4095-9eb0-855033715071 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:20.833757 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb6eb2-3744-4095-9eb0-855033715071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:20.852761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-82bb6eb2-3744-4095-9eb0-855033715071 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:48:20.853953 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-82bb6eb2-3744-4095-9eb0-855033715071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:48:20.861731 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 756/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 08:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:48:21.014202 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3499788-8d6d-4715-96da-cccca4d1c03c None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:48:21.029153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3499788-8d6d-4715-96da-cccca4d1c03c None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:48:21.035072 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e715a7-4e59-4bc1-a3d3-873be19de36b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:48:21.035736 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e715a7-4e59-4bc1-a3d3-873be19de36b service nova] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:21.036024 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e715a7-4e59-4bc1-a3d3-873be19de36b service nova] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:21.036301 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e715a7-4e59-4bc1-a3d3-873be19de36b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:21.044316 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e715a7-4e59-4bc1-a3d3-873be19de36b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:48:21.045987 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e715a7-4e59-4bc1-a3d3-873be19de36b service nova] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:48:21.055500 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 771/1527] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:48:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:48:24.924715 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e7ce0-31d6-4116-b29f-9d738874b145 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:24.925276 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e7ce0-31d6-4116-b29f-9d738874b145 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:24.925276 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e7ce0-31d6-4116-b29f-9d738874b145 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:24.926684 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 757/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 08:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:48:24.931899 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75872f49-210b-45eb-b05f-9486d6247e87 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:24.932331 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75872f49-210b-45eb-b05f-9486d6247e87 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:24.932452 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75872f49-210b-45eb-b05f-9486d6247e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:24.951658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-75872f49-210b-45eb-b05f-9486d6247e87 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:48:24.953378 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-75872f49-210b-45eb-b05f-9486d6247e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:48:24.961268 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 772/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 08:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:48:25.033713 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e7ce0-31d6-4116-b29f-9d738874b145 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:48:25.035467 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-878e7ce0-31d6-4116-b29f-9d738874b145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:48:25.113206 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e7ce0-31d6-4116-b29f-9d738874b145 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:48:25.116735 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c72f02-f5f0-424b-a83e-efcd29b4cf70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:48:25.117411 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c72f02-f5f0-424b-a83e-efcd29b4cf70 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:25.117694 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c72f02-f5f0-424b-a83e-efcd29b4cf70 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:25.117971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c72f02-f5f0-424b-a83e-efcd29b4cf70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:25.126774 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c72f02-f5f0-424b-a83e-efcd29b4cf70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:48:25.128237 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c72f02-f5f0-424b-a83e-efcd29b4cf70 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:48:25.137492 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 758/1530] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:48:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:48:27.121361 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfcbbd-7e20-44a4-b89f-ac16a91356ec None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:27.121893 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfcbbd-7e20-44a4-b89f-ac16a91356ec None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:27.121893 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfcbbd-7e20-44a4-b89f-ac16a91356ec None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:27.123249 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 773/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 08:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:48:27.128881 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce9914-670c-4ff8-b1df-ec42a659e30f None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:27.129319 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce9914-670c-4ff8-b1df-ec42a659e30f None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:27.129440 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce9914-670c-4ff8-b1df-ec42a659e30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:27.149942 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-03ce9914-670c-4ff8-b1df-ec42a659e30f None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:48:27.151131 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-03ce9914-670c-4ff8-b1df-ec42a659e30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:48:27.159494 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 759/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 08:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:48:27.194999 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cfcbbd-7e20-44a4-b89f-ac16a91356ec None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:48:27.196723 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-95cfcbbd-7e20-44a4-b89f-ac16a91356ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:48:27.210219 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cfcbbd-7e20-44a4-b89f-ac16a91356ec None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:48:27.213692 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82638216-8169-43b7-87ba-4c6bdec4af09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:48:27.214325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82638216-8169-43b7-87ba-4c6bdec4af09 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:27.214607 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82638216-8169-43b7-87ba-4c6bdec4af09 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:27.214885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82638216-8169-43b7-87ba-4c6bdec4af09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:27.223791 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82638216-8169-43b7-87ba-4c6bdec4af09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:48:27.225213 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82638216-8169-43b7-87ba-4c6bdec4af09 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:48:27.234897 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 774/1533] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:48:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:48:30.720913 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bd195-66b6-479e-a409-1b2a9d53c703 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:30.721388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bd195-66b6-479e-a409-1b2a9d53c703 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:30.721495 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bd195-66b6-479e-a409-1b2a9d53c703 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:30.722848 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 760/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 08:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:48:30.728060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59812d-9847-45c2-9d46-a8c113346b73 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:30.728505 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59812d-9847-45c2-9d46-a8c113346b73 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:30.728610 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59812d-9847-45c2-9d46-a8c113346b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:30.748568 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-ff59812d-9847-45c2-9d46-a8c113346b73 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:48:30.749785 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-ff59812d-9847-45c2-9d46-a8c113346b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:48:30.758300 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 775/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 08:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:48:31.063638 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2bd195-66b6-479e-a409-1b2a9d53c703 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:48:31.065365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-3f2bd195-66b6-479e-a409-1b2a9d53c703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:48:31.130679 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:48:31.144518 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2bd195-66b6-479e-a409-1b2a9d53c703 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:48:31.148143 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be7326-0c3d-41f3-9464-a276059a2176 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:48:31.148787 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be7326-0c3d-41f3-9464-a276059a2176 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:31.149071 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be7326-0c3d-41f3-9464-a276059a2176 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:31.149347 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be7326-0c3d-41f3-9464-a276059a2176 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:31.160037 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be7326-0c3d-41f3-9464-a276059a2176 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:48:31.161457 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be7326-0c3d-41f3-9464-a276059a2176 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:48:31.170761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 761/1536] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:48:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:48:33.294770 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944d3cd-d8d2-4d6c-8414-f3d94b431598 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:33.295354 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944d3cd-d8d2-4d6c-8414-f3d94b431598 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:33.295354 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944d3cd-d8d2-4d6c-8414-f3d94b431598 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:33.296732 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 776/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 08:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:48:33.301917 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad73a29-a283-4a2f-873d-44c8c2b188da None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:33.302322 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad73a29-a283-4a2f-873d-44c8c2b188da None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:33.302479 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad73a29-a283-4a2f-873d-44c8c2b188da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:33.322559 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-1ad73a29-a283-4a2f-873d-44c8c2b188da None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:48:33.323781 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-1ad73a29-a283-4a2f-873d-44c8c2b188da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:48:33.332730 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 762/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 08:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:48:33.642129 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944d3cd-d8d2-4d6c-8414-f3d94b431598 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:48:33.643850 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-6944d3cd-d8d2-4d6c-8414-f3d94b431598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:48:33.656492 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944d3cd-d8d2-4d6c-8414-f3d94b431598 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:48:33.660512 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd2555-0801-4d55-a24d-949d40858739 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:48:33.661139 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd2555-0801-4d55-a24d-949d40858739 service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:48:33.661414 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd2555-0801-4d55-a24d-949d40858739 service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:48:33.661694 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd2555-0801-4d55-a24d-949d40858739 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:48:33.670559 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd2555-0801-4d55-a24d-949d40858739 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:48:33.672014 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd2555-0801-4d55-a24d-949d40858739 service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:48:33.682485 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 777/1539] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:48:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:48:43.317891 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=11 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:48:43.678240 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=89 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:04.485488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfeb619-f2f3-4cfa-8b2b-50cfa084c3a4 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:04.486307 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfeb619-f2f3-4cfa-8b2b-50cfa084c3a4 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:04.486307 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfeb619-f2f3-4cfa-8b2b-50cfa084c3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:04.511875 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-3cfeb619-f2f3-4cfa-8b2b-50cfa084c3a4 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:04.513091 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-3cfeb619-f2f3-4cfa-8b2b-50cfa084c3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:04.526450 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 763/1540] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:04.530624 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719551ae-3841-4c3c-baff-c57c81a53780 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:04.531133 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719551ae-3841-4c3c-baff-c57c81a53780 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:04.531225 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719551ae-3841-4c3c-baff-c57c81a53780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:04.543938 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9f8f2-cb20-409a-95ee-717b7fd940af None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:04.544266 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9f8f2-cb20-409a-95ee-717b7fd940af None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:04.544512 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9f8f2-cb20-409a-95ee-717b7fd940af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:04.562888 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-719551ae-3841-4c3c-baff-c57c81a53780 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:04.568229 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-719551ae-3841-4c3c-baff-c57c81a53780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:04.570820 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-8fb9f8f2-cb20-409a-95ee-717b7fd940af None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:04.572036 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-8fb9f8f2-cb20-409a-95ee-717b7fd940af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:04.578791 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 778/1541] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:04.588907 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae86d9-484e-4d11-86b4-8a2d8c1f6917 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:04.589320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae86d9-484e-4d11-86b4-8a2d8c1f6917 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:04.589624 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae86d9-484e-4d11-86b4-8a2d8c1f6917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:04.591256 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 764/1542] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:04.596038 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9f8f2-cb20-409a-95ee-717b7fd940af None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:04.606318 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9f8f2-cb20-409a-95ee-717b7fd940af None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:04.621469 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b01ce2-5459-442b-b296-d194326ee990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:04.621928 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-ebae86d9-484e-4d11-86b4-8a2d8c1f6917 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:04.622364 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b01ce2-5459-442b-b296-d194326ee990 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:04.622652 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b01ce2-5459-442b-b296-d194326ee990 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:04.622928 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b01ce2-5459-442b-b296-d194326ee990 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:04.623690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b01ce2-5459-442b-b296-d194326ee990 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:50:04.624145 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-ebae86d9-484e-4d11-86b4-8a2d8c1f6917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:04.624334 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b01ce2-5459-442b-b296-d194326ee990 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:04.626097 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b01ce2-5459-442b-b296-d194326ee990 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:04.646328 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 765/1543] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:50:04.652006 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 779/1544] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:04.654073 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b01ce2-5459-442b-b296-d194326ee990 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:04.657423 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae86d9-484e-4d11-86b4-8a2d8c1f6917 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:04.667126 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b01ce2-5459-442b-b296-d194326ee990 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:04.674735 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae86d9-484e-4d11-86b4-8a2d8c1f6917 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:04.675911 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee0d73-2ea7-40a1-aa09-43faac5987b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:04.676811 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee0d73-2ea7-40a1-aa09-43faac5987b7 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:04.677107 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee0d73-2ea7-40a1-aa09-43faac5987b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:04.677391 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee0d73-2ea7-40a1-aa09-43faac5987b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:04.678099 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee0d73-2ea7-40a1-aa09-43faac5987b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:04.679307 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: WARNING py.warnings [None req-d2ee0d73-2ea7-40a1-aa09-43faac5987b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:50:04.679307 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: warnings.warn(msg) Jul 25 08:50:04.679307 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: Jul 25 08:50:04.681951 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee0d73-2ea7-40a1-aa09-43faac5987b7 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:04.685508 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51904c09-2575-463a-9fca-133ef1b4b38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:04.686196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51904c09-2575-463a-9fca-133ef1b4b38d admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:04.686479 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51904c09-2575-463a-9fca-133ef1b4b38d admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:04.686757 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51904c09-2575-463a-9fca-133ef1b4b38d admin admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:04.691633 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51904c09-2575-463a-9fca-133ef1b4b38d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:50:04.691633 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51904c09-2575-463a-9fca-133ef1b4b38d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:04.691633 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: WARNING py.warnings [None req-51904c09-2575-463a-9fca-133ef1b4b38d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:50:04.691633 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: warnings.warn(msg) Jul 25 08:50:04.691633 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: Jul 25 08:50:04.691633 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51904c09-2575-463a-9fca-133ef1b4b38d admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:04.719632 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 780/1545] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:50:04.719812 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2719fc-3b88-4653-a6d4-7c42072a154f None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:04.720064 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2719fc-3b88-4653-a6d4-7c42072a154f None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:04.720348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2719fc-3b88-4653-a6d4-7c42072a154f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:04.754918 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-aa2719fc-3b88-4653-a6d4-7c42072a154f None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:04.754918 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-aa2719fc-3b88-4653-a6d4-7c42072a154f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:04.767259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 781/1546] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:04.769464 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94b1d9-8c77-4e36-baf5-20cbfbd1e83d None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:04.770328 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94b1d9-8c77-4e36-baf5-20cbfbd1e83d None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:04.770858 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94b1d9-8c77-4e36-baf5-20cbfbd1e83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:04.793553 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-ef94b1d9-8c77-4e36-baf5-20cbfbd1e83d None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:04.794864 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-ef94b1d9-8c77-4e36-baf5-20cbfbd1e83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:04.804235 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 782/1547] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:04.806292 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3709b-62fb-4169-8465-e373c0b31203 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:04.806587 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3709b-62fb-4169-8465-e373c0b31203 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:04.806836 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3709b-62fb-4169-8465-e373c0b31203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:04.825291 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 766/1548] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:50:04 2022] POST /identity/v3/projects => generated 375 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:04.826180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee0d73-2ea7-40a1-aa09-43faac5987b7 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:04.827021 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-12e3709b-62fb-4169-8465-e373c0b31203 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:04.828251 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-12e3709b-62fb-4169-8465-e373c0b31203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:04.890496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 783/1549] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:04.891794 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee0d73-2ea7-40a1-aa09-43faac5987b7 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:04.891937 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d30be-d076-479a-9573-6b851812ac39 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:04.892184 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d30be-d076-479a-9573-6b851812ac39 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:04.892464 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d30be-d076-479a-9573-6b851812ac39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:04.897428 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce51303-3adf-40c7-b9a2-b4f27ccfc8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:04.898235 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce51303-3adf-40c7-b9a2-b4f27ccfc8aa admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:04.898532 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce51303-3adf-40c7-b9a2-b4f27ccfc8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:04.898814 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce51303-3adf-40c7-b9a2-b4f27ccfc8aa admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:04.899865 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce51303-3adf-40c7-b9a2-b4f27ccfc8aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:04.901872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce51303-3adf-40c7-b9a2-b4f27ccfc8aa admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:04.913847 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-052d30be-d076-479a-9573-6b851812ac39 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:04.915062 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-052d30be-d076-479a-9573-6b851812ac39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:04.923460 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 784/1550] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:04.925363 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9754ec4-fd0a-4728-a71c-0ed17b494726 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:04.929959 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9754ec4-fd0a-4728-a71c-0ed17b494726 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:04.929959 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9754ec4-fd0a-4728-a71c-0ed17b494726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:04.947015 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-e9754ec4-fd0a-4728-a71c-0ed17b494726 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:04.948259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-e9754ec4-fd0a-4728-a71c-0ed17b494726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:04.956656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 785/1551] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:04.957981 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd1cdc-b4ed-4c5b-ad61-bc17eeb659be None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:04.958277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd1cdc-b4ed-4c5b-ad61-bc17eeb659be None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:04.958559 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd1cdc-b4ed-4c5b-ad61-bc17eeb659be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:04.977154 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-71bd1cdc-b4ed-4c5b-ad61-bc17eeb659be None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:04.981530 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-71bd1cdc-b4ed-4c5b-ad61-bc17eeb659be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:04.986164 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 786/1552] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:04.988048 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401712f-4784-4ac7-9689-7a7bc91a02fc None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:04.988338 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401712f-4784-4ac7-9689-7a7bc91a02fc None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:04.988706 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401712f-4784-4ac7-9689-7a7bc91a02fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:05.009611 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-1401712f-4784-4ac7-9689-7a7bc91a02fc None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:05.009611 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-1401712f-4784-4ac7-9689-7a7bc91a02fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:05.010061 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 767/1553] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:50:04 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:05.011286 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331262c-4202-4dec-b24c-d00039faf40a None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:05.011580 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331262c-4202-4dec-b24c-d00039faf40a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:05.011892 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331262c-4202-4dec-b24c-d00039faf40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:05.031331 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-e331262c-4202-4dec-b24c-d00039faf40a None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:05.033446 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-e331262c-4202-4dec-b24c-d00039faf40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:05.071829 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 787/1554] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:05.072977 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401712f-4784-4ac7-9689-7a7bc91a02fc None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:05.086629 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401712f-4784-4ac7-9689-7a7bc91a02fc None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:05.091239 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a5de1-e9ca-4e85-84c2-98d9c51b5772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:05.091933 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a5de1-e9ca-4e85-84c2-98d9c51b5772 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:05.092218 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a5de1-e9ca-4e85-84c2-98d9c51b5772 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:05.092492 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a5de1-e9ca-4e85-84c2-98d9c51b5772 admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:05.093178 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a5de1-e9ca-4e85-84c2-98d9c51b5772 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:05.094162 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 768/1555] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:05.094315 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: WARNING py.warnings [None req-908a5de1-e9ca-4e85-84c2-98d9c51b5772 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:50:05.094315 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: warnings.warn(msg) Jul 25 08:50:05.094315 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: Jul 25 08:50:05.095387 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a5de1-e9ca-4e85-84c2-98d9c51b5772 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:05.095662 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2c77a-7559-4be8-87d4-1c3e56693e31 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:05.095965 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2c77a-7559-4be8-87d4-1c3e56693e31 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:05.096249 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2c77a-7559-4be8-87d4-1c3e56693e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:05.116099 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-3ba2c77a-7559-4be8-87d4-1c3e56693e31 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:05.119107 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-3ba2c77a-7559-4be8-87d4-1c3e56693e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:05.125864 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 769/1556] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:05.127051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a4e7d-1351-4d5a-8828-295eed646e02 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:05.127335 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a4e7d-1351-4d5a-8828-295eed646e02 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:05.127707 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a4e7d-1351-4d5a-8828-295eed646e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:05.147308 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-f46a4e7d-1351-4d5a-8828-295eed646e02 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:05.148553 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f46a4e7d-1351-4d5a-8828-295eed646e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:05.156604 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 770/1557] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:05.157634 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a4e7d-1351-4d5a-8828-295eed646e02 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:05.167989 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a4e7d-1351-4d5a-8828-295eed646e02 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:05.172776 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682dec7-50b5-4e9c-bc48-e05106bc1df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:05.173419 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682dec7-50b5-4e9c-bc48-e05106bc1df3 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:05.173708 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682dec7-50b5-4e9c-bc48-e05106bc1df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:05.173991 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682dec7-50b5-4e9c-bc48-e05106bc1df3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:05.174841 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682dec7-50b5-4e9c-bc48-e05106bc1df3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:50:05.175158 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682dec7-50b5-4e9c-bc48-e05106bc1df3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:05.176820 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682dec7-50b5-4e9c-bc48-e05106bc1df3 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:05.195636 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 771/1558] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:50:05.195636 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811f7d9-3ce8-4efe-b2a5-ac47a94dc423 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:05.195636 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811f7d9-3ce8-4efe-b2a5-ac47a94dc423 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:05.195636 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811f7d9-3ce8-4efe-b2a5-ac47a94dc423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:05.196713 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 788/1559] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:50:05 2022] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:05.197766 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a5de1-e9ca-4e85-84c2-98d9c51b5772 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:05.198312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:05.208943 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a5de1-e9ca-4e85-84c2-98d9c51b5772 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:05.211798 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-6811f7d9-3ce8-4efe-b2a5-ac47a94dc423 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:05.212998 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6811f7d9-3ce8-4efe-b2a5-ac47a94dc423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:05.213563 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2256459-9e31-4ca8-b685-3e578bacd0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:05.214222 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2256459-9e31-4ca8-b685-3e578bacd0ef admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:05.214501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2256459-9e31-4ca8-b685-3e578bacd0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:05.214778 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2256459-9e31-4ca8-b685-3e578bacd0ef admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:05.215465 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2256459-9e31-4ca8-b685-3e578bacd0ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:05.217479 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2256459-9e31-4ca8-b685-3e578bacd0ef admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:05.223841 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 772/1560] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:05.228436 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407ca93-bf5f-45d4-a2ba-1e439bebeb90 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:05.228436 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407ca93-bf5f-45d4-a2ba-1e439bebeb90 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:05.228436 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407ca93-bf5f-45d4-a2ba-1e439bebeb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:05.246117 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-6407ca93-bf5f-45d4-a2ba-1e439bebeb90 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:05.248139 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6407ca93-bf5f-45d4-a2ba-1e439bebeb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:05.257402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 773/1561] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:05.257944 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407ca93-bf5f-45d4-a2ba-1e439bebeb90 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:05.266976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407ca93-bf5f-45d4-a2ba-1e439bebeb90 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:05.272529 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f5f5d-7726-4428-b8c3-450dff30214c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:05.277843 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f5f5d-7726-4428-b8c3-450dff30214c admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:05.277843 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f5f5d-7726-4428-b8c3-450dff30214c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:05.277843 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f5f5d-7726-4428-b8c3-450dff30214c admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:05.277843 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f5f5d-7726-4428-b8c3-450dff30214c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:50:05.277843 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f5f5d-7726-4428-b8c3-450dff30214c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:05.277843 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f5f5d-7726-4428-b8c3-450dff30214c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:05.289584 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 774/1562] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:50:05.291548 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f5f5d-7726-4428-b8c3-450dff30214c admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:05.297083 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 789/1563] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:50:05 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:05.298124 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2256459-9e31-4ca8-b685-3e578bacd0ef admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:05.304298 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f5f5d-7726-4428-b8c3-450dff30214c admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:05.308461 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2256459-9e31-4ca8-b685-3e578bacd0ef admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:05.308975 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85254d05-9ffa-4d50-a9ee-c6853143ebdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:05.309633 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85254d05-9ffa-4d50-a9ee-c6853143ebdb admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:05.309919 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85254d05-9ffa-4d50-a9ee-c6853143ebdb admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:05.310198 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85254d05-9ffa-4d50-a9ee-c6853143ebdb admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:05.310932 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85254d05-9ffa-4d50-a9ee-c6853143ebdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:50:05.311245 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85254d05-9ffa-4d50-a9ee-c6853143ebdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:05.312875 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85254d05-9ffa-4d50-a9ee-c6853143ebdb admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:05.313440 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cccfb-47c3-4687-bd6d-fc711d2fc777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:05.314310 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cccfb-47c3-4687-bd6d-fc711d2fc777 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:05.314660 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cccfb-47c3-4687-bd6d-fc711d2fc777 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:05.315002 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cccfb-47c3-4687-bd6d-fc711d2fc777 admin admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:05.316624 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cccfb-47c3-4687-bd6d-fc711d2fc777 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:50:05.316929 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cccfb-47c3-4687-bd6d-fc711d2fc777 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:05.318608 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cccfb-47c3-4687-bd6d-fc711d2fc777 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:05.320243 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:05.325835 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 775/1564] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:50:05.336239 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85254d05-9ffa-4d50-a9ee-c6853143ebdb admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:05.336385 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 790/1565] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:50:05.336385 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cccfb-47c3-4687-bd6d-fc711d2fc777 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:05.341732 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85254d05-9ffa-4d50-a9ee-c6853143ebdb admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:05.344252 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cccfb-47c3-4687-bd6d-fc711d2fc777 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:05.346632 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67980ae-759b-4703-b131-2cb0447c1747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:05.347360 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67980ae-759b-4703-b131-2cb0447c1747 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:05.347688 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67980ae-759b-4703-b131-2cb0447c1747 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:05.348015 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67980ae-759b-4703-b131-2cb0447c1747 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:05.352415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67980ae-759b-4703-b131-2cb0447c1747 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:05.352541 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9236a-9447-4eef-aebb-6832c3d92747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:05.352654 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67980ae-759b-4703-b131-2cb0447c1747 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:05.352760 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9236a-9447-4eef-aebb-6832c3d92747 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:05.352760 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9236a-9447-4eef-aebb-6832c3d92747 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:05.352760 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9236a-9447-4eef-aebb-6832c3d92747 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:05.352760 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9236a-9447-4eef-aebb-6832c3d92747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:05.354053 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9236a-9447-4eef-aebb-6832c3d92747 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:05.364913 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 791/1566] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:05.365831 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9236a-9447-4eef-aebb-6832c3d92747 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:05.375501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9236a-9447-4eef-aebb-6832c3d92747 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:05.380722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595e7c2-2e7e-4a81-8405-6682446b414c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:05.381355 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595e7c2-2e7e-4a81-8405-6682446b414c admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:05.381641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595e7c2-2e7e-4a81-8405-6682446b414c admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:05.381921 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595e7c2-2e7e-4a81-8405-6682446b414c admin admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:05.382680 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595e7c2-2e7e-4a81-8405-6682446b414c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:50:05.382993 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595e7c2-2e7e-4a81-8405-6682446b414c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:05.384593 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595e7c2-2e7e-4a81-8405-6682446b414c admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:05.397781 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 792/1567] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:50:05.399355 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595e7c2-2e7e-4a81-8405-6682446b414c admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:05.409129 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595e7c2-2e7e-4a81-8405-6682446b414c admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:05.414599 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b93d1-4fa5-4275-bab6-c9b348182dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:05.415275 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b93d1-4fa5-4275-bab6-c9b348182dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:05.415557 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b93d1-4fa5-4275-bab6-c9b348182dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:05.415851 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b93d1-4fa5-4275-bab6-c9b348182dd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:05.416573 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b93d1-4fa5-4275-bab6-c9b348182dd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:50:05.416857 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b93d1-4fa5-4275-bab6-c9b348182dd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:05.418408 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b93d1-4fa5-4275-bab6-c9b348182dd4 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:05.429848 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 793/1568] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:50:05.430940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b93d1-4fa5-4275-bab6-c9b348182dd4 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:05.432784 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 776/1569] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:50:05 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:05.437825 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67980ae-759b-4703-b131-2cb0447c1747 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:05.442687 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b93d1-4fa5-4275-bab6-c9b348182dd4 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:05.499543 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67980ae-759b-4703-b131-2cb0447c1747 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:05.500203 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac816b-a253-4a84-8e15-511eddbd2507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:05.500353 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac816b-a253-4a84-8e15-511eddbd2507 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:05.500590 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac816b-a253-4a84-8e15-511eddbd2507 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:05.500861 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac816b-a253-4a84-8e15-511eddbd2507 admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:05.501538 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac816b-a253-4a84-8e15-511eddbd2507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:05.504470 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac816b-a253-4a84-8e15-511eddbd2507 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:05.505288 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917c1cc-669c-4db6-bd5f-151f3eceb96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:05.505948 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917c1cc-669c-4db6-bd5f-151f3eceb96e admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:05.506230 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917c1cc-669c-4db6-bd5f-151f3eceb96e admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:05.506504 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917c1cc-669c-4db6-bd5f-151f3eceb96e admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:05.507230 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917c1cc-669c-4db6-bd5f-151f3eceb96e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:05.508854 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917c1cc-669c-4db6-bd5f-151f3eceb96e admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:05.519418 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 777/1570] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:05.520316 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917c1cc-669c-4db6-bd5f-151f3eceb96e admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:05.531432 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917c1cc-669c-4db6-bd5f-151f3eceb96e admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:05.536600 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4091895e-3ee2-4736-a4b1-1b468cfe7dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:05.537241 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091895e-3ee2-4736-a4b1-1b468cfe7dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:05.537531 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091895e-3ee2-4736-a4b1-1b468cfe7dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:05.537813 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091895e-3ee2-4736-a4b1-1b468cfe7dd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:05.538500 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4091895e-3ee2-4736-a4b1-1b468cfe7dd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:05.540462 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4091895e-3ee2-4736-a4b1-1b468cfe7dd6 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:05.586603 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 794/1571] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:50:05 2022] POST /identity/v3/projects => generated 389 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:05.587243 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac816b-a253-4a84-8e15-511eddbd2507 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:05.621520 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 778/1572] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:50:05 2022] POST /identity/v3/projects => generated 393 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:05.622557 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4091895e-3ee2-4736-a4b1-1b468cfe7dd6 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:05.651848 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac816b-a253-4a84-8e15-511eddbd2507 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:05.688833 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4091895e-3ee2-4736-a4b1-1b468cfe7dd6 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:05.694749 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa8a84-6fae-4854-b6fa-097aed59163b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:05.695423 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa8a84-6fae-4854-b6fa-097aed59163b admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:05.695738 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa8a84-6fae-4854-b6fa-097aed59163b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:05.696081 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa8a84-6fae-4854-b6fa-097aed59163b admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:05.696746 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa8a84-6fae-4854-b6fa-097aed59163b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:05.698351 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa8a84-6fae-4854-b6fa-097aed59163b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:05.698885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:05.708898 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 779/1573] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:05.709743 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa8a84-6fae-4854-b6fa-097aed59163b admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:05.711656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d7d21-a6a7-421e-99cc-a2366598814c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:05.712208 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d7d21-a6a7-421e-99cc-a2366598814c admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:05.712543 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d7d21-a6a7-421e-99cc-a2366598814c admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:05.712822 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d7d21-a6a7-421e-99cc-a2366598814c admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:05.713521 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d7d21-a6a7-421e-99cc-a2366598814c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:05.715635 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d7d21-a6a7-421e-99cc-a2366598814c admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:05.720273 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa8a84-6fae-4854-b6fa-097aed59163b admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:05.724992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31f533-4d75-431d-90da-7a16b7ed5ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:05.725644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31f533-4d75-431d-90da-7a16b7ed5ccd admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:05.725923 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31f533-4d75-431d-90da-7a16b7ed5ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:05.726197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31f533-4d75-431d-90da-7a16b7ed5ccd admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:05.726882 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f31f533-4d75-431d-90da-7a16b7ed5ccd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:05.728794 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f31f533-4d75-431d-90da-7a16b7ed5ccd admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:05.739178 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:05.808580 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 795/1574] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:50:05 2022] POST /identity/v3/projects => generated 379 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:05.809396 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d7d21-a6a7-421e-99cc-a2366598814c admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:05.837593 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 780/1575] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:50:05 2022] POST /identity/v3/projects => generated 381 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:05.838664 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31f533-4d75-431d-90da-7a16b7ed5ccd admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:05.872812 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d7d21-a6a7-421e-99cc-a2366598814c admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:05.900508 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31f533-4d75-431d-90da-7a16b7ed5ccd admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:05.905349 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1503887-851a-43c9-a2bb-9013fe5b8cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:05.906017 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1503887-851a-43c9-a2bb-9013fe5b8cdb admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:05.906302 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1503887-851a-43c9-a2bb-9013fe5b8cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:05.906578 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1503887-851a-43c9-a2bb-9013fe5b8cdb admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:05.907540 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1503887-851a-43c9-a2bb-9013fe5b8cdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:05.910151 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1503887-851a-43c9-a2bb-9013fe5b8cdb admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:05.927794 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab35fc-954a-46df-8ff8-905fd36def44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:05.928463 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab35fc-954a-46df-8ff8-905fd36def44 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:05.928743 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab35fc-954a-46df-8ff8-905fd36def44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:05.929015 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab35fc-954a-46df-8ff8-905fd36def44 admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:05.929702 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab35fc-954a-46df-8ff8-905fd36def44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:05.931600 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab35fc-954a-46df-8ff8-905fd36def44 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:06.019535 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 781/1576] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:50:05 2022] POST /identity/v3/projects => generated 365 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:06.020500 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1503887-851a-43c9-a2bb-9013fe5b8cdb admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:06.030150 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 796/1577] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:50:05 2022] POST /identity/v3/users => generated 289 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:06.030864 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab35fc-954a-46df-8ff8-905fd36def44 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:06.040744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab35fc-954a-46df-8ff8-905fd36def44 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:06.086349 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1503887-851a-43c9-a2bb-9013fe5b8cdb admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:06.091050 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de914f4f-1b1d-4d5b-8ecf-fa51baad985d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:06.091741 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de914f4f-1b1d-4d5b-8ecf-fa51baad985d admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:06.092030 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de914f4f-1b1d-4d5b-8ecf-fa51baad985d admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:06.092311 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de914f4f-1b1d-4d5b-8ecf-fa51baad985d admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:06.093036 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de914f4f-1b1d-4d5b-8ecf-fa51baad985d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:06.094618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de914f4f-1b1d-4d5b-8ecf-fa51baad985d admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:06.096885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281eace6-c169-49bf-b655-ab30610f4db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:06.097558 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281eace6-c169-49bf-b655-ab30610f4db4 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:06.097842 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281eace6-c169-49bf-b655-ab30610f4db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:06.098120 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281eace6-c169-49bf-b655-ab30610f4db4 admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:06.098814 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281eace6-c169-49bf-b655-ab30610f4db4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:06.100778 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281eace6-c169-49bf-b655-ab30610f4db4 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:06.104326 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 782/1578] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:06.105102 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de914f4f-1b1d-4d5b-8ecf-fa51baad985d admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:06.114667 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de914f4f-1b1d-4d5b-8ecf-fa51baad985d admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:06.119361 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3c6c4-2968-464e-95d5-2ee52695239e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:06.120317 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3c6c4-2968-464e-95d5-2ee52695239e admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:06.120488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3c6c4-2968-464e-95d5-2ee52695239e admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:06.120601 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3c6c4-2968-464e-95d5-2ee52695239e admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:06.121300 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b3c6c4-2968-464e-95d5-2ee52695239e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:06.123177 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b3c6c4-2968-464e-95d5-2ee52695239e admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:06.191465 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:06.196733 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 797/1579] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:50:06 2022] POST /identity/v3/users => generated 295 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:06.197666 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281eace6-c169-49bf-b655-ab30610f4db4 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:06.207856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281eace6-c169-49bf-b655-ab30610f4db4 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:06.210898 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 783/1580] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:50:06 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:06.210898 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3c6c4-2968-464e-95d5-2ee52695239e admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:06.212853 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77a3c0-d7ff-4674-9e67-31c1b0614cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:06.213760 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77a3c0-d7ff-4674-9e67-31c1b0614cd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:06.214047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77a3c0-d7ff-4674-9e67-31c1b0614cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:06.214322 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77a3c0-d7ff-4674-9e67-31c1b0614cd7 admin admin] PATH_INFO: `/v3/projects/57e577ae489b48cd97ac8082c1efe3cf/users/cfce07539a5149e4b4976f0dc7260b75/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:06.218468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3c6c4-2968-464e-95d5-2ee52695239e admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:06.223226 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d4942-e586-4a11-9997-01eca7f2e1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:06.223970 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d4942-e586-4a11-9997-01eca7f2e1d1 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:06.231307 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d4942-e586-4a11-9997-01eca7f2e1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:06.231307 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d4942-e586-4a11-9997-01eca7f2e1d1 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:06.231307 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7d4942-e586-4a11-9997-01eca7f2e1d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:06.231307 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7d4942-e586-4a11-9997-01eca7f2e1d1 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:06.231725 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77a3c0-d7ff-4674-9e67-31c1b0614cd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57e577ae489b48cd97ac8082c1efe3cf, user_id=cfce07539a5149e4b4976f0dc7260b75, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:06.232502 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77a3c0-d7ff-4674-9e67-31c1b0614cd7 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:06.280874 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 798/1581] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:06 2022] PUT /identity/v3/projects/57e577ae489b48cd97ac8082c1efe3cf/users/cfce07539a5149e4b4976f0dc7260b75/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:06.281659 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77a3c0-d7ff-4674-9e67-31c1b0614cd7 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:06.299460 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 784/1582] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:50:06 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:06.302604 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d4942-e586-4a11-9997-01eca7f2e1d1 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:06.309880 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d4942-e586-4a11-9997-01eca7f2e1d1 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:06.346063 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:06.347147 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77a3c0-d7ff-4674-9e67-31c1b0614cd7 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:06.351987 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d65d51-c1ed-49c5-8139-d1a3a2ef98e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:06.352645 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d65d51-c1ed-49c5-8139-d1a3a2ef98e7 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:06.352934 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d65d51-c1ed-49c5-8139-d1a3a2ef98e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:06.353210 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d65d51-c1ed-49c5-8139-d1a3a2ef98e7 admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:06.353907 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d65d51-c1ed-49c5-8139-d1a3a2ef98e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:06.355849 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d65d51-c1ed-49c5-8139-d1a3a2ef98e7 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:06.371535 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124214b-66f2-4691-b15f-c705b7a9205c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:06.372431 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124214b-66f2-4691-b15f-c705b7a9205c admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:06.372712 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124214b-66f2-4691-b15f-c705b7a9205c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:06.372989 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124214b-66f2-4691-b15f-c705b7a9205c admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:06.373678 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124214b-66f2-4691-b15f-c705b7a9205c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:06.375683 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124214b-66f2-4691-b15f-c705b7a9205c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:06.432924 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 799/1583] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:50:06 2022] POST /identity/v3/users => generated 291 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:06.432924 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d65d51-c1ed-49c5-8139-d1a3a2ef98e7 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:06.441281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d65d51-c1ed-49c5-8139-d1a3a2ef98e7 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:06.445838 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58c770-9746-417b-afdc-7093f4b68feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:06.446478 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58c770-9746-417b-afdc-7093f4b68feb admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:06.446765 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58c770-9746-417b-afdc-7093f4b68feb admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:06.447037 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58c770-9746-417b-afdc-7093f4b68feb admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:06.447910 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a58c770-9746-417b-afdc-7093f4b68feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:06.449505 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a58c770-9746-417b-afdc-7093f4b68feb admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:06.453756 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 785/1584] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:50:06 2022] POST /identity/v3/users => generated 283 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:06.453756 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124214b-66f2-4691-b15f-c705b7a9205c admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:06.463183 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 800/1585] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:06.463183 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58c770-9746-417b-afdc-7093f4b68feb admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:06.465875 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124214b-66f2-4691-b15f-c705b7a9205c admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:06.470516 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef1ede-77c9-4bbd-bf7e-47478af97305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:06.470677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58c770-9746-417b-afdc-7093f4b68feb admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:06.471445 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef1ede-77c9-4bbd-bf7e-47478af97305 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:06.471936 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef1ede-77c9-4bbd-bf7e-47478af97305 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:06.472231 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef1ede-77c9-4bbd-bf7e-47478af97305 admin admin] PATH_INFO: `/v3/projects/74b4e0581e754c7484c72545abeb27dd/users/7f29a7f15ddc4ebfb399260ecbfc4600/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:06.476006 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ced3e9-299a-42bf-b022-521da8fa587f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:06.476661 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ced3e9-299a-42bf-b022-521da8fa587f admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:06.476948 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ced3e9-299a-42bf-b022-521da8fa587f admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:06.477229 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ced3e9-299a-42bf-b022-521da8fa587f admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:06.477978 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ced3e9-299a-42bf-b022-521da8fa587f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:06.479581 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ced3e9-299a-42bf-b022-521da8fa587f admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:06.487605 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef1ede-77c9-4bbd-bf7e-47478af97305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74b4e0581e754c7484c72545abeb27dd, user_id=7f29a7f15ddc4ebfb399260ecbfc4600, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:06.489013 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: WARNING py.warnings [None req-45ef1ede-77c9-4bbd-bf7e-47478af97305 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:50:06.489013 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: warnings.warn(msg) Jul 25 08:50:06.489013 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: Jul 25 08:50:06.490969 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef1ede-77c9-4bbd-bf7e-47478af97305 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:06.491112 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 801/1586] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:06.491922 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ced3e9-299a-42bf-b022-521da8fa587f admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:06.501574 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ced3e9-299a-42bf-b022-521da8fa587f admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:06.506754 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4bc6e-5a15-4cd7-9a81-b40e1d20ab27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:06.507398 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4bc6e-5a15-4cd7-9a81-b40e1d20ab27 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:06.507717 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4bc6e-5a15-4cd7-9a81-b40e1d20ab27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:06.508003 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4bc6e-5a15-4cd7-9a81-b40e1d20ab27 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:06.508715 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4bc6e-5a15-4cd7-9a81-b40e1d20ab27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:06.510292 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4bc6e-5a15-4cd7-9a81-b40e1d20ab27 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:06.519925 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 802/1587] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:06.519925 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8edf2e-ecfc-459b-8942-25d8148e3e4a None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:06.519925 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8edf2e-ecfc-459b-8942-25d8148e3e4a None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:06.519925 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8edf2e-ecfc-459b-8942-25d8148e3e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:06.539064 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 786/1588] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:06 2022] PUT /identity/v3/projects/74b4e0581e754c7484c72545abeb27dd/users/7f29a7f15ddc4ebfb399260ecbfc4600/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:06.539997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef1ede-77c9-4bbd-bf7e-47478af97305 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:06.555964 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-7e8edf2e-ecfc-459b-8942-25d8148e3e4a None None] MFA Rules not processed for user `cfce07539a5149e4b4976f0dc7260b75`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:06.557219 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-7e8edf2e-ecfc-459b-8942-25d8148e3e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:06.611717 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef1ede-77c9-4bbd-bf7e-47478af97305 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:06.616873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda08c6-8a02-4d07-91ed-322927857672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:06.617544 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda08c6-8a02-4d07-91ed-322927857672 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:06.617832 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda08c6-8a02-4d07-91ed-322927857672 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:06.618115 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda08c6-8a02-4d07-91ed-322927857672 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:06.618853 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda08c6-8a02-4d07-91ed-322927857672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:06.620435 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 803/1589] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:06.620925 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda08c6-8a02-4d07-91ed-322927857672 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:06.621272 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8edf2e-ecfc-459b-8942-25d8148e3e4a None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:06.631484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 787/1590] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:06.632355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda08c6-8a02-4d07-91ed-322927857672 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:06.638510 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8edf2e-ecfc-459b-8942-25d8148e3e4a None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:06.638510 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c526c-0914-4fae-918f-79a7eb2ec967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:06.639141 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c526c-0914-4fae-918f-79a7eb2ec967 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:06.639605 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c526c-0914-4fae-918f-79a7eb2ec967 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:06.639865 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c526c-0914-4fae-918f-79a7eb2ec967 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:06.641000 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c526c-0914-4fae-918f-79a7eb2ec967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:06.642254 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c526c-0914-4fae-918f-79a7eb2ec967 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:06.644613 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda08c6-8a02-4d07-91ed-322927857672 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:06.650177 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265df88a-fd89-4f92-b417-84176b6562cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:06.650839 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265df88a-fd89-4f92-b417-84176b6562cc admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:06.651126 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265df88a-fd89-4f92-b417-84176b6562cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:06.651556 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265df88a-fd89-4f92-b417-84176b6562cc admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:06.652175 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265df88a-fd89-4f92-b417-84176b6562cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:06.657105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 804/1591] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:06.657359 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265df88a-fd89-4f92-b417-84176b6562cc admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:06.657461 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c526c-0914-4fae-918f-79a7eb2ec967 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:06.665222 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c526c-0914-4fae-918f-79a7eb2ec967 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:06.667605 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 788/1592] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:06.667605 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265df88a-fd89-4f92-b417-84176b6562cc admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:06.673992 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287015d0-7b91-4e55-82f9-97b922d14b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:06.673992 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287015d0-7b91-4e55-82f9-97b922d14b7b admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:06.673992 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287015d0-7b91-4e55-82f9-97b922d14b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:06.673992 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287015d0-7b91-4e55-82f9-97b922d14b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:06.675415 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287015d0-7b91-4e55-82f9-97b922d14b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:06.677055 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287015d0-7b91-4e55-82f9-97b922d14b7b admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:06.677808 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265df88a-fd89-4f92-b417-84176b6562cc admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:06.682515 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60abfb-11d7-41a9-b306-fb87d372479d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:06.682966 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:06.683159 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60abfb-11d7-41a9-b306-fb87d372479d admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:06.683456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60abfb-11d7-41a9-b306-fb87d372479d admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:06.683794 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60abfb-11d7-41a9-b306-fb87d372479d admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:06.684524 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60abfb-11d7-41a9-b306-fb87d372479d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:06.686171 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60abfb-11d7-41a9-b306-fb87d372479d admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:06.688158 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 805/1593] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:06.693155 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287015d0-7b91-4e55-82f9-97b922d14b7b admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:06.702448 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 789/1594] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:06.703781 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287015d0-7b91-4e55-82f9-97b922d14b7b admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:06.703900 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1d700-0bac-45e7-89c8-32760569e425 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:06.704123 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1d700-0bac-45e7-89c8-32760569e425 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:06.704397 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1d700-0bac-45e7-89c8-32760569e425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:06.710130 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119d2bb-c066-4d77-8b2a-aca05644b85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:06.710130 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119d2bb-c066-4d77-8b2a-aca05644b85c admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:06.710130 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119d2bb-c066-4d77-8b2a-aca05644b85c admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:06.710460 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119d2bb-c066-4d77-8b2a-aca05644b85c admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:06.711158 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119d2bb-c066-4d77-8b2a-aca05644b85c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:06.712850 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119d2bb-c066-4d77-8b2a-aca05644b85c admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:06.726582 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 806/1595] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:06.727402 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119d2bb-c066-4d77-8b2a-aca05644b85c admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:06.734479 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-d2b1d700-0bac-45e7-89c8-32760569e425 None None] MFA Rules not processed for user `7f29a7f15ddc4ebfb399260ecbfc4600`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:06.736416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d2b1d700-0bac-45e7-89c8-32760569e425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:06.740720 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119d2bb-c066-4d77-8b2a-aca05644b85c admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:06.745642 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e4c81-ec4e-400a-9318-17d440659f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:06.746298 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e4c81-ec4e-400a-9318-17d440659f83 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:06.746584 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e4c81-ec4e-400a-9318-17d440659f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:06.746869 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e4c81-ec4e-400a-9318-17d440659f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:06.747603 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e4c81-ec4e-400a-9318-17d440659f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:06.753198 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e4c81-ec4e-400a-9318-17d440659f83 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:06.760074 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 807/1596] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:06.760891 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e4c81-ec4e-400a-9318-17d440659f83 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:06.771600 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e4c81-ec4e-400a-9318-17d440659f83 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:06.776303 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86eb77b-5e00-45dc-aba5-962a53ae0ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:06.782327 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86eb77b-5e00-45dc-aba5-962a53ae0ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:06.782327 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86eb77b-5e00-45dc-aba5-962a53ae0ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:06.782327 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86eb77b-5e00-45dc-aba5-962a53ae0ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:06.782327 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86eb77b-5e00-45dc-aba5-962a53ae0ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:06.782327 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86eb77b-5e00-45dc-aba5-962a53ae0ea7 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:06.790089 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 808/1597] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:06.791535 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152254f-762c-4929-9746-fbda1cf11390 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:06.791878 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152254f-762c-4929-9746-fbda1cf11390 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:06.792158 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152254f-762c-4929-9746-fbda1cf11390 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:06.793390 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 809/1598] 10.222.0.18 () {54 vars in 962 bytes} [Mon Jul 25 08:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:50:06.794117 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152254f-762c-4929-9746-fbda1cf11390 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:06.806685 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152254f-762c-4929-9746-fbda1cf11390 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:06.811711 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b13cc-7bfa-4a56-a1e4-dfe4333765b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:06.812457 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b13cc-7bfa-4a56-a1e4-dfe4333765b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:06.812843 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b13cc-7bfa-4a56-a1e4-dfe4333765b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:06.813017 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 790/1599] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:06.813303 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b13cc-7bfa-4a56-a1e4-dfe4333765b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:06.813828 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1d700-0bac-45e7-89c8-32760569e425 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:06.814261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b13cc-7bfa-4a56-a1e4-dfe4333765b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:06.816829 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b13cc-7bfa-4a56-a1e4-dfe4333765b1 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:06.825449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1d700-0bac-45e7-89c8-32760569e425 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:06.826660 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:06.827819 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 810/1600] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:06.828651 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b13cc-7bfa-4a56-a1e4-dfe4333765b1 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:06.840088 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02648cbe-81b3-4eed-9a16-8dc3d3accb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:06.840088 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02648cbe-81b3-4eed-9a16-8dc3d3accb4a admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:06.840088 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02648cbe-81b3-4eed-9a16-8dc3d3accb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:06.840088 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02648cbe-81b3-4eed-9a16-8dc3d3accb4a admin admin] PATH_INFO: `/v3/projects/6c602df7be1e424189aecfb781248815/users/f67af2f4a93543c5bbd1703a6764867b/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:06.843971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b13cc-7bfa-4a56-a1e4-dfe4333765b1 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:06.849935 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28977fb-a13e-4ee2-9843-7266bb270a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:06.850755 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28977fb-a13e-4ee2-9843-7266bb270a7a admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:06.851154 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28977fb-a13e-4ee2-9843-7266bb270a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:06.851668 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28977fb-a13e-4ee2-9843-7266bb270a7a admin admin] PATH_INFO: `/v3/projects/734a3bd889ad4c3388428a2e4ac321f2/users/c8fac29036de4afbb8c1b64862e829b9/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:06.852982 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02648cbe-81b3-4eed-9a16-8dc3d3accb4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c602df7be1e424189aecfb781248815, user_id=f67af2f4a93543c5bbd1703a6764867b, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:06.856224 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02648cbe-81b3-4eed-9a16-8dc3d3accb4a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:06.867953 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28977fb-a13e-4ee2-9843-7266bb270a7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=734a3bd889ad4c3388428a2e4ac321f2, user_id=c8fac29036de4afbb8c1b64862e829b9, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:06.869120 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28977fb-a13e-4ee2-9843-7266bb270a7a admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:06.938532 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 791/1601] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:06 2022] PUT /identity/v3/projects/6c602df7be1e424189aecfb781248815/users/f67af2f4a93543c5bbd1703a6764867b/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:06.939334 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02648cbe-81b3-4eed-9a16-8dc3d3accb4a admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:06.978757 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 811/1602] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:06 2022] PUT /identity/v3/projects/734a3bd889ad4c3388428a2e4ac321f2/users/c8fac29036de4afbb8c1b64862e829b9/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:06.979746 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28977fb-a13e-4ee2-9843-7266bb270a7a admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:07.003765 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02648cbe-81b3-4eed-9a16-8dc3d3accb4a admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:07.042368 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28977fb-a13e-4ee2-9843-7266bb270a7a admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:07.047055 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f048c-b23b-4a4d-8da2-817c5ff11897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:07.047983 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f048c-b23b-4a4d-8da2-817c5ff11897 admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:07.048271 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f048c-b23b-4a4d-8da2-817c5ff11897 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:07.048548 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f048c-b23b-4a4d-8da2-817c5ff11897 admin admin] PATH_INFO: `/v3/projects/bab881ea3c0340f38ab21df3fb187545/users/3c510b9d94bc48e6a0bd5cd1fa9d1706/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:07.062534 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2e205-e978-4ebf-b617-0cd8e050d406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:07.063426 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2e205-e978-4ebf-b617-0cd8e050d406 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:07.063740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2e205-e978-4ebf-b617-0cd8e050d406 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:07.064020 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2e205-e978-4ebf-b617-0cd8e050d406 admin admin] PATH_INFO: `/v3/projects/1d41250ae46e46cb9cecf36596625905/users/e416de38c3354372909e3f13678e5b54/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:07.064186 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f048c-b23b-4a4d-8da2-817c5ff11897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bab881ea3c0340f38ab21df3fb187545, user_id=3c510b9d94bc48e6a0bd5cd1fa9d1706, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:07.067076 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f048c-b23b-4a4d-8da2-817c5ff11897 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:07.078381 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2e205-e978-4ebf-b617-0cd8e050d406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d41250ae46e46cb9cecf36596625905, user_id=e416de38c3354372909e3f13678e5b54, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:07.083413 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2e205-e978-4ebf-b617-0cd8e050d406 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:07.138632 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 812/1603] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:06 2022] PUT /identity/v3/projects/bab881ea3c0340f38ab21df3fb187545/users/3c510b9d94bc48e6a0bd5cd1fa9d1706/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:07.139642 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f048c-b23b-4a4d-8da2-817c5ff11897 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:07.151083 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 792/1604] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:06 2022] PUT /identity/v3/projects/1d41250ae46e46cb9cecf36596625905/users/e416de38c3354372909e3f13678e5b54/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:07.152447 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c61f5-97fa-4fde-ab4f-99289231bd34 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:07.152740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c61f5-97fa-4fde-ab4f-99289231bd34 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:07.153019 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c61f5-97fa-4fde-ab4f-99289231bd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:07.191287 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-895c61f5-97fa-4fde-ab4f-99289231bd34 None None] MFA Rules not processed for user `1c1a08d3a76643a9996dc0daa8714ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:07.192567 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-895c61f5-97fa-4fde-ab4f-99289231bd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:07.202551 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f048c-b23b-4a4d-8da2-817c5ff11897 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:07.220771 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:07.244855 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:07.259243 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890f12a-2e95-410d-8039-090191647495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:07.261612 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890f12a-2e95-410d-8039-090191647495 admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:07.261612 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890f12a-2e95-410d-8039-090191647495 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:07.261612 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890f12a-2e95-410d-8039-090191647495 admin admin] PATH_INFO: `/v3/projects/4ab2d80d06c14106b5f1c7ae0fdd16af/users/86fd23a3e9454b36b340849cbe96e683/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:07.262044 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 793/1605] 10.222.0.18 () {58 vars in 1059 bytes} [Mon Jul 25 08:50:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:07.262500 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c61f5-97fa-4fde-ab4f-99289231bd34 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:07.273695 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c61f5-97fa-4fde-ab4f-99289231bd34 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:07.276866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890f12a-2e95-410d-8039-090191647495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ab2d80d06c14106b5f1c7ae0fdd16af, user_id=86fd23a3e9454b36b340849cbe96e683, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:07.278215 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4bed6-4c45-43c0-8afd-1d85acb6198a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:07.279170 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4bed6-4c45-43c0-8afd-1d85acb6198a admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:07.279465 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4bed6-4c45-43c0-8afd-1d85acb6198a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:07.279703 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890f12a-2e95-410d-8039-090191647495 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:07.279818 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4bed6-4c45-43c0-8afd-1d85acb6198a admin admin] PATH_INFO: `/v3/projects/33274da9fd014cb7a75be9e66c1e85e8/users/b9c10bd4ea1740869d8579695c9c4196/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:07.296333 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4bed6-4c45-43c0-8afd-1d85acb6198a admin admin] RBAC: Authorizing `identity:create_grant(project_id=33274da9fd014cb7a75be9e66c1e85e8, user_id=b9c10bd4ea1740869d8579695c9c4196, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:07.298977 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4bed6-4c45-43c0-8afd-1d85acb6198a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:07.378611 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 813/1606] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:07 2022] PUT /identity/v3/projects/4ab2d80d06c14106b5f1c7ae0fdd16af/users/86fd23a3e9454b36b340849cbe96e683/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:07.380030 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b03f3-4c06-4d7c-8fff-9c4e59190b1b None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:07.380320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b03f3-4c06-4d7c-8fff-9c4e59190b1b None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:07.380626 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b03f3-4c06-4d7c-8fff-9c4e59190b1b None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:07.381930 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 814/1607] 10.222.0.18 () {54 vars in 962 bytes} [Mon Jul 25 08:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:50:07.382973 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b21a8-9b81-4405-85da-2c625fcb8c2f None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:07.383291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b21a8-9b81-4405-85da-2c625fcb8c2f None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:07.383540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b21a8-9b81-4405-85da-2c625fcb8c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:07.402761 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-661b21a8-9b81-4405-85da-2c625fcb8c2f None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:07.403912 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-661b21a8-9b81-4405-85da-2c625fcb8c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:07.408048 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 794/1608] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:07 2022] PUT /identity/v3/projects/33274da9fd014cb7a75be9e66c1e85e8/users/b9c10bd4ea1740869d8579695c9c4196/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:07.409973 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb616b-9ced-45f8-a1e4-5fbb1ed55871 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:07.410262 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb616b-9ced-45f8-a1e4-5fbb1ed55871 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:07.410541 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb616b-9ced-45f8-a1e4-5fbb1ed55871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:07.429462 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-b4eb616b-9ced-45f8-a1e4-5fbb1ed55871 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:07.430791 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b4eb616b-9ced-45f8-a1e4-5fbb1ed55871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:07.477515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 815/1609] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:07.478970 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f51ce-ed30-42b4-8612-2032122ffd3b None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:07.479256 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f51ce-ed30-42b4-8612-2032122ffd3b None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:07.479527 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f51ce-ed30-42b4-8612-2032122ffd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:07.499050 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-840f51ce-ed30-42b4-8612-2032122ffd3b None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:07.500279 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-840f51ce-ed30-42b4-8612-2032122ffd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:07.506109 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 795/1610] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:07.507382 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc628e6f-2f93-4878-9280-4a5b984fbfa7 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:07.507820 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc628e6f-2f93-4878-9280-4a5b984fbfa7 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:07.508104 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc628e6f-2f93-4878-9280-4a5b984fbfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:07.512111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 816/1611] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:07.512111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f51ce-ed30-42b4-8612-2032122ffd3b None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:07.528310 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-bc628e6f-2f93-4878-9280-4a5b984fbfa7 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:07.529521 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-bc628e6f-2f93-4878-9280-4a5b984fbfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:07.537644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 796/1612] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:07.538865 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8d664-e0aa-4b90-a5e9-e500edd100ad None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:07.539150 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8d664-e0aa-4b90-a5e9-e500edd100ad None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:07.539712 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8d664-e0aa-4b90-a5e9-e500edd100ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:07.558585 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-3cd8d664-e0aa-4b90-a5e9-e500edd100ad None None] MFA Rules not processed for user `1c1a08d3a76643a9996dc0daa8714ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:07.559801 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-3cd8d664-e0aa-4b90-a5e9-e500edd100ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:07.586927 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f51ce-ed30-42b4-8612-2032122ffd3b None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:07.592478 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef80a12-351e-4ab5-acd3-55b018bf1087 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:07.593117 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef80a12-351e-4ab5-acd3-55b018bf1087 service nova] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:07.593394 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef80a12-351e-4ab5-acd3-55b018bf1087 service nova] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:07.593663 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef80a12-351e-4ab5-acd3-55b018bf1087 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:07.625930 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:07.628439 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 797/1613] 10.222.0.18 () {58 vars in 1059 bytes} [Mon Jul 25 08:50:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:07.629897 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b6026-e513-440c-bc09-528956d07ab3 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:07.630266 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b6026-e513-440c-bc09-528956d07ab3 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:07.630618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b6026-e513-440c-bc09-528956d07ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:07.651285 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef80a12-351e-4ab5-acd3-55b018bf1087 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:07.653175 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef80a12-351e-4ab5-acd3-55b018bf1087 service nova] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:07.658561 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-7a3b6026-e513-440c-bc09-528956d07ab3 None None] MFA Rules not processed for user `86fd23a3e9454b36b340849cbe96e683`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:07.659998 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-7a3b6026-e513-440c-bc09-528956d07ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:07.663157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 817/1614] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:07.664537 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee4a13-d6be-4cd4-94bb-94eb59db2d7e None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:07.664915 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee4a13-d6be-4cd4-94bb-94eb59db2d7e None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:07.665266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee4a13-d6be-4cd4-94bb-94eb59db2d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:07.693857 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-b5ee4a13-d6be-4cd4-94bb-94eb59db2d7e None None] MFA Rules not processed for user `b9c10bd4ea1740869d8579695c9c4196`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:07.697948 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-b5ee4a13-d6be-4cd4-94bb-94eb59db2d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:07.710450 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:07.744198 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 798/1615] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:07.745430 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b6026-e513-440c-bc09-528956d07ab3 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:07.772642 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 818/1616] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:07.773417 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee4a13-d6be-4cd4-94bb-94eb59db2d7e None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:07.806063 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b6026-e513-440c-bc09-528956d07ab3 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:07.810587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82784ab0-b716-4886-a01b-1bba921c7ab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:07.811238 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82784ab0-b716-4886-a01b-1bba921c7ab8 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:07.811528 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82784ab0-b716-4886-a01b-1bba921c7ab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:07.811835 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82784ab0-b716-4886-a01b-1bba921c7ab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:07.821272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82784ab0-b716-4886-a01b-1bba921c7ab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:07.822705 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82784ab0-b716-4886-a01b-1bba921c7ab8 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:07.831992 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee4a13-d6be-4cd4-94bb-94eb59db2d7e None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:07.833497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 799/1617] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:07.834232 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82784ab0-b716-4886-a01b-1bba921c7ab8 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:07.836249 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580cd1a-a269-4fd9-a768-cf613e1ded45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:07.837006 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580cd1a-a269-4fd9-a768-cf613e1ded45 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:07.837391 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580cd1a-a269-4fd9-a768-cf613e1ded45 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:07.837766 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580cd1a-a269-4fd9-a768-cf613e1ded45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:07.843106 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82784ab0-b716-4886-a01b-1bba921c7ab8 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:07.847743 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6faea-41e9-4c70-8c3d-6a94f5092806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:07.848442 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6faea-41e9-4c70-8c3d-6a94f5092806 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:07.848737 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6faea-41e9-4c70-8c3d-6a94f5092806 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:07.848878 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580cd1a-a269-4fd9-a768-cf613e1ded45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:07.849018 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6faea-41e9-4c70-8c3d-6a94f5092806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:07.850622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580cd1a-a269-4fd9-a768-cf613e1ded45 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:07.858983 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6faea-41e9-4c70-8c3d-6a94f5092806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:07.860632 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6faea-41e9-4c70-8c3d-6a94f5092806 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:07.861370 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 819/1618] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:07.862871 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580cd1a-a269-4fd9-a768-cf613e1ded45 service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:07.873714 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 800/1619] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:07.875601 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580cd1a-a269-4fd9-a768-cf613e1ded45 service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:07.877572 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6faea-41e9-4c70-8c3d-6a94f5092806 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:07.889771 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79788420-a6c1-4ce9-8c05-99945a9b5460 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:07.889771 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79788420-a6c1-4ce9-8c05-99945a9b5460 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:07.890099 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79788420-a6c1-4ce9-8c05-99945a9b5460 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:07.890099 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79788420-a6c1-4ce9-8c05-99945a9b5460 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:07.908212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6faea-41e9-4c70-8c3d-6a94f5092806 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:07.914710 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79788420-a6c1-4ce9-8c05-99945a9b5460 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:07.916201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79788420-a6c1-4ce9-8c05-99945a9b5460 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:07.931913 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07b5e3-e3ea-424b-b9af-e242b71382a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:07.931913 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07b5e3-e3ea-424b-b9af-e242b71382a3 service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:07.931913 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07b5e3-e3ea-424b-b9af-e242b71382a3 service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:07.931913 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07b5e3-e3ea-424b-b9af-e242b71382a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:07.936597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 820/1620] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:07.937405 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79788420-a6c1-4ce9-8c05-99945a9b5460 service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:07.961598 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79788420-a6c1-4ce9-8c05-99945a9b5460 service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:07.980399 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea81b9-df00-4de1-a72f-fc334951dcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:07.980399 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea81b9-df00-4de1-a72f-fc334951dcda admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:07.980399 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea81b9-df00-4de1-a72f-fc334951dcda admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:07.980399 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea81b9-df00-4de1-a72f-fc334951dcda admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:07.980859 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea81b9-df00-4de1-a72f-fc334951dcda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:07.980859 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea81b9-df00-4de1-a72f-fc334951dcda admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:08.006479 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07b5e3-e3ea-424b-b9af-e242b71382a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:08.008533 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07b5e3-e3ea-424b-b9af-e242b71382a3 service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:08.026854 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 801/1621] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:08.026854 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07b5e3-e3ea-424b-b9af-e242b71382a3 service nova] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:08.032836 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07b5e3-e3ea-424b-b9af-e242b71382a3 service nova] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:08.039118 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b9f61-0234-4533-a420-1e46d62cf852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:08.039640 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b9f61-0234-4533-a420-1e46d62cf852 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:08.041251 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b9f61-0234-4533-a420-1e46d62cf852 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:08.041251 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b9f61-0234-4533-a420-1e46d62cf852 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:08.041251 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b9f61-0234-4533-a420-1e46d62cf852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:08.051819 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 821/1622] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:50:07 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:08.054389 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b19d86-cdc7-44b8-b609-a9612e37325e None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:08.054687 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b19d86-cdc7-44b8-b609-a9612e37325e None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:08.054968 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b19d86-cdc7-44b8-b609-a9612e37325e None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:08.055787 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b9f61-0234-4533-a420-1e46d62cf852 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:08.057452 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 822/1623] 10.222.0.18 () {54 vars in 912 bytes} [Mon Jul 25 08:50:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:50:08.064607 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b19d86-cdc7-44b8-b609-a9612e37325e None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:08.132718 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:08.168062 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b19d86-cdc7-44b8-b609-a9612e37325e None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:08.173994 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4b467-ba4d-4c65-b0bf-110e0da98087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:08.174196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4b467-ba4d-4c65-b0bf-110e0da98087 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:08.175046 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4b467-ba4d-4c65-b0bf-110e0da98087 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:08.175402 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4b467-ba4d-4c65-b0bf-110e0da98087 admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:08.176357 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4b467-ba4d-4c65-b0bf-110e0da98087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:08.180452 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4b467-ba4d-4c65-b0bf-110e0da98087 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:08.208246 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 802/1624] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:50:08 2022] POST /identity/v3/projects => generated 365 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:08.210323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3c374-c9ea-4395-9b8b-567ee5de80c1 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:08.210915 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3c374-c9ea-4395-9b8b-567ee5de80c1 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:08.211405 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3c374-c9ea-4395-9b8b-567ee5de80c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:08.238855 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-52f3c374-c9ea-4395-9b8b-567ee5de80c1 None None] MFA Rules not processed for user `1c1a08d3a76643a9996dc0daa8714ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:08.240334 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-52f3c374-c9ea-4395-9b8b-567ee5de80c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:08.288682 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 823/1625] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:50:08 2022] POST /identity/v3/users => generated 296 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:08.290226 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4b467-ba4d-4c65-b0bf-110e0da98087 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:08.304296 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4b467-ba4d-4c65-b0bf-110e0da98087 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:08.338916 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:08.370051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 803/1626] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Jul 25 08:50:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:08.371209 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3c374-c9ea-4395-9b8b-567ee5de80c1 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:08.426534 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c06b46-7d53-4a45-a06c-fabc0260d4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:08.428866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c06b46-7d53-4a45-a06c-fabc0260d4b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:08.430362 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c06b46-7d53-4a45-a06c-fabc0260d4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:08.430362 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c06b46-7d53-4a45-a06c-fabc0260d4b0 admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:08.430362 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c06b46-7d53-4a45-a06c-fabc0260d4b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:08.433722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c06b46-7d53-4a45-a06c-fabc0260d4b0 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:08.465683 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3c374-c9ea-4395-9b8b-567ee5de80c1 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:08.470722 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857b474-34c6-4740-a58a-a408f13dd1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:08.472290 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857b474-34c6-4740-a58a-a408f13dd1d9 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:08.472724 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857b474-34c6-4740-a58a-a408f13dd1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:08.473096 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857b474-34c6-4740-a58a-a408f13dd1d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:08.474166 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857b474-34c6-4740-a58a-a408f13dd1d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:08.476082 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857b474-34c6-4740-a58a-a408f13dd1d9 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:08.491272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 804/1627] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:08.492998 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f6e95-d45a-4d29-805c-008c075b706a None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:08.493610 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f6e95-d45a-4d29-805c-008c075b706a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:08.493785 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f6e95-d45a-4d29-805c-008c075b706a None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:08.499782 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 805/1628] 10.222.0.18 () {54 vars in 912 bytes} [Mon Jul 25 08:50:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:50:08.500855 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f6e95-d45a-4d29-805c-008c075b706a None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:08.530113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 824/1629] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:50:08 2022] POST /identity/v3/users => generated 289 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:08.530753 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c06b46-7d53-4a45-a06c-fabc0260d4b0 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:08.546057 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c06b46-7d53-4a45-a06c-fabc0260d4b0 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:08.558916 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c838686-8725-43d7-8a79-5c6bae802983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:08.558916 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c838686-8725-43d7-8a79-5c6bae802983 admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:08.558916 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c838686-8725-43d7-8a79-5c6bae802983 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:08.558916 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c838686-8725-43d7-8a79-5c6bae802983 admin admin] PATH_INFO: `/v3/projects/3f0ef7891fc440b09c2f76ff24325142/users/8523b0f96ff04b67861e358ac23e5baa/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:08.573846 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c838686-8725-43d7-8a79-5c6bae802983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f0ef7891fc440b09c2f76ff24325142, user_id=8523b0f96ff04b67861e358ac23e5baa, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:08.578465 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c838686-8725-43d7-8a79-5c6bae802983 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:08.593561 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f6e95-d45a-4d29-805c-008c075b706a None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:08.597978 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227ac84-e017-4d3b-9f45-175b57d06b55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:08.598644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227ac84-e017-4d3b-9f45-175b57d06b55 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:08.598935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227ac84-e017-4d3b-9f45-175b57d06b55 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:08.599220 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227ac84-e017-4d3b-9f45-175b57d06b55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:08.610295 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227ac84-e017-4d3b-9f45-175b57d06b55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:08.611826 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227ac84-e017-4d3b-9f45-175b57d06b55 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:08.624159 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 806/1630] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:08.626269 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7927c3-aace-43fc-8223-e9bbc149e58b None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:08.626582 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7927c3-aace-43fc-8223-e9bbc149e58b None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:08.626871 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7927c3-aace-43fc-8223-e9bbc149e58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:08.661392 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 825/1631] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:08 2022] PUT /identity/v3/projects/3f0ef7891fc440b09c2f76ff24325142/users/8523b0f96ff04b67861e358ac23e5baa/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:08.662116 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c838686-8725-43d7-8a79-5c6bae802983 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:08.667195 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-3f7927c3-aace-43fc-8223-e9bbc149e58b None None] MFA Rules not processed for user `1c1a08d3a76643a9996dc0daa8714ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:08.668528 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-3f7927c3-aace-43fc-8223-e9bbc149e58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:08.822901 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 807/1632] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Jul 25 08:50:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:08.826906 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7927c3-aace-43fc-8223-e9bbc149e58b None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:08.840914 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:08.850721 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c838686-8725-43d7-8a79-5c6bae802983 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:08.877531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8619ef-3887-4040-bcbb-c185e610b399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:08.882973 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8619ef-3887-4040-bcbb-c185e610b399 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:08.884523 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8619ef-3887-4040-bcbb-c185e610b399 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:08.885266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8619ef-3887-4040-bcbb-c185e610b399 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:08.888345 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8619ef-3887-4040-bcbb-c185e610b399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:08.894549 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8619ef-3887-4040-bcbb-c185e610b399 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:08.936903 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 826/1633] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:08.940302 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8619ef-3887-4040-bcbb-c185e610b399 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:08.950211 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7927c3-aace-43fc-8223-e9bbc149e58b None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:08.957222 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cea75-63aa-4d83-9959-233f8edeb562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:08.958278 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cea75-63aa-4d83-9959-233f8edeb562 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:08.958695 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cea75-63aa-4d83-9959-233f8edeb562 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:08.959046 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cea75-63aa-4d83-9959-233f8edeb562 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:08.959875 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179cea75-63aa-4d83-9959-233f8edeb562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:08.961500 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179cea75-63aa-4d83-9959-233f8edeb562 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:08.984442 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 808/1634] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:08.990537 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cea75-63aa-4d83-9959-233f8edeb562 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:09.007693 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:09.012550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cea75-63aa-4d83-9959-233f8edeb562 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:09.022908 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40485c26-40fd-45dd-b736-64fa8e7e969a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:09.022908 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40485c26-40fd-45dd-b736-64fa8e7e969a admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:09.022908 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40485c26-40fd-45dd-b736-64fa8e7e969a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:09.022908 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40485c26-40fd-45dd-b736-64fa8e7e969a admin admin] PATH_INFO: `/v3/projects/3aecabd846a742ad9d91c9412cfef4aa/users/0459cd1344f04dbda2da734ea7619551/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:09.040155 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40485c26-40fd-45dd-b736-64fa8e7e969a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aecabd846a742ad9d91c9412cfef4aa, user_id=0459cd1344f04dbda2da734ea7619551, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:09.043643 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40485c26-40fd-45dd-b736-64fa8e7e969a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:09.046594 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8619ef-3887-4040-bcbb-c185e610b399 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:09.052630 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0125d4-cb15-4503-bb20-65d39af78e9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:09.053321 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0125d4-cb15-4503-bb20-65d39af78e9a service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:09.053608 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0125d4-cb15-4503-bb20-65d39af78e9a service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:09.053885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0125d4-cb15-4503-bb20-65d39af78e9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:09.064889 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0125d4-cb15-4503-bb20-65d39af78e9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:09.066651 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0125d4-cb15-4503-bb20-65d39af78e9a service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:09.078126 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 827/1635] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:09.079032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0125d4-cb15-4503-bb20-65d39af78e9a service cinder] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:09.090588 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0125d4-cb15-4503-bb20-65d39af78e9a service cinder] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:09.095445 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f6acb-d541-498b-a712-f71458d4a3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:09.097056 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f6acb-d541-498b-a712-f71458d4a3e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:09.097520 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f6acb-d541-498b-a712-f71458d4a3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:09.097914 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f6acb-d541-498b-a712-f71458d4a3e1 admin admin] PATH_INFO: `/v3/projects/3f0ef7891fc440b09c2f76ff24325142/users/8523b0f96ff04b67861e358ac23e5baa/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:09.100415 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f6acb-d541-498b-a712-f71458d4a3e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f0ef7891fc440b09c2f76ff24325142, user_id=8523b0f96ff04b67861e358ac23e5baa, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:09.103910 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f6acb-d541-498b-a712-f71458d4a3e1 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:09.119434 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 828/1636] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:09 2022] PUT /identity/v3/projects/3f0ef7891fc440b09c2f76ff24325142/users/8523b0f96ff04b67861e358ac23e5baa/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:09.120746 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f6acb-d541-498b-a712-f71458d4a3e1 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:09.128937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 809/1637] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:08 2022] PUT /identity/v3/projects/3aecabd846a742ad9d91c9412cfef4aa/users/0459cd1344f04dbda2da734ea7619551/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:09.131071 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8c690-ff90-46df-8b90-0925048e3743 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:09.131360 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8c690-ff90-46df-8b90-0925048e3743 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:09.131663 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8c690-ff90-46df-8b90-0925048e3743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:09.197194 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-bce8c690-ff90-46df-8b90-0925048e3743 None None] MFA Rules not processed for user `8523b0f96ff04b67861e358ac23e5baa`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:09.198125 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-bce8c690-ff90-46df-8b90-0925048e3743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:09.216212 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f6acb-d541-498b-a712-f71458d4a3e1 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:09.287227 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 810/1638] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:09 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:09.288192 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8c690-ff90-46df-8b90-0925048e3743 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:09.299109 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5524ead-32fe-4832-bbf5-ee210ef5843a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:09.300981 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5524ead-32fe-4832-bbf5-ee210ef5843a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:09.301376 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5524ead-32fe-4832-bbf5-ee210ef5843a admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:09.301740 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5524ead-32fe-4832-bbf5-ee210ef5843a admin admin] PATH_INFO: `/v3/users/cfce07539a5149e4b4976f0dc7260b75` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:09.303370 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5524ead-32fe-4832-bbf5-ee210ef5843a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfce07539a5149e4b4976f0dc7260b75)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:09.306223 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5524ead-32fe-4832-bbf5-ee210ef5843a admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:09.431292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8c690-ff90-46df-8b90-0925048e3743 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:09.444174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11727cee-c448-40de-8659-9a5e504f2df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:09.445090 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11727cee-c448-40de-8659-9a5e504f2df4 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:09.445385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11727cee-c448-40de-8659-9a5e504f2df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:09.445668 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11727cee-c448-40de-8659-9a5e504f2df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:09.446447 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11727cee-c448-40de-8659-9a5e504f2df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:09.454632 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11727cee-c448-40de-8659-9a5e504f2df4 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:09.477097 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 811/1639] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:09.479214 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11727cee-c448-40de-8659-9a5e504f2df4 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:09.484692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:09.541270 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-c5524ead-32fe-4832-bbf5-ee210ef5843a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfce07539a5149e4b4976f0dc7260b75'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:09.542118 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-c5524ead-32fe-4832-bbf5-ee210ef5843a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfce07539a5149e4b4976f0dc7260b75'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:09.542780 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-c5524ead-32fe-4832-bbf5-ee210ef5843a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfce07539a5149e4b4976f0dc7260b75'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:09.552728 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-c5524ead-32fe-4832-bbf5-ee210ef5843a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfce07539a5149e4b4976f0dc7260b75'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:09.572690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11727cee-c448-40de-8659-9a5e504f2df4 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:09.576726 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43b02a-58bd-4fe7-81a8-f7636bec3a9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:09.577339 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43b02a-58bd-4fe7-81a8-f7636bec3a9d service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:09.578165 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43b02a-58bd-4fe7-81a8-f7636bec3a9d service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:09.578165 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43b02a-58bd-4fe7-81a8-f7636bec3a9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:09.579813 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-cc43b02a-58bd-4fe7-81a8-f7636bec3a9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:09.592504 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43b02a-58bd-4fe7-81a8-f7636bec3a9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:09.594500 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43b02a-58bd-4fe7-81a8-f7636bec3a9d service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:09.605512 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 812/1640] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:09 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:09.606598 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43b02a-58bd-4fe7-81a8-f7636bec3a9d service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:09.607554 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-cc43b02a-58bd-4fe7-81a8-f7636bec3a9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:09.624680 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43b02a-58bd-4fe7-81a8-f7636bec3a9d service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:09.630260 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-c5524ead-32fe-4832-bbf5-ee210ef5843a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfce07539a5149e4b4976f0dc7260b75'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:09.638629 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e6a5f-6523-473b-bfcc-936853677fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:09.641462 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e6a5f-6523-473b-bfcc-936853677fa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:09.641462 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e6a5f-6523-473b-bfcc-936853677fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:09.641462 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e6a5f-6523-473b-bfcc-936853677fa8 admin admin] PATH_INFO: `/v3/projects/3aecabd846a742ad9d91c9412cfef4aa/users/0459cd1344f04dbda2da734ea7619551/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:09.645148 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e6a5f-6523-473b-bfcc-936853677fa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aecabd846a742ad9d91c9412cfef4aa, user_id=0459cd1344f04dbda2da734ea7619551, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:09.650456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e6a5f-6523-473b-bfcc-936853677fa8 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:09.661805 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 829/1641] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:50:09 2022] DELETE /identity/v3/users/cfce07539a5149e4b4976f0dc7260b75 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:09.666360 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3ffa2-ad3c-4248-8624-5b17501ffa64 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:09.666802 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3ffa2-ad3c-4248-8624-5b17501ffa64 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:09.667153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3ffa2-ad3c-4248-8624-5b17501ffa64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:09.677211 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 813/1642] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:09 2022] PUT /identity/v3/projects/3aecabd846a742ad9d91c9412cfef4aa/users/0459cd1344f04dbda2da734ea7619551/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:09.694172 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a2560-e28e-4d2a-8d27-0170052b47a6 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:09.694500 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a2560-e28e-4d2a-8d27-0170052b47a6 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:09.694748 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a2560-e28e-4d2a-8d27-0170052b47a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:09.724763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-e9e3ffa2-ad3c-4248-8624-5b17501ffa64 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:09.751000 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-e9e3ffa2-ad3c-4248-8624-5b17501ffa64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:09.751309 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-bc2a2560-e28e-4d2a-8d27-0170052b47a6 None None] MFA Rules not processed for user `0459cd1344f04dbda2da734ea7619551`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:09.751309 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-bc2a2560-e28e-4d2a-8d27-0170052b47a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:09.820113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 830/1643] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:09.833222 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3ffa2-ad3c-4248-8624-5b17501ffa64 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:09.835048 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-e9e3ffa2-ad3c-4248-8624-5b17501ffa64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:09.851874 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 814/1644] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:09 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:09.896340 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3ffa2-ad3c-4248-8624-5b17501ffa64 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:09.903078 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829eb3f3-1413-4290-bea3-73197bc35588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:09.903787 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829eb3f3-1413-4290-bea3-73197bc35588 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:09.907162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829eb3f3-1413-4290-bea3-73197bc35588 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:09.907162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829eb3f3-1413-4290-bea3-73197bc35588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:09.919008 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829eb3f3-1413-4290-bea3-73197bc35588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:09.920877 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829eb3f3-1413-4290-bea3-73197bc35588 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:09.956738 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 831/1645] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:09.969321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a2560-e28e-4d2a-8d27-0170052b47a6 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:09.971019 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-bc2a2560-e28e-4d2a-8d27-0170052b47a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:10.019744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:10.087432 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a2560-e28e-4d2a-8d27-0170052b47a6 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:10.095014 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55988861-c301-4d80-b835-6767d55f1ab4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:10.096029 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55988861-c301-4d80-b835-6767d55f1ab4 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:10.098587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55988861-c301-4d80-b835-6767d55f1ab4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:10.099174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55988861-c301-4d80-b835-6767d55f1ab4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:10.115162 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55988861-c301-4d80-b835-6767d55f1ab4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:10.117652 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55988861-c301-4d80-b835-6767d55f1ab4 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:10.136000 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 815/1646] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:09 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:11.264372 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829eb3f3-1413-4290-bea3-73197bc35588 service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:11.265852 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-829eb3f3-1413-4290-bea3-73197bc35588 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:11.293423 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829eb3f3-1413-4290-bea3-73197bc35588 service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:11.298412 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a77c20-9260-4b4a-888f-9ea6b8c02cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:11.299277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a77c20-9260-4b4a-888f-9ea6b8c02cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:11.300273 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a77c20-9260-4b4a-888f-9ea6b8c02cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:11.300779 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a77c20-9260-4b4a-888f-9ea6b8c02cf1 admin admin] PATH_INFO: `/v3/projects/57e577ae489b48cd97ac8082c1efe3cf` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:11.303397 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a77c20-9260-4b4a-888f-9ea6b8c02cf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57e577ae489b48cd97ac8082c1efe3cf)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:11.304480 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: WARNING py.warnings [None req-e5a77c20-9260-4b4a-888f-9ea6b8c02cf1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:50:11.304480 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: warnings.warn(msg) Jul 25 08:50:11.304480 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: Jul 25 08:50:11.305747 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a77c20-9260-4b4a-888f-9ea6b8c02cf1 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:11.342190 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55988861-c301-4d80-b835-6767d55f1ab4 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:11.376449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:11.459517 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55988861-c301-4d80-b835-6767d55f1ab4 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:11.476925 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-e5a77c20-9260-4b4a-888f-9ea6b8c02cf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57e577ae489b48cd97ac8082c1efe3cf', 'request_id': 'req-e5a77c20-9260-4b4a-888f-9ea6b8c02cf1'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:11.496619 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-e5a77c20-9260-4b4a-888f-9ea6b8c02cf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57e577ae489b48cd97ac8082c1efe3cf', 'request_id': 'req-e5a77c20-9260-4b4a-888f-9ea6b8c02cf1'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:11.507268 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-e5a77c20-9260-4b4a-888f-9ea6b8c02cf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57e577ae489b48cd97ac8082c1efe3cf', 'request_id': 'req-e5a77c20-9260-4b4a-888f-9ea6b8c02cf1'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:11.571541 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f62364-e3d5-4879-9e66-68a41ee0677d tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8523b0f96ff04b67861e358ac23e5baa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f0ef7891fc440b09c2f76ff24325142', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:11.572694 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f62364-e3d5-4879-9e66-68a41ee0677d tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:11.573338 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f62364-e3d5-4879-9e66-68a41ee0677d tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:11.573950 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f62364-e3d5-4879-9e66-68a41ee0677d tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:11.574928 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f62364-e3d5-4879-9e66-68a41ee0677d tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:50:11.575492 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f62364-e3d5-4879-9e66-68a41ee0677d tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:11.577566 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f62364-e3d5-4879-9e66-68a41ee0677d tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:11.597596 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 816/1647] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:50:11.606665 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f62364-e3d5-4879-9e66-68a41ee0677d tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:11.636083 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-e5a77c20-9260-4b4a-888f-9ea6b8c02cf1 admin admin] The token cache is being invalidate because project 57e577ae489b48cd97ac8082c1efe3cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:50:11.641637 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-e5a77c20-9260-4b4a-888f-9ea6b8c02cf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:11.641861 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f62364-e3d5-4879-9e66-68a41ee0677d tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:11.643142 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-e5a77c20-9260-4b4a-888f-9ea6b8c02cf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:11.649827 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 832/1648] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:50:11 2022] DELETE /identity/v3/projects/57e577ae489b48cd97ac8082c1efe3cf => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:11.650957 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd2e0a-4816-4fc9-a885-37789e8d8db2 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:11.651355 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd2e0a-4816-4fc9-a885-37789e8d8db2 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:11.651837 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd2e0a-4816-4fc9-a885-37789e8d8db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:11.657980 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd96bb-0539-4696-93a4-441f5c4781b1 tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8523b0f96ff04b67861e358ac23e5baa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f0ef7891fc440b09c2f76ff24325142', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:11.659353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd96bb-0539-4696-93a4-441f5c4781b1 tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:11.660594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd96bb-0539-4696-93a4-441f5c4781b1 tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:11.661245 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd96bb-0539-4696-93a4-441f5c4781b1 tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:11.662186 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd96bb-0539-4696-93a4-441f5c4781b1 tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:11.666979 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd96bb-0539-4696-93a4-441f5c4781b1 tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:11.700065 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-e8dd2e0a-4816-4fc9-a885-37789e8d8db2 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:11.704500 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-e8dd2e0a-4816-4fc9-a885-37789e8d8db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:11.817243 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 833/1649] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:11.820171 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ce8d3-5508-42fe-b586-67585b036994 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:11.820477 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ce8d3-5508-42fe-b586-67585b036994 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:11.820761 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ce8d3-5508-42fe-b586-67585b036994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:11.836645 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 817/1650] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:50:11 2022] POST /identity/v3/projects => generated 354 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:11.841653 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd96bb-0539-4696-93a4-441f5c4781b1 tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:11.843919 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9fdd96bb-0539-4696-93a4-441f5c4781b1 tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:11.851646 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-887ce8d3-5508-42fe-b586-67585b036994 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:11.853203 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-887ce8d3-5508-42fe-b586-67585b036994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:11.900020 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:11.948953 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 834/1651] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:11.948953 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ce8d3-5508-42fe-b586-67585b036994 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:11.949198 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-887ce8d3-5508-42fe-b586-67585b036994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:11.972135 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ce8d3-5508-42fe-b586-67585b036994 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:11.981035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0460d4-e755-4912-ad9b-bfa5066b56c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:11.982448 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0460d4-e755-4912-ad9b-bfa5066b56c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:11.982785 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0460d4-e755-4912-ad9b-bfa5066b56c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:11.983176 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0460d4-e755-4912-ad9b-bfa5066b56c3 admin admin] PATH_INFO: `/v3/users/b9c10bd4ea1740869d8579695c9c4196` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:11.984827 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0460d4-e755-4912-ad9b-bfa5066b56c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9c10bd4ea1740869d8579695c9c4196)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:11.989806 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0460d4-e755-4912-ad9b-bfa5066b56c3 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:12.018128 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd96bb-0539-4696-93a4-441f5c4781b1 tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:12.025866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489b8fd-e61a-48fb-ab57-865a090c72ec tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8523b0f96ff04b67861e358ac23e5baa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f0ef7891fc440b09c2f76ff24325142', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:12.026556 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489b8fd-e61a-48fb-ab57-865a090c72ec tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:12.026905 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489b8fd-e61a-48fb-ab57-865a090c72ec tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:12.027284 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489b8fd-e61a-48fb-ab57-865a090c72ec tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:12.028013 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489b8fd-e61a-48fb-ab57-865a090c72ec tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:50:12.028489 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489b8fd-e61a-48fb-ab57-865a090c72ec tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:12.030235 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489b8fd-e61a-48fb-ab57-865a090c72ec tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:12.051915 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 818/1652] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:50:12.051915 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489b8fd-e61a-48fb-ab57-865a090c72ec tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:12.067364 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489b8fd-e61a-48fb-ab57-865a090c72ec tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:12.074195 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44728d-f9ee-4f10-92b0-a8dd183caf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:12.076459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44728d-f9ee-4f10-92b0-a8dd183caf13 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:12.076459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44728d-f9ee-4f10-92b0-a8dd183caf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:12.076459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44728d-f9ee-4f10-92b0-a8dd183caf13 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:12.077256 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44728d-f9ee-4f10-92b0-a8dd183caf13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:50:12.077581 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44728d-f9ee-4f10-92b0-a8dd183caf13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:12.079555 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44728d-f9ee-4f10-92b0-a8dd183caf13 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:12.100309 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 819/1653] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:50:12.108853 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44728d-f9ee-4f10-92b0-a8dd183caf13 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:12.120500 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44728d-f9ee-4f10-92b0-a8dd183caf13 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:12.124993 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7661b-b782-4387-bb7e-3428fc97402a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:12.125709 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7661b-b782-4387-bb7e-3428fc97402a admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:12.125909 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7661b-b782-4387-bb7e-3428fc97402a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:12.126176 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7661b-b782-4387-bb7e-3428fc97402a admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:12.126866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e7661b-b782-4387-bb7e-3428fc97402a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:12.129438 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e7661b-b782-4387-bb7e-3428fc97402a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:12.170298 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-bc0460d4-e755-4912-ad9b-bfa5066b56c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9c10bd4ea1740869d8579695c9c4196'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:12.171007 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-bc0460d4-e755-4912-ad9b-bfa5066b56c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9c10bd4ea1740869d8579695c9c4196'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:12.171708 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-bc0460d4-e755-4912-ad9b-bfa5066b56c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9c10bd4ea1740869d8579695c9c4196'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:12.181393 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-bc0460d4-e755-4912-ad9b-bfa5066b56c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9c10bd4ea1740869d8579695c9c4196'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:12.215205 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 820/1654] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:50:12 2022] POST /identity/v3/projects => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:12.216174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7661b-b782-4387-bb7e-3428fc97402a admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:12.219465 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-e0e7661b-b782-4387-bb7e-3428fc97402a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:12.264162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-bc0460d4-e755-4912-ad9b-bfa5066b56c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9c10bd4ea1740869d8579695c9c4196'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:12.298689 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 835/1655] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:50:11 2022] DELETE /identity/v3/users/b9c10bd4ea1740869d8579695c9c4196 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:12.304087 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0460d4-e755-4912-ad9b-bfa5066b56c3 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:12.305481 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-bc0460d4-e755-4912-ad9b-bfa5066b56c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:12.308712 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7661b-b782-4387-bb7e-3428fc97402a admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:12.387761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30faa62e-5ffc-419d-994b-d5333d71a64d tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8523b0f96ff04b67861e358ac23e5baa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f0ef7891fc440b09c2f76ff24325142', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:12.388974 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30faa62e-5ffc-419d-994b-d5333d71a64d tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:12.390148 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30faa62e-5ffc-419d-994b-d5333d71a64d tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:12.390807 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30faa62e-5ffc-419d-994b-d5333d71a64d tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] PATH_INFO: `/v3/projects/166462e7b85647bc9dd0f9a83c94faa5` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:12.394438 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30faa62e-5ffc-419d-994b-d5333d71a64d tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] RBAC: Authorizing `identity:delete_project(project_id=166462e7b85647bc9dd0f9a83c94faa5)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:12.396862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30faa62e-5ffc-419d-994b-d5333d71a64d tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:12.446394 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0460d4-e755-4912-ad9b-bfa5066b56c3 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:12.451326 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ecf41-460a-4f73-8488-fefbb4ba9621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:12.452146 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ecf41-460a-4f73-8488-fefbb4ba9621 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:12.452491 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ecf41-460a-4f73-8488-fefbb4ba9621 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:12.452845 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ecf41-460a-4f73-8488-fefbb4ba9621 admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:12.453793 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ecf41-460a-4f73-8488-fefbb4ba9621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:12.457084 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ecf41-460a-4f73-8488-fefbb4ba9621 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:12.518057 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-30faa62e-5ffc-419d-994b-d5333d71a64d tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '166462e7b85647bc9dd0f9a83c94faa5', 'request_id': 'req-30faa62e-5ffc-419d-994b-d5333d71a64d'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:12.527066 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-30faa62e-5ffc-419d-994b-d5333d71a64d tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '166462e7b85647bc9dd0f9a83c94faa5', 'request_id': 'req-30faa62e-5ffc-419d-994b-d5333d71a64d'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:12.552888 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-30faa62e-5ffc-419d-994b-d5333d71a64d tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '166462e7b85647bc9dd0f9a83c94faa5', 'request_id': 'req-30faa62e-5ffc-419d-994b-d5333d71a64d'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:12.619734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 836/1656] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:50:12 2022] POST /identity/v3/users => generated 286 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:12.624476 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3612a-4097-482a-be59-eb3e4737d71a None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:12.624476 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3612a-4097-482a-be59-eb3e4737d71a None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:12.624476 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3612a-4097-482a-be59-eb3e4737d71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:12.653167 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-30faa62e-5ffc-419d-994b-d5333d71a64d tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] The token cache is being invalidate because project 166462e7b85647bc9dd0f9a83c94faa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:50:12.653472 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-30faa62e-5ffc-419d-994b-d5333d71a64d tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:12.654785 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-aee3612a-4097-482a-be59-eb3e4737d71a None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:12.656040 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-aee3612a-4097-482a-be59-eb3e4737d71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:12.658140 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-30faa62e-5ffc-419d-994b-d5333d71a64d tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:12.660284 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 821/1657] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:50:12 2022] DELETE /identity/v3/projects/166462e7b85647bc9dd0f9a83c94faa5 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:12.661226 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30faa62e-5ffc-419d-994b-d5333d71a64d tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:12.662547 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-30faa62e-5ffc-419d-994b-d5333d71a64d tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:12.812382 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 837/1658] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:12.831714 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:12.897951 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30faa62e-5ffc-419d-994b-d5333d71a64d tempest-VolumeQuotaClassesTest-280422077 tempest-VolumeQuotaClassesTest-280422077-project-admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:12.905189 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c36892-9be6-4791-9aaf-466fc39bb4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:12.905889 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c36892-9be6-4791-9aaf-466fc39bb4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:12.906173 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c36892-9be6-4791-9aaf-466fc39bb4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:12.909929 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c36892-9be6-4791-9aaf-466fc39bb4d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:12.909929 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c36892-9be6-4791-9aaf-466fc39bb4d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:12.909929 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c36892-9be6-4791-9aaf-466fc39bb4d6 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:12.926259 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 822/1659] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:12.930338 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3612a-4097-482a-be59-eb3e4737d71a None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:12.973188 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3612a-4097-482a-be59-eb3e4737d71a None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:12.978969 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6b3a9-cadf-4e66-97b2-92b2c9abac54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:12.989263 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6b3a9-cadf-4e66-97b2-92b2c9abac54 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:12.989263 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6b3a9-cadf-4e66-97b2-92b2c9abac54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:12.989263 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6b3a9-cadf-4e66-97b2-92b2c9abac54 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:12.989263 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b6b3a9-cadf-4e66-97b2-92b2c9abac54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:12.989263 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b6b3a9-cadf-4e66-97b2-92b2c9abac54 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:13.044871 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 838/1660] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:13.047015 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c36892-9be6-4791-9aaf-466fc39bb4d6 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:13.073550 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6b3a9-cadf-4e66-97b2-92b2c9abac54 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:13.080760 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-65b6b3a9-cadf-4e66-97b2-92b2c9abac54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:13.093125 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c36892-9be6-4791-9aaf-466fc39bb4d6 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:13.117740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ace91f-6d0b-4613-a577-e80fe525f303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:13.118669 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ace91f-6d0b-4613-a577-e80fe525f303 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:13.127476 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ace91f-6d0b-4613-a577-e80fe525f303 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:13.127476 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ace91f-6d0b-4613-a577-e80fe525f303 admin admin] PATH_INFO: `/v3/projects/b5e44de5314545e49497f8289df28243/users/ea9bcfce0a964cdb82ea12247c3aee1f/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:13.219493 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ace91f-6d0b-4613-a577-e80fe525f303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5e44de5314545e49497f8289df28243, user_id=ea9bcfce0a964cdb82ea12247c3aee1f, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:13.222558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ace91f-6d0b-4613-a577-e80fe525f303 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:13.333672 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6b3a9-cadf-4e66-97b2-92b2c9abac54 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:13.334119 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 823/1661] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:13 2022] PUT /identity/v3/projects/b5e44de5314545e49497f8289df28243/users/ea9bcfce0a964cdb82ea12247c3aee1f/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:13.344286 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d50678-bbb2-4852-a05b-276b20dcf04d None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:13.344634 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d50678-bbb2-4852-a05b-276b20dcf04d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:13.344916 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d50678-bbb2-4852-a05b-276b20dcf04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:13.456892 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-29d50678-bbb2-4852-a05b-276b20dcf04d None None] MFA Rules not processed for user `ea9bcfce0a964cdb82ea12247c3aee1f`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:13.458730 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-29d50678-bbb2-4852-a05b-276b20dcf04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:13.497186 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083dc426-a03e-454d-9f09-239d8f7cf277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:13.498982 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083dc426-a03e-454d-9f09-239d8f7cf277 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:13.506346 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083dc426-a03e-454d-9f09-239d8f7cf277 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:13.506346 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083dc426-a03e-454d-9f09-239d8f7cf277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:13.649293 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083dc426-a03e-454d-9f09-239d8f7cf277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:13.651216 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 824/1662] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:13.655517 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d50678-bbb2-4852-a05b-276b20dcf04d None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:13.655761 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083dc426-a03e-454d-9f09-239d8f7cf277 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:13.671440 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d50678-bbb2-4852-a05b-276b20dcf04d None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:13.682555 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468ba0e-a860-419a-bfe6-bf9672c97dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:13.683555 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468ba0e-a860-419a-bfe6-bf9672c97dea admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:13.684075 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468ba0e-a860-419a-bfe6-bf9672c97dea admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:13.684545 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468ba0e-a860-419a-bfe6-bf9672c97dea admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:13.684713 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 839/1663] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:13.686540 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468ba0e-a860-419a-bfe6-bf9672c97dea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:13.688766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468ba0e-a860-419a-bfe6-bf9672c97dea admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:13.710408 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:13.843083 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 825/1664] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:50:13 2022] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:50:13.843760 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083dc426-a03e-454d-9f09-239d8f7cf277 service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:13.863423 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083dc426-a03e-454d-9f09-239d8f7cf277 service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:13.878740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468ba0e-a860-419a-bfe6-bf9672c97dea admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:13.880875 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a468ba0e-a860-419a-bfe6-bf9672c97dea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:13.943060 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:14.013374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860a15a-0b34-4d66-a601-2d6e439c9d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:14.014218 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860a15a-0b34-4d66-a601-2d6e439c9d89 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:14.015077 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860a15a-0b34-4d66-a601-2d6e439c9d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:14.015430 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860a15a-0b34-4d66-a601-2d6e439c9d89 admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:14.016249 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860a15a-0b34-4d66-a601-2d6e439c9d89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:14.020799 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860a15a-0b34-4d66-a601-2d6e439c9d89 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:14.047835 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468ba0e-a860-419a-bfe6-bf9672c97dea admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:14.057015 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1981d1-6374-4cdc-b0b9-10ddf5a980f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:14.058124 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1981d1-6374-4cdc-b0b9-10ddf5a980f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:14.058245 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1981d1-6374-4cdc-b0b9-10ddf5a980f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:14.058476 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1981d1-6374-4cdc-b0b9-10ddf5a980f7 admin admin] PATH_INFO: `/v3/users/86fd23a3e9454b36b340849cbe96e683` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:14.061594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1981d1-6374-4cdc-b0b9-10ddf5a980f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86fd23a3e9454b36b340849cbe96e683)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:14.064719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: WARNING py.warnings [None req-7d1981d1-6374-4cdc-b0b9-10ddf5a980f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 08:50:14.064719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: warnings.warn(msg) Jul 25 08:50:14.064719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: Jul 25 08:50:14.069710 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1981d1-6374-4cdc-b0b9-10ddf5a980f7 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:14.799985 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 840/1665] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:50:13 2022] POST /identity/v3/users => generated 293 bytes in 960 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:14.803972 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860a15a-0b34-4d66-a601-2d6e439c9d89 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:14.824587 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860a15a-0b34-4d66-a601-2d6e439c9d89 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:14.840043 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b806f7a-3950-4fcc-bea6-d100c0bcfbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:14.840043 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b806f7a-3950-4fcc-bea6-d100c0bcfbfc admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:14.840043 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b806f7a-3950-4fcc-bea6-d100c0bcfbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:14.840584 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b806f7a-3950-4fcc-bea6-d100c0bcfbfc admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:14.841404 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b806f7a-3950-4fcc-bea6-d100c0bcfbfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:14.843101 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b806f7a-3950-4fcc-bea6-d100c0bcfbfc admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:14.868078 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 841/1666] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:50:14.872456 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b806f7a-3950-4fcc-bea6-d100c0bcfbfc admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:14.898188 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b806f7a-3950-4fcc-bea6-d100c0bcfbfc admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:14.915304 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66a7f9-fe8c-4cfa-a426-718d2fdf062b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:14.916396 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66a7f9-fe8c-4cfa-a426-718d2fdf062b admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:14.916750 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66a7f9-fe8c-4cfa-a426-718d2fdf062b admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:14.917116 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66a7f9-fe8c-4cfa-a426-718d2fdf062b admin admin] PATH_INFO: `/v3/projects/09fefaa2dfa44944928c0e4d6c5ceee3/users/89569720a2f7486ab48d6f5e357d0f21/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:14.963459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7d1981d1-6374-4cdc-b0b9-10ddf5a980f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86fd23a3e9454b36b340849cbe96e683'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:14.964521 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7d1981d1-6374-4cdc-b0b9-10ddf5a980f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86fd23a3e9454b36b340849cbe96e683'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:14.970249 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66a7f9-fe8c-4cfa-a426-718d2fdf062b admin admin] RBAC: Authorizing `identity:create_grant(project_id=09fefaa2dfa44944928c0e4d6c5ceee3, user_id=89569720a2f7486ab48d6f5e357d0f21, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:14.996846 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66a7f9-fe8c-4cfa-a426-718d2fdf062b admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:15.015361 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7d1981d1-6374-4cdc-b0b9-10ddf5a980f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86fd23a3e9454b36b340849cbe96e683'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:15.018234 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7d1981d1-6374-4cdc-b0b9-10ddf5a980f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86fd23a3e9454b36b340849cbe96e683'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:15.083071 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 842/1667] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:14 2022] PUT /identity/v3/projects/09fefaa2dfa44944928c0e4d6c5ceee3/users/89569720a2f7486ab48d6f5e357d0f21/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:15.087084 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66a7f9-fe8c-4cfa-a426-718d2fdf062b admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:15.097095 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-ba66a7f9-fe8c-4cfa-a426-718d2fdf062b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:15.106907 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7d1981d1-6374-4cdc-b0b9-10ddf5a980f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86fd23a3e9454b36b340849cbe96e683'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:15.205103 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 826/1668] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:50:13 2022] DELETE /identity/v3/users/86fd23a3e9454b36b340849cbe96e683 => generated 0 bytes in 1328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:50:15.217720 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8602a33-9c35-4000-8659-3f966da8ca0b None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:15.217720 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8602a33-9c35-4000-8659-3f966da8ca0b None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:15.217720 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8602a33-9c35-4000-8659-3f966da8ca0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:15.286425 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-d8602a33-9c35-4000-8659-3f966da8ca0b None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:15.287706 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d8602a33-9c35-4000-8659-3f966da8ca0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:15.385622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66a7f9-fe8c-4cfa-a426-718d2fdf062b admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:15.538060 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 827/1669] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:15.592406 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70622758-558c-482a-8c9e-bcd6c77c9440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:15.593114 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70622758-558c-482a-8c9e-bcd6c77c9440 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:15.595303 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70622758-558c-482a-8c9e-bcd6c77c9440 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:15.595696 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70622758-558c-482a-8c9e-bcd6c77c9440 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:15.598826 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70622758-558c-482a-8c9e-bcd6c77c9440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:15.602082 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70622758-558c-482a-8c9e-bcd6c77c9440 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:15.626865 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 843/1670] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 540 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:15.629771 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8602a33-9c35-4000-8659-3f966da8ca0b None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:15.644357 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8602a33-9c35-4000-8659-3f966da8ca0b None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:15.668458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523954d-57bd-4ca9-93fe-e10bbdf9ff79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:15.669667 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523954d-57bd-4ca9-93fe-e10bbdf9ff79 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:15.669951 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523954d-57bd-4ca9-93fe-e10bbdf9ff79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:15.670229 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523954d-57bd-4ca9-93fe-e10bbdf9ff79 admin admin] PATH_INFO: `/v3/projects/09fefaa2dfa44944928c0e4d6c5ceee3/users/89569720a2f7486ab48d6f5e357d0f21/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:15.672412 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523954d-57bd-4ca9-93fe-e10bbdf9ff79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09fefaa2dfa44944928c0e4d6c5ceee3, user_id=89569720a2f7486ab48d6f5e357d0f21, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:15.675750 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523954d-57bd-4ca9-93fe-e10bbdf9ff79 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:15.719250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70622758-558c-482a-8c9e-bcd6c77c9440 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:15.722824 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-70622758-558c-482a-8c9e-bcd6c77c9440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:15.734000 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 828/1671] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:15 2022] PUT /identity/v3/projects/09fefaa2dfa44944928c0e4d6c5ceee3/users/89569720a2f7486ab48d6f5e357d0f21/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:15.736083 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc879afc-5d21-4c53-a718-b7b834a3a4a1 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:15.736486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc879afc-5d21-4c53-a718-b7b834a3a4a1 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:15.736829 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc879afc-5d21-4c53-a718-b7b834a3a4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:15.814798 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-dc879afc-5d21-4c53-a718-b7b834a3a4a1 None None] MFA Rules not processed for user `89569720a2f7486ab48d6f5e357d0f21`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:15.817938 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-dc879afc-5d21-4c53-a718-b7b834a3a4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:15.818569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:15.886528 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70622758-558c-482a-8c9e-bcd6c77c9440 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:15.953683 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 829/1672] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:15.966880 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc879afc-5d21-4c53-a718-b7b834a3a4a1 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:15.969121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-dc879afc-5d21-4c53-a718-b7b834a3a4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:16.051640 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc879afc-5d21-4c53-a718-b7b834a3a4a1 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:16.054289 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5c0fb-7abe-4116-9958-ee80f36a4261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:16.054826 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5c0fb-7abe-4116-9958-ee80f36a4261 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:16.055110 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5c0fb-7abe-4116-9958-ee80f36a4261 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:16.055263 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e32c29-a0c3-4257-8d52-8674454e076c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:16.055401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5c0fb-7abe-4116-9958-ee80f36a4261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:16.056014 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e32c29-a0c3-4257-8d52-8674454e076c service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:16.056248 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e32c29-a0c3-4257-8d52-8674454e076c service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:16.056532 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e32c29-a0c3-4257-8d52-8674454e076c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:16.067565 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e32c29-a0c3-4257-8d52-8674454e076c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:16.070180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e32c29-a0c3-4257-8d52-8674454e076c service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:16.083262 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 830/1673] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:50:16.185468 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5c0fb-7abe-4116-9958-ee80f36a4261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:16.187053 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5c0fb-7abe-4116-9958-ee80f36a4261 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:16.213573 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 844/1674] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:50:16.300185 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:16.310763 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e32c29-a0c3-4257-8d52-8674454e076c service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:16.324321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e32c29-a0c3-4257-8d52-8674454e076c service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:16.338933 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01e922-c9c0-4b07-8d09-10d5ec9b1904 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:16.341199 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01e922-c9c0-4b07-8d09-10d5ec9b1904 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:16.342459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01e922-c9c0-4b07-8d09-10d5ec9b1904 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:16.343152 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01e922-c9c0-4b07-8d09-10d5ec9b1904 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:16.353155 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9f01e922-c9c0-4b07-8d09-10d5ec9b1904 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:16.361184 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5c0fb-7abe-4116-9958-ee80f36a4261 service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:16.363800 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-43b5c0fb-7abe-4116-9958-ee80f36a4261 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:16.384481 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5c0fb-7abe-4116-9958-ee80f36a4261 service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:16.403815 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17341c-5b02-4f70-8931-5849ec0c79fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:16.405068 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17341c-5b02-4f70-8931-5849ec0c79fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:16.405574 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17341c-5b02-4f70-8931-5849ec0c79fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:16.406053 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17341c-5b02-4f70-8931-5849ec0c79fb admin admin] PATH_INFO: `/v3/projects/33274da9fd014cb7a75be9e66c1e85e8` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:16.409782 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17341c-5b02-4f70-8931-5849ec0c79fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=33274da9fd014cb7a75be9e66c1e85e8)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:16.412064 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17341c-5b02-4f70-8931-5849ec0c79fb admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:16.570351 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01e922-c9c0-4b07-8d09-10d5ec9b1904 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:16.574392 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01e922-c9c0-4b07-8d09-10d5ec9b1904 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:16.597738 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 831/1675] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:16.655752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-6f17341c-5b02-4f70-8931-5849ec0c79fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33274da9fd014cb7a75be9e66c1e85e8', 'request_id': 'req-6f17341c-5b02-4f70-8931-5849ec0c79fb'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:16.683188 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-6f17341c-5b02-4f70-8931-5849ec0c79fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33274da9fd014cb7a75be9e66c1e85e8', 'request_id': 'req-6f17341c-5b02-4f70-8931-5849ec0c79fb'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:16.709644 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-6f17341c-5b02-4f70-8931-5849ec0c79fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33274da9fd014cb7a75be9e66c1e85e8', 'request_id': 'req-6f17341c-5b02-4f70-8931-5849ec0c79fb'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:16.857182 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-6f17341c-5b02-4f70-8931-5849ec0c79fb admin admin] The token cache is being invalidate because project 33274da9fd014cb7a75be9e66c1e85e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:50:16.858953 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-6f17341c-5b02-4f70-8931-5849ec0c79fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:16.860205 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-6f17341c-5b02-4f70-8931-5849ec0c79fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:16.863170 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 845/1676] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:50:16 2022] DELETE /identity/v3/projects/33274da9fd014cb7a75be9e66c1e85e8 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:50:16.866895 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01e922-c9c0-4b07-8d09-10d5ec9b1904 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:16.881973 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01e922-c9c0-4b07-8d09-10d5ec9b1904 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:17.028398 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95680b1-3c5d-49c5-85a4-da72cb6e42b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:17.029311 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95680b1-3c5d-49c5-85a4-da72cb6e42b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:17.029607 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95680b1-3c5d-49c5-85a4-da72cb6e42b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:17.033679 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95680b1-3c5d-49c5-85a4-da72cb6e42b6 admin admin] PATH_INFO: `/v3/users/0459cd1344f04dbda2da734ea7619551` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:17.036035 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95680b1-3c5d-49c5-85a4-da72cb6e42b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0459cd1344f04dbda2da734ea7619551)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:17.041658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95680b1-3c5d-49c5-85a4-da72cb6e42b6 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:17.104635 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:17.288131 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f95680b1-3c5d-49c5-85a4-da72cb6e42b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0459cd1344f04dbda2da734ea7619551'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:17.291919 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f95680b1-3c5d-49c5-85a4-da72cb6e42b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0459cd1344f04dbda2da734ea7619551'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:17.320672 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f95680b1-3c5d-49c5-85a4-da72cb6e42b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0459cd1344f04dbda2da734ea7619551'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:17.324731 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f95680b1-3c5d-49c5-85a4-da72cb6e42b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0459cd1344f04dbda2da734ea7619551'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:17.437899 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f95680b1-3c5d-49c5-85a4-da72cb6e42b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0459cd1344f04dbda2da734ea7619551'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:17.481911 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 832/1677] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:50:16 2022] DELETE /identity/v3/users/0459cd1344f04dbda2da734ea7619551 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:17.765245 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17341c-5b02-4f70-8931-5849ec0c79fb admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:17.767114 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-6f17341c-5b02-4f70-8931-5849ec0c79fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:17.794841 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17341c-5b02-4f70-8931-5849ec0c79fb admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:17.922106 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed052c-2fa5-46e7-b4e0-b8c272c24c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:17.923003 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed052c-2fa5-46e7-b4e0-b8c272c24c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:17.923287 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed052c-2fa5-46e7-b4e0-b8c272c24c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:17.923769 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed052c-2fa5-46e7-b4e0-b8c272c24c25 admin admin] PATH_INFO: `/v3/projects/4ab2d80d06c14106b5f1c7ae0fdd16af` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:17.925035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed052c-2fa5-46e7-b4e0-b8c272c24c25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ab2d80d06c14106b5f1c7ae0fdd16af)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:17.929163 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed052c-2fa5-46e7-b4e0-b8c272c24c25 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:18.121283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:18.133495 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-caed052c-2fa5-46e7-b4e0-b8c272c24c25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ab2d80d06c14106b5f1c7ae0fdd16af', 'request_id': 'req-caed052c-2fa5-46e7-b4e0-b8c272c24c25'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:18.149520 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-caed052c-2fa5-46e7-b4e0-b8c272c24c25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ab2d80d06c14106b5f1c7ae0fdd16af', 'request_id': 'req-caed052c-2fa5-46e7-b4e0-b8c272c24c25'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:18.164520 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-caed052c-2fa5-46e7-b4e0-b8c272c24c25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ab2d80d06c14106b5f1c7ae0fdd16af', 'request_id': 'req-caed052c-2fa5-46e7-b4e0-b8c272c24c25'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:18.289267 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-caed052c-2fa5-46e7-b4e0-b8c272c24c25 admin admin] The token cache is being invalidate because project 4ab2d80d06c14106b5f1c7ae0fdd16af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:50:18.291538 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-caed052c-2fa5-46e7-b4e0-b8c272c24c25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:18.291538 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-caed052c-2fa5-46e7-b4e0-b8c272c24c25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:18.293272 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 846/1678] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:50:17 2022] DELETE /identity/v3/projects/4ab2d80d06c14106b5f1c7ae0fdd16af => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:18.297526 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95680b1-3c5d-49c5-85a4-da72cb6e42b6 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:18.299014 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f95680b1-3c5d-49c5-85a4-da72cb6e42b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:18.309922 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:18.326667 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95680b1-3c5d-49c5-85a4-da72cb6e42b6 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:18.437650 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eac85a-80c3-4474-a590-d4261ba921f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:18.438739 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eac85a-80c3-4474-a590-d4261ba921f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:18.439179 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eac85a-80c3-4474-a590-d4261ba921f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:18.439678 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eac85a-80c3-4474-a590-d4261ba921f8 admin admin] PATH_INFO: `/v3/users/8523b0f96ff04b67861e358ac23e5baa` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:18.441207 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eac85a-80c3-4474-a590-d4261ba921f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8523b0f96ff04b67861e358ac23e5baa)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:18.446057 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eac85a-80c3-4474-a590-d4261ba921f8 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:18.549688 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed052c-2fa5-46e7-b4e0-b8c272c24c25 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:18.552311 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-caed052c-2fa5-46e7-b4e0-b8c272c24c25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:18.577036 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed052c-2fa5-46e7-b4e0-b8c272c24c25 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:18.592811 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d481d-7ccb-49a7-a101-e981274553a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:18.593625 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d481d-7ccb-49a7-a101-e981274553a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:18.593911 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d481d-7ccb-49a7-a101-e981274553a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:18.594191 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d481d-7ccb-49a7-a101-e981274553a1 admin admin] PATH_INFO: `/v3/projects/3aecabd846a742ad9d91c9412cfef4aa` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:18.595472 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d481d-7ccb-49a7-a101-e981274553a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aecabd846a742ad9d91c9412cfef4aa)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:18.598184 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d481d-7ccb-49a7-a101-e981274553a1 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:18.687230 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-48eac85a-80c3-4474-a590-d4261ba921f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8523b0f96ff04b67861e358ac23e5baa'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:18.688818 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-48eac85a-80c3-4474-a590-d4261ba921f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8523b0f96ff04b67861e358ac23e5baa'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:18.720638 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-48eac85a-80c3-4474-a590-d4261ba921f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8523b0f96ff04b67861e358ac23e5baa'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:18.722035 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-48eac85a-80c3-4474-a590-d4261ba921f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8523b0f96ff04b67861e358ac23e5baa'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:18.740585 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-533d481d-7ccb-49a7-a101-e981274553a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aecabd846a742ad9d91c9412cfef4aa', 'request_id': 'req-533d481d-7ccb-49a7-a101-e981274553a1'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:18.753911 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-533d481d-7ccb-49a7-a101-e981274553a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aecabd846a742ad9d91c9412cfef4aa', 'request_id': 'req-533d481d-7ccb-49a7-a101-e981274553a1'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:18.760620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-533d481d-7ccb-49a7-a101-e981274553a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aecabd846a742ad9d91c9412cfef4aa', 'request_id': 'req-533d481d-7ccb-49a7-a101-e981274553a1'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:18.790169 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-48eac85a-80c3-4474-a590-d4261ba921f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8523b0f96ff04b67861e358ac23e5baa'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:18.828298 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 833/1679] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:50:18 2022] DELETE /identity/v3/users/8523b0f96ff04b67861e358ac23e5baa => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:18.858808 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:18.870679 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-533d481d-7ccb-49a7-a101-e981274553a1 admin admin] The token cache is being invalidate because project 3aecabd846a742ad9d91c9412cfef4aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:50:18.871907 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-533d481d-7ccb-49a7-a101-e981274553a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:18.873530 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-533d481d-7ccb-49a7-a101-e981274553a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:18.877034 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 847/1680] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:50:18 2022] DELETE /identity/v3/projects/3aecabd846a742ad9d91c9412cfef4aa => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:50:18.882184 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa588078-052c-4239-bfa5-c65f97637bfc None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:18.882562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa588078-052c-4239-bfa5-c65f97637bfc None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:18.882798 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa588078-052c-4239-bfa5-c65f97637bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:18.905342 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-fa588078-052c-4239-bfa5-c65f97637bfc None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:18.906996 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-fa588078-052c-4239-bfa5-c65f97637bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:19.016965 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 834/1681] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:19.020135 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c10275-ef35-4241-a5f7-8e0c59270ba6 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:19.020602 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c10275-ef35-4241-a5f7-8e0c59270ba6 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:19.020734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c10275-ef35-4241-a5f7-8e0c59270ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:19.055717 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-94c10275-ef35-4241-a5f7-8e0c59270ba6 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:19.061100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-94c10275-ef35-4241-a5f7-8e0c59270ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:19.073489 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 848/1682] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:19.077436 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa588078-052c-4239-bfa5-c65f97637bfc None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:19.091197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa588078-052c-4239-bfa5-c65f97637bfc None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:19.100030 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99c9bb-22cc-4359-a685-5f97044487fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:19.100868 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99c9bb-22cc-4359-a685-5f97044487fd admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:19.101331 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99c9bb-22cc-4359-a685-5f97044487fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:19.101620 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99c9bb-22cc-4359-a685-5f97044487fd admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:19.102601 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99c9bb-22cc-4359-a685-5f97044487fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:50:19.103000 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99c9bb-22cc-4359-a685-5f97044487fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:19.104749 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99c9bb-22cc-4359-a685-5f97044487fd admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:19.124574 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 835/1683] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:50:19.129279 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c10275-ef35-4241-a5f7-8e0c59270ba6 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:19.142625 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c10275-ef35-4241-a5f7-8e0c59270ba6 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:19.155480 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5dfa2-b169-47cd-881d-0cd5dc9e1fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:19.156656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5dfa2-b169-47cd-881d-0cd5dc9e1fad admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:19.157218 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5dfa2-b169-47cd-881d-0cd5dc9e1fad admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:19.157680 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5dfa2-b169-47cd-881d-0cd5dc9e1fad admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:19.158569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5dfa2-b169-47cd-881d-0cd5dc9e1fad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:19.161250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5dfa2-b169-47cd-881d-0cd5dc9e1fad admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:19.275236 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 849/1684] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:50:19 2022] POST /identity/v3/projects => generated 365 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:19.280205 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99c9bb-22cc-4359-a685-5f97044487fd admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:19.300902 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99c9bb-22cc-4359-a685-5f97044487fd admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:19.546952 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec6eb0-78d9-418f-af6a-0f91bcd9c312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:19.547821 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec6eb0-78d9-418f-af6a-0f91bcd9c312 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:19.548353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec6eb0-78d9-418f-af6a-0f91bcd9c312 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:19.548840 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec6eb0-78d9-418f-af6a-0f91bcd9c312 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:19.550592 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec6eb0-78d9-418f-af6a-0f91bcd9c312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:19.556383 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec6eb0-78d9-418f-af6a-0f91bcd9c312 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:19.713312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:19.727443 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 836/1685] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:50:19 2022] POST /identity/v3/users => generated 283 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:19.728745 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5dfa2-b169-47cd-881d-0cd5dc9e1fad admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:19.750954 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5dfa2-b169-47cd-881d-0cd5dc9e1fad admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:19.776676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b82fa5-7929-49d9-8d50-ee50e4f5717a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:19.777359 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b82fa5-7929-49d9-8d50-ee50e4f5717a admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:19.777642 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b82fa5-7929-49d9-8d50-ee50e4f5717a admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:19.777923 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b82fa5-7929-49d9-8d50-ee50e4f5717a admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:19.778659 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b82fa5-7929-49d9-8d50-ee50e4f5717a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:19.780292 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b82fa5-7929-49d9-8d50-ee50e4f5717a admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:19.819579 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 850/1686] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:19.824974 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec6eb0-78d9-418f-af6a-0f91bcd9c312 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:19.838976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec6eb0-78d9-418f-af6a-0f91bcd9c312 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:19.863364 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905e3b8-d92b-48ff-8ef9-46546ee6f011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:19.864609 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905e3b8-d92b-48ff-8ef9-46546ee6f011 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:19.864907 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905e3b8-d92b-48ff-8ef9-46546ee6f011 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:19.865190 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905e3b8-d92b-48ff-8ef9-46546ee6f011 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:19.866868 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905e3b8-d92b-48ff-8ef9-46546ee6f011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:19.871370 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905e3b8-d92b-48ff-8ef9-46546ee6f011 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:19.901375 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 837/1687] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:19.905141 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b82fa5-7929-49d9-8d50-ee50e4f5717a admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:19.923690 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b82fa5-7929-49d9-8d50-ee50e4f5717a admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:19.942756 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265b5f2-8c2c-4da7-8d44-6de258958033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:19.942756 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265b5f2-8c2c-4da7-8d44-6de258958033 admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:19.942756 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265b5f2-8c2c-4da7-8d44-6de258958033 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:19.942756 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265b5f2-8c2c-4da7-8d44-6de258958033 admin admin] PATH_INFO: `/v3/projects/a059fd0bb44d4277bfc23960a6d5a1fa/users/f604f9abd3c342068dc5c70c46f1b75f/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:19.980566 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3265b5f2-8c2c-4da7-8d44-6de258958033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a059fd0bb44d4277bfc23960a6d5a1fa, user_id=f604f9abd3c342068dc5c70c46f1b75f, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:19.983590 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3265b5f2-8c2c-4da7-8d44-6de258958033 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:20.066764 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 851/1688] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:19 2022] PUT /identity/v3/projects/a059fd0bb44d4277bfc23960a6d5a1fa/users/f604f9abd3c342068dc5c70c46f1b75f/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:20.077495 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc86fe4-48df-4532-b6d2-9d4c0e65675d None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:20.077877 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc86fe4-48df-4532-b6d2-9d4c0e65675d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:20.078281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc86fe4-48df-4532-b6d2-9d4c0e65675d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:20.144714 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-0cc86fe4-48df-4532-b6d2-9d4c0e65675d None None] MFA Rules not processed for user `f604f9abd3c342068dc5c70c46f1b75f`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:20.145918 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0cc86fe4-48df-4532-b6d2-9d4c0e65675d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:20.352284 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 838/1689] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:20 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:50:20.356932 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265b5f2-8c2c-4da7-8d44-6de258958033 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:20.505371 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265b5f2-8c2c-4da7-8d44-6de258958033 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:20.510794 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2b3fc-8faf-42fe-a487-894cf9924f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:20.511732 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2b3fc-8faf-42fe-a487-894cf9924f09 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:20.512249 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2b3fc-8faf-42fe-a487-894cf9924f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:20.512690 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2b3fc-8faf-42fe-a487-894cf9924f09 admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:20.513571 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2b3fc-8faf-42fe-a487-894cf9924f09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:20.515762 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2b3fc-8faf-42fe-a487-894cf9924f09 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:20.638127 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:20.645784 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 852/1690] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:50:20 2022] POST /identity/v3/projects => generated 361 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:20.649879 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc86fe4-48df-4532-b6d2-9d4c0e65675d None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:20.663992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc86fe4-48df-4532-b6d2-9d4c0e65675d None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:20.764893 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa370b-822b-46ab-99cd-56897ad99a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:20.766283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa370b-822b-46ab-99cd-56897ad99a63 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:20.766873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa370b-822b-46ab-99cd-56897ad99a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:20.767287 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa370b-822b-46ab-99cd-56897ad99a63 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:20.769029 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa370b-822b-46ab-99cd-56897ad99a63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:20.771141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa370b-822b-46ab-99cd-56897ad99a63 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:20.844170 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2b3fc-8faf-42fe-a487-894cf9924f09 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:20.846050 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-5ab2b3fc-8faf-42fe-a487-894cf9924f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:20.885073 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2b3fc-8faf-42fe-a487-894cf9924f09 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:20.894112 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b3c8e-93f8-4dc1-9aff-79b8e7a13b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:20.896455 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b3c8e-93f8-4dc1-9aff-79b8e7a13b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:20.898657 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b3c8e-93f8-4dc1-9aff-79b8e7a13b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:20.899890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b3c8e-93f8-4dc1-9aff-79b8e7a13b53 admin admin] PATH_INFO: `/v3/projects/3f0ef7891fc440b09c2f76ff24325142` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:20.903429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b3c8e-93f8-4dc1-9aff-79b8e7a13b53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f0ef7891fc440b09c2f76ff24325142)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:20.908377 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b3c8e-93f8-4dc1-9aff-79b8e7a13b53 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:20.919432 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 839/1691] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:50:20 2022] POST /identity/v3/users => generated 287 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:20.927439 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa370b-822b-46ab-99cd-56897ad99a63 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:20.951719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa370b-822b-46ab-99cd-56897ad99a63 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:20.975961 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7331b21-79c1-406d-b2d5-c4b1d2e21541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:20.976103 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7331b21-79c1-406d-b2d5-c4b1d2e21541 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:20.976611 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7331b21-79c1-406d-b2d5-c4b1d2e21541 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:20.979876 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7331b21-79c1-406d-b2d5-c4b1d2e21541 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:20.981955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7331b21-79c1-406d-b2d5-c4b1d2e21541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:20.985501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7331b21-79c1-406d-b2d5-c4b1d2e21541 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:21.009783 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:21.012761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 840/1692] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:21.013974 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7331b21-79c1-406d-b2d5-c4b1d2e21541 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:21.039000 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7331b21-79c1-406d-b2d5-c4b1d2e21541 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:21.053407 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b600fa8-f70f-4fed-be87-22db37964092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:21.055591 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b600fa8-f70f-4fed-be87-22db37964092 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:21.055591 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b600fa8-f70f-4fed-be87-22db37964092 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:21.057551 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b600fa8-f70f-4fed-be87-22db37964092 admin admin] PATH_INFO: `/v3/projects/8df973a6570d4f85b0286b0748a48ccf/users/24887858321641f691c072e7256a2c61/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:21.105357 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b600fa8-f70f-4fed-be87-22db37964092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df973a6570d4f85b0286b0748a48ccf, user_id=24887858321641f691c072e7256a2c61, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:21.113495 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b600fa8-f70f-4fed-be87-22db37964092 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:21.134862 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-062b3c8e-93f8-4dc1-9aff-79b8e7a13b53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f0ef7891fc440b09c2f76ff24325142', 'request_id': 'req-062b3c8e-93f8-4dc1-9aff-79b8e7a13b53'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:21.146223 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-062b3c8e-93f8-4dc1-9aff-79b8e7a13b53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f0ef7891fc440b09c2f76ff24325142', 'request_id': 'req-062b3c8e-93f8-4dc1-9aff-79b8e7a13b53'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:21.161427 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-062b3c8e-93f8-4dc1-9aff-79b8e7a13b53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f0ef7891fc440b09c2f76ff24325142', 'request_id': 'req-062b3c8e-93f8-4dc1-9aff-79b8e7a13b53'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:21.293313 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 841/1693] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:21 2022] PUT /identity/v3/projects/8df973a6570d4f85b0286b0748a48ccf/users/24887858321641f691c072e7256a2c61/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:21.296890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b600fa8-f70f-4fed-be87-22db37964092 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:21.324417 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-062b3c8e-93f8-4dc1-9aff-79b8e7a13b53 admin admin] The token cache is being invalidate because project 3f0ef7891fc440b09c2f76ff24325142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:50:21.326483 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-062b3c8e-93f8-4dc1-9aff-79b8e7a13b53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:21.326483 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-062b3c8e-93f8-4dc1-9aff-79b8e7a13b53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:21.328381 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 853/1694] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:50:20 2022] DELETE /identity/v3/projects/3f0ef7891fc440b09c2f76ff24325142 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:21.329485 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955304d-15a6-474d-8245-eb7f072d96f0 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:21.329780 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955304d-15a6-474d-8245-eb7f072d96f0 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:21.330062 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955304d-15a6-474d-8245-eb7f072d96f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:21.390837 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-6955304d-15a6-474d-8245-eb7f072d96f0 None None] MFA Rules not processed for user `e416de38c3354372909e3f13678e5b54`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:21.393235 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-6955304d-15a6-474d-8245-eb7f072d96f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:21.424806 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b600fa8-f70f-4fed-be87-22db37964092 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:21.434456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b54cd-ead7-4ea7-8a6b-141476a2643e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:21.436200 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b54cd-ead7-4ea7-8a6b-141476a2643e admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:21.436621 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b54cd-ead7-4ea7-8a6b-141476a2643e admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:21.436756 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b54cd-ead7-4ea7-8a6b-141476a2643e admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:21.437514 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b54cd-ead7-4ea7-8a6b-141476a2643e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:21.441438 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b54cd-ead7-4ea7-8a6b-141476a2643e admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:21.465715 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 842/1695] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:50:21.473529 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cae324-00fa-4a5b-8da5-1c85f0d245e4 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:21.473829 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cae324-00fa-4a5b-8da5-1c85f0d245e4 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:21.474116 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cae324-00fa-4a5b-8da5-1c85f0d245e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:21.520255 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-96cae324-00fa-4a5b-8da5-1c85f0d245e4 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:21.523711 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-96cae324-00fa-4a5b-8da5-1c85f0d245e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:21.543413 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 854/1696] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:21.545784 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 843/1697] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:21.547316 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360713d-5672-4ac9-8a11-a8e3dfac6ab7 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:21.548356 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cae324-00fa-4a5b-8da5-1c85f0d245e4 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:21.548799 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360713d-5672-4ac9-8a11-a8e3dfac6ab7 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:21.549689 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360713d-5672-4ac9-8a11-a8e3dfac6ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:21.554178 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-96cae324-00fa-4a5b-8da5-1c85f0d245e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:21.581720 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cae324-00fa-4a5b-8da5-1c85f0d245e4 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:21.595721 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb79c4-9c50-459c-8c49-e416c00ec37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:21.596875 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb79c4-9c50-459c-8c49-e416c00ec37b admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:21.597168 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb79c4-9c50-459c-8c49-e416c00ec37b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:21.597454 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb79c4-9c50-459c-8c49-e416c00ec37b admin admin] PATH_INFO: `/v3/projects/8df973a6570d4f85b0286b0748a48ccf/users/24887858321641f691c072e7256a2c61/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:21.604939 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb79c4-9c50-459c-8c49-e416c00ec37b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df973a6570d4f85b0286b0748a48ccf, user_id=24887858321641f691c072e7256a2c61, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:21.612816 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb79c4-9c50-459c-8c49-e416c00ec37b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:21.620534 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-6360713d-5672-4ac9-8a11-a8e3dfac6ab7 None None] MFA Rules not processed for user `3c510b9d94bc48e6a0bd5cd1fa9d1706`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:21.621958 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-6360713d-5672-4ac9-8a11-a8e3dfac6ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:21.663504 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 844/1698] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:21 2022] PUT /identity/v3/projects/8df973a6570d4f85b0286b0748a48ccf/users/24887858321641f691c072e7256a2c61/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:21.667230 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce45560-b14b-41b8-8243-ad4ed24ca80d None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:21.667437 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce45560-b14b-41b8-8243-ad4ed24ca80d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:21.668782 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce45560-b14b-41b8-8243-ad4ed24ca80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:21.715722 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-3ce45560-b14b-41b8-8243-ad4ed24ca80d None None] MFA Rules not processed for user `e416de38c3354372909e3f13678e5b54`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:21.716975 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-3ce45560-b14b-41b8-8243-ad4ed24ca80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:21.811546 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 855/1699] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:21.811546 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7aef11-e205-4125-aeae-391d8d7f08d4 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:21.811546 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7aef11-e205-4125-aeae-391d8d7f08d4 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:21.811546 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7aef11-e205-4125-aeae-391d8d7f08d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:21.854161 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 845/1700] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:21.858296 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4814c03-f7d3-4af5-9095-09cfd4e1e658 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:21.858762 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4814c03-f7d3-4af5-9095-09cfd4e1e658 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:21.859054 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4814c03-f7d3-4af5-9095-09cfd4e1e658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:21.861158 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-ee7aef11-e205-4125-aeae-391d8d7f08d4 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:21.865915 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-ee7aef11-e205-4125-aeae-391d8d7f08d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:21.983859 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-c4814c03-f7d3-4af5-9095-09cfd4e1e658 None None] MFA Rules not processed for user `24887858321641f691c072e7256a2c61`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:21.994456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c4814c03-f7d3-4af5-9095-09cfd4e1e658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:22.168418 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 846/1701] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:21 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:22.171802 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27875ceb-56b3-46e3-b2ca-0ae608768789 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:22.172104 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27875ceb-56b3-46e3-b2ca-0ae608768789 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:22.172414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27875ceb-56b3-46e3-b2ca-0ae608768789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:22.184177 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 856/1702] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:22.188032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7aef11-e205-4125-aeae-391d8d7f08d4 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:22.192101 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-ee7aef11-e205-4125-aeae-391d8d7f08d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:22.236571 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-27875ceb-56b3-46e3-b2ca-0ae608768789 None None] MFA Rules not processed for user `3c510b9d94bc48e6a0bd5cd1fa9d1706`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:22.244937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-27875ceb-56b3-46e3-b2ca-0ae608768789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:22.470280 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:22.482205 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 847/1703] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:22.485064 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27875ceb-56b3-46e3-b2ca-0ae608768789 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:22.529426 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7aef11-e205-4125-aeae-391d8d7f08d4 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:22.533250 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27875ceb-56b3-46e3-b2ca-0ae608768789 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:22.561679 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e1f3e-0997-44e5-b16c-d6f95f564128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:22.561980 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ad946-9373-48d7-9a83-7307b6139ce7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:22.563732 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ad946-9373-48d7-9a83-7307b6139ce7 service nova] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:22.564456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e1f3e-0997-44e5-b16c-d6f95f564128 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:22.565036 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e1f3e-0997-44e5-b16c-d6f95f564128 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:22.565537 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ad946-9373-48d7-9a83-7307b6139ce7 service nova] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:22.566108 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ad946-9373-48d7-9a83-7307b6139ce7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:22.566555 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e1f3e-0997-44e5-b16c-d6f95f564128 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:22.571437 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e1f3e-0997-44e5-b16c-d6f95f564128 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:50:22.571437 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e1f3e-0997-44e5-b16c-d6f95f564128 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:22.571437 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e1f3e-0997-44e5-b16c-d6f95f564128 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:22.587887 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ad946-9373-48d7-9a83-7307b6139ce7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:22.589969 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ad946-9373-48d7-9a83-7307b6139ce7 service nova] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:22.608523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 848/1704] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:50:22.610928 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e1f3e-0997-44e5-b16c-d6f95f564128 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:22.617908 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-653e1f3e-0997-44e5-b16c-d6f95f564128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:22.623235 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 857/1705] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:22.625430 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ad946-9373-48d7-9a83-7307b6139ce7 service nova] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:22.630131 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-684ad946-9373-48d7-9a83-7307b6139ce7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:22.637366 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:22.664580 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ad946-9373-48d7-9a83-7307b6139ce7 service nova] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:22.690368 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceddf83-5967-4bc0-b229-712cbf1231ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:22.691073 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceddf83-5967-4bc0-b229-712cbf1231ba service nova] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:22.692179 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceddf83-5967-4bc0-b229-712cbf1231ba service nova] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:22.695801 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceddf83-5967-4bc0-b229-712cbf1231ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:22.722413 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceddf83-5967-4bc0-b229-712cbf1231ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:22.727993 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceddf83-5967-4bc0-b229-712cbf1231ba service nova] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:22.761955 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 858/1706] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:22.765553 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceddf83-5967-4bc0-b229-712cbf1231ba service nova] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:22.805028 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceddf83-5967-4bc0-b229-712cbf1231ba service nova] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:22.855187 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f2882-941f-4a06-86c8-ecbd01b5497c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:22.870083 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f2882-941f-4a06-86c8-ecbd01b5497c admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:22.872182 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f2882-941f-4a06-86c8-ecbd01b5497c admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:22.872915 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f2882-941f-4a06-86c8-ecbd01b5497c admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:22.888245 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f2882-941f-4a06-86c8-ecbd01b5497c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:22.896869 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e1f3e-0997-44e5-b16c-d6f95f564128 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:22.903814 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f2882-941f-4a06-86c8-ecbd01b5497c admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:22.918499 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a260a-2435-44bb-a6cb-bbfd439cd385 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:22.919178 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a260a-2435-44bb-a6cb-bbfd439cd385 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:22.919472 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a260a-2435-44bb-a6cb-bbfd439cd385 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:22.919847 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a260a-2435-44bb-a6cb-bbfd439cd385 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:22.952841 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a260a-2435-44bb-a6cb-bbfd439cd385 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:22.954424 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a260a-2435-44bb-a6cb-bbfd439cd385 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:22.994766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 849/1707] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:22 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:23.129086 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 859/1708] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:50:22 2022] POST /identity/v3/projects => generated 407 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:23.131434 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a260a-2435-44bb-a6cb-bbfd439cd385 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:23.165301 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a260a-2435-44bb-a6cb-bbfd439cd385 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:23.338120 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f2882-941f-4a06-86c8-ecbd01b5497c admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:23.386209 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b956c41-1517-4477-acbc-a8f1c43b0d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:23.387920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b956c41-1517-4477-acbc-a8f1c43b0d48 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:23.392456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b956c41-1517-4477-acbc-a8f1c43b0d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:23.392456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b956c41-1517-4477-acbc-a8f1c43b0d48 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:23.393197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b956c41-1517-4477-acbc-a8f1c43b0d48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:23.401755 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b956c41-1517-4477-acbc-a8f1c43b0d48 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:23.508270 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 850/1709] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:50:23 2022] POST /identity/v3/users => generated 304 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:23.508270 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05178a-7825-40f1-8e5d-b0423b58b6c6 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:23.508270 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05178a-7825-40f1-8e5d-b0423b58b6c6 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:23.509451 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05178a-7825-40f1-8e5d-b0423b58b6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:23.566271 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f2882-941f-4a06-86c8-ecbd01b5497c admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:23.574503 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315a840-10f0-4e98-a433-0b11b95430a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:23.578639 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315a840-10f0-4e98-a433-0b11b95430a0 service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:23.579467 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315a840-10f0-4e98-a433-0b11b95430a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:23.581017 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315a840-10f0-4e98-a433-0b11b95430a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:23.611909 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-6315a840-10f0-4e98-a433-0b11b95430a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:23.612896 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-4b05178a-7825-40f1-8e5d-b0423b58b6c6 None None] MFA Rules not processed for user `c8fac29036de4afbb8c1b64862e829b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:23.614588 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4b05178a-7825-40f1-8e5d-b0423b58b6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:23.624508 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:23.774615 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315a840-10f0-4e98-a433-0b11b95430a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:23.776374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315a840-10f0-4e98-a433-0b11b95430a0 service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:23.776818 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 851/1710] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:23.777731 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05178a-7825-40f1-8e5d-b0423b58b6c6 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:23.804561 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05178a-7825-40f1-8e5d-b0423b58b6c6 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:23.817744 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fc6d8-d9cc-4dc9-a322-178410022331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:23.818528 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fc6d8-d9cc-4dc9-a322-178410022331 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:23.818887 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fc6d8-d9cc-4dc9-a322-178410022331 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:23.819238 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fc6d8-d9cc-4dc9-a322-178410022331 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:23.820067 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fc6d8-d9cc-4dc9-a322-178410022331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:23.825301 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fc6d8-d9cc-4dc9-a322-178410022331 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:23.827979 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 860/1711] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:23 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:23.836934 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:23.858802 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 852/1712] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:23.860524 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315a840-10f0-4e98-a433-0b11b95430a0 service cinder] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:23.876350 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf55fb-e7c4-4e4e-b87b-6292580ac108 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:23.882719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf55fb-e7c4-4e4e-b87b-6292580ac108 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:23.882719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf55fb-e7c4-4e4e-b87b-6292580ac108 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:23.882719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 853/1713] 10.222.0.18 () {54 vars in 912 bytes} [Mon Jul 25 08:50:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:50:23.888908 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315a840-10f0-4e98-a433-0b11b95430a0 service cinder] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:23.894793 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd24b20-2c43-4f91-b29c-b23d068471d0 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:23.895168 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd24b20-2c43-4f91-b29c-b23d068471d0 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:23.895515 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd24b20-2c43-4f91-b29c-b23d068471d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:23.911526 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee810e37-15da-445b-8033-7a304f52c6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:23.911526 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee810e37-15da-445b-8033-7a304f52c6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:23.911526 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee810e37-15da-445b-8033-7a304f52c6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:23.911526 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee810e37-15da-445b-8033-7a304f52c6f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:23.911866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee810e37-15da-445b-8033-7a304f52c6f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:23.914241 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee810e37-15da-445b-8033-7a304f52c6f7 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:23.942939 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 861/1714] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:23.945149 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee810e37-15da-445b-8033-7a304f52c6f7 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:23.958752 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:23.963830 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee810e37-15da-445b-8033-7a304f52c6f7 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:23.971193 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068eead-746d-46a5-84a1-c8b648ac45ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:23.973096 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068eead-746d-46a5-84a1-c8b648ac45ca admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:23.973717 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068eead-746d-46a5-84a1-c8b648ac45ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:23.974238 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068eead-746d-46a5-84a1-c8b648ac45ca admin admin] PATH_INFO: `/v3/projects/95efeacd42ec4ad5ad7b7bbd326fdddd/users/9e1503a13df24396a275d306433c7e7f/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:24.013268 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068eead-746d-46a5-84a1-c8b648ac45ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=95efeacd42ec4ad5ad7b7bbd326fdddd, user_id=9e1503a13df24396a275d306433c7e7f, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:24.016429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068eead-746d-46a5-84a1-c8b648ac45ca admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:24.034385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-cdd24b20-2c43-4f91-b29c-b23d068471d0 None None] MFA Rules not processed for user `a08bd52110074f11ba56b2f02397062f`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:24.035580 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-cdd24b20-2c43-4f91-b29c-b23d068471d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:24.158206 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 854/1715] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Jul 25 08:50:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:24.163722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 862/1716] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:23 2022] PUT /identity/v3/projects/95efeacd42ec4ad5ad7b7bbd326fdddd/users/9e1503a13df24396a275d306433c7e7f/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:24.177397 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780841f9-8777-4d31-8394-a36ad29827b7 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:24.178699 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780841f9-8777-4d31-8394-a36ad29827b7 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:24.179138 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780841f9-8777-4d31-8394-a36ad29827b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:24.190293 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd24b20-2c43-4f91-b29c-b23d068471d0 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:24.193212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-cdd24b20-2c43-4f91-b29c-b23d068471d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:24.212518 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd24b20-2c43-4f91-b29c-b23d068471d0 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:24.218318 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-780841f9-8777-4d31-8394-a36ad29827b7 None None] MFA Rules not processed for user `9e1503a13df24396a275d306433c7e7f`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:24.219928 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-780841f9-8777-4d31-8394-a36ad29827b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:24.330148 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 863/1717] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:24 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:24.330148 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceef9d0-9317-4214-9f79-fe2102845615 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:24.330148 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceef9d0-9317-4214-9f79-fe2102845615 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:24.330148 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceef9d0-9317-4214-9f79-fe2102845615 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:24.332235 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4afcb0-61fb-4ab1-b2e4-241a4ae17242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:24.333085 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4afcb0-61fb-4ab1-b2e4-241a4ae17242 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:24.333478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4afcb0-61fb-4ab1-b2e4-241a4ae17242 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:24.333884 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4afcb0-61fb-4ab1-b2e4-241a4ae17242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:24.336172 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 864/1718] 10.222.0.18 () {54 vars in 912 bytes} [Mon Jul 25 08:50:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:50:24.337227 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceef9d0-9317-4214-9f79-fe2102845615 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:24.345261 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4afcb0-61fb-4ab1-b2e4-241a4ae17242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:24.348560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4afcb0-61fb-4ab1-b2e4-241a4ae17242 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:24.380599 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 855/1719] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:24.382107 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c447d-31a5-424b-85be-d8682d910459 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:24.382451 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c447d-31a5-424b-85be-d8682d910459 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:24.395800 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c447d-31a5-424b-85be-d8682d910459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:24.403579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:24.486202 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-ad3c447d-31a5-424b-85be-d8682d910459 None None] MFA Rules not processed for user `a08bd52110074f11ba56b2f02397062f`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:24.496541 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-ad3c447d-31a5-424b-85be-d8682d910459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:24.524140 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 856/1720] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Jul 25 08:50:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:24.556635 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c447d-31a5-424b-85be-d8682d910459 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:24.558135 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-ad3c447d-31a5-424b-85be-d8682d910459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:24.580696 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c447d-31a5-424b-85be-d8682d910459 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:24.594586 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceef9d0-9317-4214-9f79-fe2102845615 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:24.605371 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4407fbf-a12d-4615-b517-0b22ac25bc3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:24.606331 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4407fbf-a12d-4615-b517-0b22ac25bc3a service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:24.606331 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4407fbf-a12d-4615-b517-0b22ac25bc3a service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:24.606634 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4407fbf-a12d-4615-b517-0b22ac25bc3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:24.608454 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7322c-f7de-432d-9e5b-8e33d66e53c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:24.610905 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7322c-f7de-432d-9e5b-8e33d66e53c1 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:24.614962 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7322c-f7de-432d-9e5b-8e33d66e53c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:24.615510 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7322c-f7de-432d-9e5b-8e33d66e53c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:24.617373 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4407fbf-a12d-4615-b517-0b22ac25bc3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:24.618198 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7322c-f7de-432d-9e5b-8e33d66e53c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:24.619702 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4407fbf-a12d-4615-b517-0b22ac25bc3a service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:24.630426 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7322c-f7de-432d-9e5b-8e33d66e53c1 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:24.634927 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 857/1721] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:50:24.778435 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 865/1722] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:50:24 2022] POST /identity/v3/projects => generated 409 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:24.782927 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4407fbf-a12d-4615-b517-0b22ac25bc3a service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:24.803485 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4407fbf-a12d-4615-b517-0b22ac25bc3a service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:24.905711 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293282b-0863-4cf7-90a4-986017b27126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:24.912112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293282b-0863-4cf7-90a4-986017b27126 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:24.912112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293282b-0863-4cf7-90a4-986017b27126 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:24.912112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293282b-0863-4cf7-90a4-986017b27126 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:24.912112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293282b-0863-4cf7-90a4-986017b27126 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:24.912112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293282b-0863-4cf7-90a4-986017b27126 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:25.006799 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 858/1723] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:50:24 2022] POST /identity/v3/users => generated 311 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:25.008459 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7322c-f7de-432d-9e5b-8e33d66e53c1 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:25.041285 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7322c-f7de-432d-9e5b-8e33d66e53c1 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:25.080537 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6b539-daa8-444e-bb0c-04b6a2e8c93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:25.081242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6b539-daa8-444e-bb0c-04b6a2e8c93a admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:25.082676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6b539-daa8-444e-bb0c-04b6a2e8c93a admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:25.082964 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6b539-daa8-444e-bb0c-04b6a2e8c93a admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:25.087716 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6b539-daa8-444e-bb0c-04b6a2e8c93a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:25.089649 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6b539-daa8-444e-bb0c-04b6a2e8c93a admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:25.104547 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 866/1724] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:25.109071 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293282b-0863-4cf7-90a4-986017b27126 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:25.126487 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293282b-0863-4cf7-90a4-986017b27126 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:25.132486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028c4fe-9fca-4271-9ded-b51bc2dbf673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:25.135529 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028c4fe-9fca-4271-9ded-b51bc2dbf673 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:25.140484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028c4fe-9fca-4271-9ded-b51bc2dbf673 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:25.140484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028c4fe-9fca-4271-9ded-b51bc2dbf673 admin admin] PATH_INFO: `/v3/projects/a0d75dcef57d4917b3a335c279962ed2/users/87e33958a86e4a3395295918f68fcd97/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:25.165228 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028c4fe-9fca-4271-9ded-b51bc2dbf673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0d75dcef57d4917b3a335c279962ed2, user_id=87e33958a86e4a3395295918f68fcd97, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:25.170582 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028c4fe-9fca-4271-9ded-b51bc2dbf673 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:25.223630 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13d49c-0f9c-4fac-b0e8-5d5baf4484fb None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:25.223936 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13d49c-0f9c-4fac-b0e8-5d5baf4484fb None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:25.224221 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13d49c-0f9c-4fac-b0e8-5d5baf4484fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:25.242337 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:25.277323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 859/1725] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:25 2022] PUT /identity/v3/projects/a0d75dcef57d4917b3a335c279962ed2/users/87e33958a86e4a3395295918f68fcd97/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:25.281093 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028c4fe-9fca-4271-9ded-b51bc2dbf673 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:25.306778 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-7b13d49c-0f9c-4fac-b0e8-5d5baf4484fb None None] MFA Rules not processed for user `f67af2f4a93543c5bbd1703a6764867b`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:25.308219 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-7b13d49c-0f9c-4fac-b0e8-5d5baf4484fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:25.472704 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 867/1726] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:50:25.480307 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028c4fe-9fca-4271-9ded-b51bc2dbf673 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:25.482189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13d49c-0f9c-4fac-b0e8-5d5baf4484fb None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:25.487052 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae2130-509e-4af0-8bec-d9f2ee3e1f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:25.487957 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae2130-509e-4af0-8bec-d9f2ee3e1f2e admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:25.488359 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae2130-509e-4af0-8bec-d9f2ee3e1f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:25.488811 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae2130-509e-4af0-8bec-d9f2ee3e1f2e admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:25.489720 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae2130-509e-4af0-8bec-d9f2ee3e1f2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:25.491690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae2130-509e-4af0-8bec-d9f2ee3e1f2e admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:25.525570 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 860/1727] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:50:25.528124 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e7789-4f5e-425d-b0bf-28afd490364d None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:25.528645 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e7789-4f5e-425d-b0bf-28afd490364d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:25.529136 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e7789-4f5e-425d-b0bf-28afd490364d None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:25.531134 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 861/1728] 10.222.0.18 () {54 vars in 961 bytes} [Mon Jul 25 08:50:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:50:25.532460 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e7789-4f5e-425d-b0bf-28afd490364d None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:25.558601 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e7789-4f5e-425d-b0bf-28afd490364d None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:25.582441 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0a926-1db4-4275-b185-71a5e8ff9c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:25.583658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0a926-1db4-4275-b185-71a5e8ff9c25 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:25.584179 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0a926-1db4-4275-b185-71a5e8ff9c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:25.585796 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0a926-1db4-4275-b185-71a5e8ff9c25 admin admin] PATH_INFO: `/v3/projects/a0d75dcef57d4917b3a335c279962ed2/users/87e33958a86e4a3395295918f68fcd97/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:25.603646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0a926-1db4-4275-b185-71a5e8ff9c25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0d75dcef57d4917b3a335c279962ed2, user_id=87e33958a86e4a3395295918f68fcd97, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:25.606747 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0a926-1db4-4275-b185-71a5e8ff9c25 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:25.664210 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 862/1729] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:25 2022] PUT /identity/v3/projects/a0d75dcef57d4917b3a335c279962ed2/users/87e33958a86e4a3395295918f68fcd97/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:25.666308 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01aa8a-aa04-4e03-9367-7e8be150c296 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:25.666308 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01aa8a-aa04-4e03-9367-7e8be150c296 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:25.666308 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01aa8a-aa04-4e03-9367-7e8be150c296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:25.700082 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13d49c-0f9c-4fac-b0e8-5d5baf4484fb None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:25.724409 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-de01aa8a-aa04-4e03-9367-7e8be150c296 None None] MFA Rules not processed for user `dfb4be75496444dd897b880c2ac3e67e`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:25.732357 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-de01aa8a-aa04-4e03-9367-7e8be150c296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:25.737981 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:25.871414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 863/1730] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Jul 25 08:50:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:25.872678 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd77eee-0d6d-40fd-a657-75b57eb33ebf None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:25.873068 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd77eee-0d6d-40fd-a657-75b57eb33ebf None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:25.873608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd77eee-0d6d-40fd-a657-75b57eb33ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:25.906061 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d91fb8-c485-4837-a312-f2a7308640ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:25.907159 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d91fb8-c485-4837-a312-f2a7308640ed service nova] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:25.907431 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d91fb8-c485-4837-a312-f2a7308640ed service nova] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:25.907910 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d91fb8-c485-4837-a312-f2a7308640ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:25.922564 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-5cd77eee-0d6d-40fd-a657-75b57eb33ebf None None] MFA Rules not processed for user `87e33958a86e4a3395295918f68fcd97`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:25.924081 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-5cd77eee-0d6d-40fd-a657-75b57eb33ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:25.961733 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:26.012530 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d91fb8-c485-4837-a312-f2a7308640ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:26.014689 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d91fb8-c485-4837-a312-f2a7308640ed service nova] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:26.033562 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 868/1731] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:26.033562 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d91fb8-c485-4837-a312-f2a7308640ed service nova] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:26.033562 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-26d91fb8-c485-4837-a312-f2a7308640ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:26.056899 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d91fb8-c485-4837-a312-f2a7308640ed service nova] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:26.074527 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 864/1732] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:25 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:26.081021 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18c7aa-23f2-40f5-a08b-fded24d7eade None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:26.081332 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18c7aa-23f2-40f5-a08b-fded24d7eade None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:26.081618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18c7aa-23f2-40f5-a08b-fded24d7eade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:26.088527 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7f1ac-0081-45bd-ab9f-6a72c63c4283 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfb4be75496444dd897b880c2ac3e67e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:26.089513 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7f1ac-0081-45bd-ab9f-6a72c63c4283 service placement] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:26.090099 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7f1ac-0081-45bd-ab9f-6a72c63c4283 service placement] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:26.091101 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7f1ac-0081-45bd-ab9f-6a72c63c4283 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:26.094159 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-6ce7f1ac-0081-45bd-ab9f-6a72c63c4283 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:26.110552 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-bf18c7aa-23f2-40f5-a08b-fded24d7eade None None] MFA Rules not processed for user `e416de38c3354372909e3f13678e5b54`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:26.113430 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-bf18c7aa-23f2-40f5-a08b-fded24d7eade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:26.122414 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7f1ac-0081-45bd-ab9f-6a72c63c4283 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:26.124252 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7f1ac-0081-45bd-ab9f-6a72c63c4283 service placement] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:26.137010 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 869/1733] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:26.138137 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7f1ac-0081-45bd-ab9f-6a72c63c4283 service placement] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:26.154043 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7f1ac-0081-45bd-ab9f-6a72c63c4283 service placement] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:26.172559 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe699cff-3b8b-41f5-96e1-78419dfe728e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfb4be75496444dd897b880c2ac3e67e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:26.175219 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe699cff-3b8b-41f5-96e1-78419dfe728e service placement] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:26.175596 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe699cff-3b8b-41f5-96e1-78419dfe728e service placement] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:26.178775 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe699cff-3b8b-41f5-96e1-78419dfe728e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:26.221739 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe699cff-3b8b-41f5-96e1-78419dfe728e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:26.223373 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe699cff-3b8b-41f5-96e1-78419dfe728e service placement] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:26.238504 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 870/1734] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:26.248929 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe699cff-3b8b-41f5-96e1-78419dfe728e service placement] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:26.284542 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe699cff-3b8b-41f5-96e1-78419dfe728e service placement] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:26.288805 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 865/1735] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:26.289966 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18c7aa-23f2-40f5-a08b-fded24d7eade None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:26.293436 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ef784-c740-4c74-8dc2-1200c469d022 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:26.294052 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ef784-c740-4c74-8dc2-1200c469d022 service nova] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:26.318527 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ef784-c740-4c74-8dc2-1200c469d022 service nova] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:26.318527 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ef784-c740-4c74-8dc2-1200c469d022 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:26.433159 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:26.477908 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18c7aa-23f2-40f5-a08b-fded24d7eade None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:26.492888 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959c753-d8f5-4646-b790-b367f95fc1b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:26.496904 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959c753-d8f5-4646-b790-b367f95fc1b2 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:26.501500 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959c753-d8f5-4646-b790-b367f95fc1b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:26.503301 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959c753-d8f5-4646-b790-b367f95fc1b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:26.530956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959c753-d8f5-4646-b790-b367f95fc1b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:26.536924 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959c753-d8f5-4646-b790-b367f95fc1b2 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:26.546592 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ef784-c740-4c74-8dc2-1200c469d022 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:26.548219 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ef784-c740-4c74-8dc2-1200c469d022 service nova] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:26.592368 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 871/1736] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:26.631119 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 866/1737] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:26 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:27.469422 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ef784-c740-4c74-8dc2-1200c469d022 service nova] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:27.490668 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ef784-c740-4c74-8dc2-1200c469d022 service nova] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:27.498831 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf4fb4-65a6-4e4d-aa48-e25b8ebb7d16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:27.504391 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf4fb4-65a6-4e4d-aa48-e25b8ebb7d16 service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:27.506610 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf4fb4-65a6-4e4d-aa48-e25b8ebb7d16 service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:27.507597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf4fb4-65a6-4e4d-aa48-e25b8ebb7d16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:27.667828 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf4fb4-65a6-4e4d-aa48-e25b8ebb7d16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:27.669836 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf4fb4-65a6-4e4d-aa48-e25b8ebb7d16 service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:27.685110 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 872/1738] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:27 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:30.536260 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959c753-d8f5-4646-b790-b367f95fc1b2 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:30.539226 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4959c753-d8f5-4646-b790-b367f95fc1b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:30.724938 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959c753-d8f5-4646-b790-b367f95fc1b2 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:30.730772 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6d1cf-ae8f-4163-8560-a6d1d4208e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:30.731893 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6d1cf-ae8f-4163-8560-a6d1d4208e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:30.732181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6d1cf-ae8f-4163-8560-a6d1d4208e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:30.732707 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6d1cf-ae8f-4163-8560-a6d1d4208e6d admin admin] PATH_INFO: `/v3/users/7f29a7f15ddc4ebfb399260ecbfc4600` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:30.745392 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6d1cf-ae8f-4163-8560-a6d1d4208e6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f29a7f15ddc4ebfb399260ecbfc4600)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:30.749752 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6d1cf-ae8f-4163-8560-a6d1d4208e6d admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:31.092564 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-01f6d1cf-ae8f-4163-8560-a6d1d4208e6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f29a7f15ddc4ebfb399260ecbfc4600'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:31.095178 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-01f6d1cf-ae8f-4163-8560-a6d1d4208e6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f29a7f15ddc4ebfb399260ecbfc4600'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:31.112356 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-01f6d1cf-ae8f-4163-8560-a6d1d4208e6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f29a7f15ddc4ebfb399260ecbfc4600'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:31.115445 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-01f6d1cf-ae8f-4163-8560-a6d1d4208e6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f29a7f15ddc4ebfb399260ecbfc4600'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:31.179643 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc52a9-2bea-48fa-b92d-94b2b97be2de None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:31.180201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc52a9-2bea-48fa-b92d-94b2b97be2de None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:31.180201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc52a9-2bea-48fa-b92d-94b2b97be2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:31.195070 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-01f6d1cf-ae8f-4163-8560-a6d1d4208e6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f29a7f15ddc4ebfb399260ecbfc4600'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:31.214890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-3edc52a9-2bea-48fa-b92d-94b2b97be2de None None] MFA Rules not processed for user `c8fac29036de4afbb8c1b64862e829b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:31.217040 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-3edc52a9-2bea-48fa-b92d-94b2b97be2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:31.239058 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 867/1739] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:50:30 2022] DELETE /identity/v3/users/7f29a7f15ddc4ebfb399260ecbfc4600 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:31.240706 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d1d63-b9c1-48db-8437-7ee042b3f4d2 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:31.244395 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d1d63-b9c1-48db-8437-7ee042b3f4d2 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:31.244395 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d1d63-b9c1-48db-8437-7ee042b3f4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:31.260729 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 873/1740] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:50:31.301725 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-2b1d1d63-b9c1-48db-8437-7ee042b3f4d2 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:31.304092 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-2b1d1d63-b9c1-48db-8437-7ee042b3f4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:31.504196 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 868/1741] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:31.547044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc52a9-2bea-48fa-b92d-94b2b97be2de None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:31.549313 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-3edc52a9-2bea-48fa-b92d-94b2b97be2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:31.623003 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:31.653354 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc52a9-2bea-48fa-b92d-94b2b97be2de None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:31.771757 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429b54b-527e-4ac9-99fe-5afa40adaf1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:31.773306 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429b54b-527e-4ac9-99fe-5afa40adaf1c service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:31.773306 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429b54b-527e-4ac9-99fe-5afa40adaf1c service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:31.773306 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429b54b-527e-4ac9-99fe-5afa40adaf1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:31.790618 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429b54b-527e-4ac9-99fe-5afa40adaf1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:31.794272 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429b54b-527e-4ac9-99fe-5afa40adaf1c service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:31.837590 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 874/1742] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:32.202759 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3006f2-d1ec-41c4-b2d5-c2df73fde54d None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:32.203346 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3006f2-d1ec-41c4-b2d5-c2df73fde54d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:32.203514 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3006f2-d1ec-41c4-b2d5-c2df73fde54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:32.213369 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:32.241613 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-1e3006f2-d1ec-41c4-b2d5-c2df73fde54d None None] MFA Rules not processed for user `f67af2f4a93543c5bbd1703a6764867b`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:32.243015 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-1e3006f2-d1ec-41c4-b2d5-c2df73fde54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:32.383661 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 869/1743] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:32.681105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429b54b-527e-4ac9-99fe-5afa40adaf1c service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:32.681105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-f429b54b-527e-4ac9-99fe-5afa40adaf1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:32.703886 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429b54b-527e-4ac9-99fe-5afa40adaf1c service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:32.717539 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3719c2-985e-442b-824c-7f655f565abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:32.719478 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3719c2-985e-442b-824c-7f655f565abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:32.719989 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3719c2-985e-442b-824c-7f655f565abf admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:32.720672 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3719c2-985e-442b-824c-7f655f565abf admin admin] PATH_INFO: `/v3/projects/74b4e0581e754c7484c72545abeb27dd` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:32.723408 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3719c2-985e-442b-824c-7f655f565abf admin admin] RBAC: Authorizing `identity:delete_project(project_id=74b4e0581e754c7484c72545abeb27dd)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:32.733163 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3719c2-985e-442b-824c-7f655f565abf admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:32.861039 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-3e3719c2-985e-442b-824c-7f655f565abf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74b4e0581e754c7484c72545abeb27dd', 'request_id': 'req-3e3719c2-985e-442b-824c-7f655f565abf'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:32.868175 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-3e3719c2-985e-442b-824c-7f655f565abf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74b4e0581e754c7484c72545abeb27dd', 'request_id': 'req-3e3719c2-985e-442b-824c-7f655f565abf'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:32.875934 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-3e3719c2-985e-442b-824c-7f655f565abf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74b4e0581e754c7484c72545abeb27dd', 'request_id': 'req-3e3719c2-985e-442b-824c-7f655f565abf'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:32.972313 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-3e3719c2-985e-442b-824c-7f655f565abf admin admin] The token cache is being invalidate because project 74b4e0581e754c7484c72545abeb27dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:50:32.972654 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-3e3719c2-985e-442b-824c-7f655f565abf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:32.974219 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-3e3719c2-985e-442b-824c-7f655f565abf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:32.976249 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 875/1744] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:50:32 2022] DELETE /identity/v3/projects/74b4e0581e754c7484c72545abeb27dd => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:32.981153 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57670ba-ed1b-43b0-b9b7-f619878811e4 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:32.981882 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57670ba-ed1b-43b0-b9b7-f619878811e4 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:32.982330 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57670ba-ed1b-43b0-b9b7-f619878811e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:33.014079 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-b57670ba-ed1b-43b0-b9b7-f619878811e4 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:33.015454 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b57670ba-ed1b-43b0-b9b7-f619878811e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:33.106458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 870/1745] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:50:33.107889 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c06e3-5486-4f06-be02-cda200124c30 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:33.108184 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c06e3-5486-4f06-be02-cda200124c30 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:33.108467 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c06e3-5486-4f06-be02-cda200124c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:33.128848 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-313c06e3-5486-4f06-be02-cda200124c30 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:33.130213 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-313c06e3-5486-4f06-be02-cda200124c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:33.142704 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 876/1746] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:50:33.143374 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57670ba-ed1b-43b0-b9b7-f619878811e4 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:33.154007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57670ba-ed1b-43b0-b9b7-f619878811e4 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:33.159885 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648bc6c-f874-4510-b929-1415653564c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:33.160565 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648bc6c-f874-4510-b929-1415653564c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:33.168875 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648bc6c-f874-4510-b929-1415653564c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:33.168875 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648bc6c-f874-4510-b929-1415653564c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:33.168875 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4648bc6c-f874-4510-b929-1415653564c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:50:33.168875 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4648bc6c-f874-4510-b929-1415653564c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:33.168875 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4648bc6c-f874-4510-b929-1415653564c9 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:33.181513 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 871/1747] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:50:33.185535 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c06e3-5486-4f06-be02-cda200124c30 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:33.196862 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c06e3-5486-4f06-be02-cda200124c30 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:33.201956 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc96834-0ce3-4807-aff3-eb766239cb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:33.207324 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc96834-0ce3-4807-aff3-eb766239cb64 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:33.207324 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc96834-0ce3-4807-aff3-eb766239cb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:33.207324 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc96834-0ce3-4807-aff3-eb766239cb64 admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:33.207324 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc96834-0ce3-4807-aff3-eb766239cb64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:33.207324 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc96834-0ce3-4807-aff3-eb766239cb64 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:33.294425 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 877/1748] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:50:33 2022] POST /identity/v3/projects => generated 405 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:50:33.295360 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648bc6c-f874-4510-b929-1415653564c9 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:33.316016 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648bc6c-f874-4510-b929-1415653564c9 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:33.417072 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374d6f5-4ef2-4882-b111-bc6245440670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:33.417805 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374d6f5-4ef2-4882-b111-bc6245440670 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:33.418096 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374d6f5-4ef2-4882-b111-bc6245440670 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:33.419998 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374d6f5-4ef2-4882-b111-bc6245440670 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:33.420296 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374d6f5-4ef2-4882-b111-bc6245440670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:33.422645 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374d6f5-4ef2-4882-b111-bc6245440670 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:33.495889 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 872/1749] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:50:33 2022] POST /identity/v3/users => generated 303 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:33.497701 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc96834-0ce3-4807-aff3-eb766239cb64 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:33.518745 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc96834-0ce3-4807-aff3-eb766239cb64 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:33.541609 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d825952-ad2d-43ca-b5c7-9e0d9f75b5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:33.546500 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d825952-ad2d-43ca-b5c7-9e0d9f75b5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:33.546854 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d825952-ad2d-43ca-b5c7-9e0d9f75b5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:33.547147 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d825952-ad2d-43ca-b5c7-9e0d9f75b5c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:33.547998 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d825952-ad2d-43ca-b5c7-9e0d9f75b5c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:33.563785 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d825952-ad2d-43ca-b5c7-9e0d9f75b5c5 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:33.594923 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 878/1750] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:33.599472 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374d6f5-4ef2-4882-b111-bc6245440670 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:33.622550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374d6f5-4ef2-4882-b111-bc6245440670 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:33.628232 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07691365-6800-4929-a965-9d1b24d35fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:33.629413 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07691365-6800-4929-a965-9d1b24d35fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:33.629706 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07691365-6800-4929-a965-9d1b24d35fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:33.630057 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07691365-6800-4929-a965-9d1b24d35fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:33.630870 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07691365-6800-4929-a965-9d1b24d35fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:33.632647 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07691365-6800-4929-a965-9d1b24d35fc5 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:33.644800 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 873/1751] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:33.649123 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d825952-ad2d-43ca-b5c7-9e0d9f75b5c5 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:33.660116 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d825952-ad2d-43ca-b5c7-9e0d9f75b5c5 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:33.664976 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea11121-dfe6-4851-93a7-534e9f42b32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:33.666671 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea11121-dfe6-4851-93a7-534e9f42b32d admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:33.666959 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea11121-dfe6-4851-93a7-534e9f42b32d admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:33.667767 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea11121-dfe6-4851-93a7-534e9f42b32d admin admin] PATH_INFO: `/v3/projects/bc9a189a2b2143dc90c4573f1da32f1c/users/27127752577f433d9de67dadfe41bc11/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:33.704622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea11121-dfe6-4851-93a7-534e9f42b32d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc9a189a2b2143dc90c4573f1da32f1c, user_id=27127752577f433d9de67dadfe41bc11, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:33.709850 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea11121-dfe6-4851-93a7-534e9f42b32d admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:33.820241 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 879/1752] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:33 2022] PUT /identity/v3/projects/bc9a189a2b2143dc90c4573f1da32f1c/users/27127752577f433d9de67dadfe41bc11/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:50:33.825481 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf12e88-427c-44f7-8a3b-5d82e8374fa3 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:33.825779 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf12e88-427c-44f7-8a3b-5d82e8374fa3 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:33.826076 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf12e88-427c-44f7-8a3b-5d82e8374fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:33.848153 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-bcf12e88-427c-44f7-8a3b-5d82e8374fa3 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:33.849562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-bcf12e88-427c-44f7-8a3b-5d82e8374fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:33.878717 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:33.981563 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 874/1753] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:33.993107 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea11121-dfe6-4851-93a7-534e9f42b32d admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:33.995022 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-5ea11121-dfe6-4851-93a7-534e9f42b32d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:34.016012 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:34.168749 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea11121-dfe6-4851-93a7-534e9f42b32d admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:34.173454 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d9c43-22a8-477e-a536-25df1e9305e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:34.186285 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d9c43-22a8-477e-a536-25df1e9305e3 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:34.192111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d9c43-22a8-477e-a536-25df1e9305e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:34.192111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d9c43-22a8-477e-a536-25df1e9305e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:34.212021 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d9c43-22a8-477e-a536-25df1e9305e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:34.215808 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d9c43-22a8-477e-a536-25df1e9305e3 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:34.230677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 880/1754] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:36.212550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5720f60-9dcd-4991-9604-691e52893601 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:36.213057 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5720f60-9dcd-4991-9604-691e52893601 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:36.213503 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5720f60-9dcd-4991-9604-691e52893601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:36.279017 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-e5720f60-9dcd-4991-9604-691e52893601 None None] MFA Rules not processed for user `27127752577f433d9de67dadfe41bc11`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:36.280560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-e5720f60-9dcd-4991-9604-691e52893601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:36.370255 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 875/1755] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:36 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:36.374658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d9c43-22a8-477e-a536-25df1e9305e3 service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:36.384558 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d9c43-22a8-477e-a536-25df1e9305e3 service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:36.389511 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c7915-3405-4ffa-9e9d-92be8a60fa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:36.390173 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c7915-3405-4ffa-9e9d-92be8a60fa09 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:36.390457 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c7915-3405-4ffa-9e9d-92be8a60fa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:36.390737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c7915-3405-4ffa-9e9d-92be8a60fa09 admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:36.391446 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c7915-3405-4ffa-9e9d-92be8a60fa09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:36.394472 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c7915-3405-4ffa-9e9d-92be8a60fa09 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:36.481794 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 881/1756] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:50:36 2022] POST /identity/v3/projects => generated 405 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:50:36.485758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5720f60-9dcd-4991-9604-691e52893601 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:36.496908 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5720f60-9dcd-4991-9604-691e52893601 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:36.557487 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8be9d3-188b-49bc-942e-1df109c6f1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:36.558176 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8be9d3-188b-49bc-942e-1df109c6f1e3 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:36.558460 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8be9d3-188b-49bc-942e-1df109c6f1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:36.558763 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8be9d3-188b-49bc-942e-1df109c6f1e3 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:36.559457 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8be9d3-188b-49bc-942e-1df109c6f1e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:36.561424 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8be9d3-188b-49bc-942e-1df109c6f1e3 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:36.652713 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 876/1757] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:50:36 2022] POST /identity/v3/users => generated 309 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:36.656198 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c7915-3405-4ffa-9e9d-92be8a60fa09 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:36.667350 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c7915-3405-4ffa-9e9d-92be8a60fa09 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:36.671802 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462dece6-ebe5-43e4-8c8b-b016fc0f6192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:36.672455 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462dece6-ebe5-43e4-8c8b-b016fc0f6192 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:36.672736 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462dece6-ebe5-43e4-8c8b-b016fc0f6192 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:36.673016 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462dece6-ebe5-43e4-8c8b-b016fc0f6192 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:36.673740 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462dece6-ebe5-43e4-8c8b-b016fc0f6192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:36.675358 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462dece6-ebe5-43e4-8c8b-b016fc0f6192 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:36.685837 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 882/1758] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:36.689937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8be9d3-188b-49bc-942e-1df109c6f1e3 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:36.700412 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8be9d3-188b-49bc-942e-1df109c6f1e3 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:36.705654 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1946db-cd25-4708-98f5-e138327faacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:36.706567 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1946db-cd25-4708-98f5-e138327faacf admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:36.706854 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1946db-cd25-4708-98f5-e138327faacf admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:36.707130 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1946db-cd25-4708-98f5-e138327faacf admin admin] PATH_INFO: `/v3/projects/f0081ec66238434d99afcd1e19f82cab/users/d242ffb1e9ea47cbab76960a549e543f/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:36.722847 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1946db-cd25-4708-98f5-e138327faacf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0081ec66238434d99afcd1e19f82cab, user_id=d242ffb1e9ea47cbab76960a549e543f, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:36.725532 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1946db-cd25-4708-98f5-e138327faacf admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:36.831248 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 877/1759] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:36 2022] PUT /identity/v3/projects/f0081ec66238434d99afcd1e19f82cab/users/d242ffb1e9ea47cbab76960a549e543f/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:36.835325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462dece6-ebe5-43e4-8c8b-b016fc0f6192 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:36.847036 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462dece6-ebe5-43e4-8c8b-b016fc0f6192 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:36.909249 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fde286-1812-4d8f-872c-9781697d3ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:36.909996 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fde286-1812-4d8f-872c-9781697d3ded admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:36.910384 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fde286-1812-4d8f-872c-9781697d3ded admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:36.910764 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fde286-1812-4d8f-872c-9781697d3ded admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:36.911630 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fde286-1812-4d8f-872c-9781697d3ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:36.913353 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fde286-1812-4d8f-872c-9781697d3ded admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:36.923261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 883/1760] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:36.927737 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1946db-cd25-4708-98f5-e138327faacf admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:36.940746 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1946db-cd25-4708-98f5-e138327faacf admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:36.944890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd840d-854a-4272-ad54-727d53eda775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:36.946252 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd840d-854a-4272-ad54-727d53eda775 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:36.946684 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd840d-854a-4272-ad54-727d53eda775 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:36.947407 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd840d-854a-4272-ad54-727d53eda775 admin admin] PATH_INFO: `/v3/projects/f0081ec66238434d99afcd1e19f82cab/users/d242ffb1e9ea47cbab76960a549e543f/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:36.950455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd840d-854a-4272-ad54-727d53eda775 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0081ec66238434d99afcd1e19f82cab, user_id=d242ffb1e9ea47cbab76960a549e543f, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:36.953435 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd840d-854a-4272-ad54-727d53eda775 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:36.957444 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:36.965675 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 878/1761] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:36 2022] PUT /identity/v3/projects/f0081ec66238434d99afcd1e19f82cab/users/d242ffb1e9ea47cbab76960a549e543f/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:38.505769 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc03d91-d2ca-4cb6-b7d0-418a17330f2e None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:38.506668 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc03d91-d2ca-4cb6-b7d0-418a17330f2e None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:38.506668 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc03d91-d2ca-4cb6-b7d0-418a17330f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:38.550622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-abc03d91-d2ca-4cb6-b7d0-418a17330f2e None None] MFA Rules not processed for user `d242ffb1e9ea47cbab76960a549e543f`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:38.550622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-abc03d91-d2ca-4cb6-b7d0-418a17330f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:38.718606 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:38.731773 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 884/1762] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:38 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:39.113390 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed443b-6e33-4060-8f07-94d8157923c0 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:39.117394 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed443b-6e33-4060-8f07-94d8157923c0 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:39.117893 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed443b-6e33-4060-8f07-94d8157923c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:39.149678 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-c2ed443b-6e33-4060-8f07-94d8157923c0 None None] MFA Rules not processed for user `a08bd52110074f11ba56b2f02397062f`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:39.151093 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c2ed443b-6e33-4060-8f07-94d8157923c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:39.222079 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 879/1763] 10.222.0.59 () {58 vars in 1015 bytes} [Mon Jul 25 08:50:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:39.248595 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc03d91-d2ca-4cb6-b7d0-418a17330f2e None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:39.250615 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-abc03d91-d2ca-4cb6-b7d0-418a17330f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:39.289920 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc03d91-d2ca-4cb6-b7d0-418a17330f2e None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:39.302411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a886f-379d-4143-9b47-d71c2fb67462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:39.302411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a886f-379d-4143-9b47-d71c2fb67462 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:39.302411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a886f-379d-4143-9b47-d71c2fb67462 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:39.302411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a886f-379d-4143-9b47-d71c2fb67462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:39.314016 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a886f-379d-4143-9b47-d71c2fb67462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:39.316384 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a886f-379d-4143-9b47-d71c2fb67462 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:39.331247 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 885/1764] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:39.372733 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d177cf-bf9d-4f69-b6a4-9a72c826f454 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:39.373027 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d177cf-bf9d-4f69-b6a4-9a72c826f454 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:39.373305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d177cf-bf9d-4f69-b6a4-9a72c826f454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:39.467864 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-58d177cf-bf9d-4f69-b6a4-9a72c826f454 None None] MFA Rules not processed for user `b3c1d56bc0a64411a68f97a4417b0379`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:39.479305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-58d177cf-bf9d-4f69-b6a4-9a72c826f454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:39.586171 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 880/1765] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Jul 25 08:50:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:40.061851 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854cd67-8b92-424c-99c3-3c84ae3512be None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:40.062348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854cd67-8b92-424c-99c3-3c84ae3512be None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:40.062431 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854cd67-8b92-424c-99c3-3c84ae3512be None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:40.064334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 886/1766] 10.222.0.18 () {54 vars in 921 bytes} [Mon Jul 25 08:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:50:40.068317 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d177cf-bf9d-4f69-b6a4-9a72c826f454 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:40.071784 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-58d177cf-bf9d-4f69-b6a4-9a72c826f454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:40.148731 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39d3ed-31ae-49ed-b346-5df17defa34f None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:40.159711 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39d3ed-31ae-49ed-b346-5df17defa34f None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:40.159711 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39d3ed-31ae-49ed-b346-5df17defa34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:40.190867 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-3c39d3ed-31ae-49ed-b346-5df17defa34f None None] MFA Rules not processed for user `dfb4be75496444dd897b880c2ac3e67e`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:40.192285 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-3c39d3ed-31ae-49ed-b346-5df17defa34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:40.196208 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:40.208566 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d177cf-bf9d-4f69-b6a4-9a72c826f454 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:40.217687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de2f7a-f0e6-46b9-818c-67f24f6de3c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2763e540681547d3a6677567b3be86ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:40.218750 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de2f7a-f0e6-46b9-818c-67f24f6de3c2 service swift] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:40.219858 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de2f7a-f0e6-46b9-818c-67f24f6de3c2 service swift] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:40.220311 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de2f7a-f0e6-46b9-818c-67f24f6de3c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:40.249733 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de2f7a-f0e6-46b9-818c-67f24f6de3c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:40.258375 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de2f7a-f0e6-46b9-818c-67f24f6de3c2 service swift] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:40.272088 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 881/1767] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Jul 25 08:50:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 08:50:40.323319 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 887/1768] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Jul 25 08:50:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:50:40.370064 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de2f7a-f0e6-46b9-818c-67f24f6de3c2 service swift] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:40.377782 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d3de2f7a-f0e6-46b9-818c-67f24f6de3c2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:40.413588 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de2f7a-f0e6-46b9-818c-67f24f6de3c2 service swift] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:40.420728 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06dd74-063d-43aa-81ca-34d2821917c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfb4be75496444dd897b880c2ac3e67e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:40.421705 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06dd74-063d-43aa-81ca-34d2821917c9 service placement] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:40.422161 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06dd74-063d-43aa-81ca-34d2821917c9 service placement] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:40.424623 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06dd74-063d-43aa-81ca-34d2821917c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:40.437347 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf06dd74-063d-43aa-81ca-34d2821917c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:40.440921 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf06dd74-063d-43aa-81ca-34d2821917c9 service placement] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:40.454067 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 882/1769] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:42.812599 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d5943-3d3a-40fb-bbe1-0b8ce5f4fef6 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:42.813547 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d5943-3d3a-40fb-bbe1-0b8ce5f4fef6 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:42.814086 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d5943-3d3a-40fb-bbe1-0b8ce5f4fef6 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:42.817087 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 888/1770] 10.222.0.18 () {54 vars in 921 bytes} [Mon Jul 25 08:50:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:50:42.829436 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0e423-9763-4cdf-9919-75d8d97d14d5 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:42.831107 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0e423-9763-4cdf-9919-75d8d97d14d5 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:42.832207 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0e423-9763-4cdf-9919-75d8d97d14d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:42.878665 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-c5f0e423-9763-4cdf-9919-75d8d97d14d5 None None] MFA Rules not processed for user `1c1a08d3a76643a9996dc0daa8714ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:42.882313 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c5f0e423-9763-4cdf-9919-75d8d97d14d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:43.031139 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 883/1771] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Jul 25 08:50:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:43.152493 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d5943-3d3a-40fb-bbe1-0b8ce5f4fef6 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:43.155839 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-ec6d5943-3d3a-40fb-bbe1-0b8ce5f4fef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:43.202810 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d5943-3d3a-40fb-bbe1-0b8ce5f4fef6 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:43.224578 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd413f56-cfaa-4b7e-a00e-60ff5d1b9f5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:43.225623 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd413f56-cfaa-4b7e-a00e-60ff5d1b9f5f service nova] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:43.226188 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd413f56-cfaa-4b7e-a00e-60ff5d1b9f5f service nova] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:43.226678 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd413f56-cfaa-4b7e-a00e-60ff5d1b9f5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:43.252495 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd413f56-cfaa-4b7e-a00e-60ff5d1b9f5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:43.255218 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd413f56-cfaa-4b7e-a00e-60ff5d1b9f5f service nova] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:43.296286 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 889/1772] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:44.348950 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d909d-cc8a-42e2-9584-e84a07951dc0 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:44.350017 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d909d-cc8a-42e2-9584-e84a07951dc0 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:44.350457 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d909d-cc8a-42e2-9584-e84a07951dc0 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:44.353150 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 884/1773] 10.222.0.18 () {54 vars in 921 bytes} [Mon Jul 25 08:50:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:50:44.597505 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4abac1-30bb-46f7-b581-76c3f50ca81e None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:44.598453 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4abac1-30bb-46f7-b581-76c3f50ca81e None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:44.598945 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4abac1-30bb-46f7-b581-76c3f50ca81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:44.644602 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-7c4abac1-30bb-46f7-b581-76c3f50ca81e None None] MFA Rules not processed for user `dfb4be75496444dd897b880c2ac3e67e`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:44.646389 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-7c4abac1-30bb-46f7-b581-76c3f50ca81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:44.666725 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 890/1774] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Jul 25 08:50:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:44.728090 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d909d-cc8a-42e2-9584-e84a07951dc0 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:44.754536 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d909d-cc8a-42e2-9584-e84a07951dc0 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:44.761012 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ad459-832d-4bc4-bec6-9c0def9330b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfb4be75496444dd897b880c2ac3e67e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:44.761886 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ad459-832d-4bc4-bec6-9c0def9330b8 service placement] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:44.762271 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ad459-832d-4bc4-bec6-9c0def9330b8 service placement] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:44.762748 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ad459-832d-4bc4-bec6-9c0def9330b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:44.777199 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ad459-832d-4bc4-bec6-9c0def9330b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:44.781220 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ad459-832d-4bc4-bec6-9c0def9330b8 service placement] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:44.799297 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 885/1775] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:45.176619 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4abac1-30bb-46f7-b581-76c3f50ca81e None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:45.362446 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4abac1-30bb-46f7-b581-76c3f50ca81e None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:45.375439 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ab9f7-9bb8-44dc-afd6-3e2e9fa34d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:45.377984 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ab9f7-9bb8-44dc-afd6-3e2e9fa34d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:45.378687 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ab9f7-9bb8-44dc-afd6-3e2e9fa34d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:45.379390 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ab9f7-9bb8-44dc-afd6-3e2e9fa34d6f admin admin] PATH_INFO: `/v3/users/27127752577f433d9de67dadfe41bc11` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:45.382099 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ab9f7-9bb8-44dc-afd6-3e2e9fa34d6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=27127752577f433d9de67dadfe41bc11)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:45.386249 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ab9f7-9bb8-44dc-afd6-3e2e9fa34d6f admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:45.991329 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5b1ab9f7-9bb8-44dc-afd6-3e2e9fa34d6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27127752577f433d9de67dadfe41bc11'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:46.003829 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5b1ab9f7-9bb8-44dc-afd6-3e2e9fa34d6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27127752577f433d9de67dadfe41bc11'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:46.003829 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5b1ab9f7-9bb8-44dc-afd6-3e2e9fa34d6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27127752577f433d9de67dadfe41bc11'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:46.029764 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5b1ab9f7-9bb8-44dc-afd6-3e2e9fa34d6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27127752577f433d9de67dadfe41bc11'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:46.173762 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5b1ab9f7-9bb8-44dc-afd6-3e2e9fa34d6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27127752577f433d9de67dadfe41bc11'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:46.179123 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:46.248218 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 891/1776] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:50:45 2022] DELETE /identity/v3/users/27127752577f433d9de67dadfe41bc11 => generated 0 bytes in 1072 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:46.501169 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ad459-832d-4bc4-bec6-9c0def9330b8 service placement] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:46.503627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-ca3ad459-832d-4bc4-bec6-9c0def9330b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:46.541412 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ad459-832d-4bc4-bec6-9c0def9330b8 service placement] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:46.625861 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ab9f7-9bb8-44dc-afd6-3e2e9fa34d6f admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:46.634584 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-5b1ab9f7-9bb8-44dc-afd6-3e2e9fa34d6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:46.718645 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fff885-7f47-489d-8762-08517c0237b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:46.722927 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fff885-7f47-489d-8762-08517c0237b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:46.722927 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fff885-7f47-489d-8762-08517c0237b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:46.722927 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fff885-7f47-489d-8762-08517c0237b6 admin admin] PATH_INFO: `/v3/users/9e1503a13df24396a275d306433c7e7f` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:46.722927 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fff885-7f47-489d-8762-08517c0237b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e1503a13df24396a275d306433c7e7f)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:46.725267 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fff885-7f47-489d-8762-08517c0237b6 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:46.832617 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ab9f7-9bb8-44dc-afd6-3e2e9fa34d6f admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:46.846356 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033e898-c3e0-4cc3-953d-e9b3dc6530ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:46.847199 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033e898-c3e0-4cc3-953d-e9b3dc6530ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:46.847386 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033e898-c3e0-4cc3-953d-e9b3dc6530ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:46.849882 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033e898-c3e0-4cc3-953d-e9b3dc6530ad admin admin] PATH_INFO: `/v3/users/f604f9abd3c342068dc5c70c46f1b75f` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:46.852284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033e898-c3e0-4cc3-953d-e9b3dc6530ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=f604f9abd3c342068dc5c70c46f1b75f)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:46.859243 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033e898-c3e0-4cc3-953d-e9b3dc6530ad admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:46.988922 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-d3fff885-7f47-489d-8762-08517c0237b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e1503a13df24396a275d306433c7e7f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:46.990860 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-d3fff885-7f47-489d-8762-08517c0237b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e1503a13df24396a275d306433c7e7f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:47.016129 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:47.022023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-d3fff885-7f47-489d-8762-08517c0237b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e1503a13df24396a275d306433c7e7f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:47.023076 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-d3fff885-7f47-489d-8762-08517c0237b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e1503a13df24396a275d306433c7e7f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:47.304776 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-d3fff885-7f47-489d-8762-08517c0237b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e1503a13df24396a275d306433c7e7f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:47.369740 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-2033e898-c3e0-4cc3-953d-e9b3dc6530ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f604f9abd3c342068dc5c70c46f1b75f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:47.374043 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-2033e898-c3e0-4cc3-953d-e9b3dc6530ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f604f9abd3c342068dc5c70c46f1b75f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:47.406750 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-2033e898-c3e0-4cc3-953d-e9b3dc6530ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f604f9abd3c342068dc5c70c46f1b75f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:47.430135 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 886/1777] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:50:46 2022] DELETE /identity/v3/users/9e1503a13df24396a275d306433c7e7f => generated 0 bytes in 929 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:47.441283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4da427-6a66-423e-a85e-69066805136e None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:47.441283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4da427-6a66-423e-a85e-69066805136e None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:47.441283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4da427-6a66-423e-a85e-69066805136e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:47.446320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-2033e898-c3e0-4cc3-953d-e9b3dc6530ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f604f9abd3c342068dc5c70c46f1b75f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:47.496745 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-6b4da427-6a66-423e-a85e-69066805136e None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:47.508222 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6b4da427-6a66-423e-a85e-69066805136e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:47.674677 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 887/1778] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:47.725712 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4da427-6a66-423e-a85e-69066805136e None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:47.727225 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6b4da427-6a66-423e-a85e-69066805136e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:47.826573 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-2033e898-c3e0-4cc3-953d-e9b3dc6530ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f604f9abd3c342068dc5c70c46f1b75f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:47.898144 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 892/1779] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:50:46 2022] DELETE /identity/v3/users/f604f9abd3c342068dc5c70c46f1b75f => generated 0 bytes in 1273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:47.905044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aea14c-2d50-466f-8c2c-c2990c7d30fa None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:47.905044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aea14c-2d50-466f-8c2c-c2990c7d30fa None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:47.905044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aea14c-2d50-466f-8c2c-c2990c7d30fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:47.941318 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4da427-6a66-423e-a85e-69066805136e None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:47.969974 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-21aea14c-2d50-466f-8c2c-c2990c7d30fa None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:47.973935 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-21aea14c-2d50-466f-8c2c-c2990c7d30fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:48.099880 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6160d-4ef1-4756-b99d-965eb4879684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:48.100719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6160d-4ef1-4756-b99d-965eb4879684 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:48.100984 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6160d-4ef1-4756-b99d-965eb4879684 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:48.101273 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6160d-4ef1-4756-b99d-965eb4879684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:48.154197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 893/1780] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:48.164817 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aea14c-2d50-466f-8c2c-c2990c7d30fa None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:48.171245 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-21aea14c-2d50-466f-8c2c-c2990c7d30fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:48.203034 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aea14c-2d50-466f-8c2c-c2990c7d30fa None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:48.223082 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fb07b-3016-482a-8d93-cde85b946410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:48.223082 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fb07b-3016-482a-8d93-cde85b946410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:48.226083 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fb07b-3016-482a-8d93-cde85b946410 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:48.227535 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fb07b-3016-482a-8d93-cde85b946410 admin admin] PATH_INFO: `/v3/projects/bc9a189a2b2143dc90c4573f1da32f1c` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:48.237887 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451fb07b-3016-482a-8d93-cde85b946410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc9a189a2b2143dc90c4573f1da32f1c)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:48.240191 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451fb07b-3016-482a-8d93-cde85b946410 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:48.281063 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6160d-4ef1-4756-b99d-965eb4879684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:48.282899 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6160d-4ef1-4756-b99d-965eb4879684 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:48.302307 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 888/1781] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:48.303424 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6160d-4ef1-4756-b99d-965eb4879684 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:48.319206 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6160d-4ef1-4756-b99d-965eb4879684 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:48.326869 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c512d-e22c-4e7e-a8ae-5c995ec0658d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:48.327837 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c512d-e22c-4e7e-a8ae-5c995ec0658d service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:48.328429 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c512d-e22c-4e7e-a8ae-5c995ec0658d service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:48.328747 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c512d-e22c-4e7e-a8ae-5c995ec0658d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:48.349673 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c512d-e22c-4e7e-a8ae-5c995ec0658d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:48.358767 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c512d-e22c-4e7e-a8ae-5c995ec0658d service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:48.373497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 889/1782] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:48.497557 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-451fb07b-3016-482a-8d93-cde85b946410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc9a189a2b2143dc90c4573f1da32f1c', 'request_id': 'req-451fb07b-3016-482a-8d93-cde85b946410'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:48.512306 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-451fb07b-3016-482a-8d93-cde85b946410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc9a189a2b2143dc90c4573f1da32f1c', 'request_id': 'req-451fb07b-3016-482a-8d93-cde85b946410'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:48.535259 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2612f6-8957-4d6f-8b06-f155d78d01c4 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:48.536324 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2612f6-8957-4d6f-8b06-f155d78d01c4 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:48.536754 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2612f6-8957-4d6f-8b06-f155d78d01c4 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:48.538679 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 890/1783] 10.222.0.18 () {54 vars in 921 bytes} [Mon Jul 25 08:50:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:50:48.542341 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-451fb07b-3016-482a-8d93-cde85b946410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc9a189a2b2143dc90c4573f1da32f1c', 'request_id': 'req-451fb07b-3016-482a-8d93-cde85b946410'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:48.553659 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6f535-79a8-4198-b22c-3970a267b869 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:48.554207 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6f535-79a8-4198-b22c-3970a267b869 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:48.554647 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6f535-79a8-4198-b22c-3970a267b869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:48.609482 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-dac6f535-79a8-4198-b22c-3970a267b869 None None] MFA Rules not processed for user `1c1a08d3a76643a9996dc0daa8714ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:48.612212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-dac6f535-79a8-4198-b22c-3970a267b869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:48.747599 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-451fb07b-3016-482a-8d93-cde85b946410 admin admin] The token cache is being invalidate because project bc9a189a2b2143dc90c4573f1da32f1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:50:48.747599 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-451fb07b-3016-482a-8d93-cde85b946410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:48.747599 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-451fb07b-3016-482a-8d93-cde85b946410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:48.750553 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 894/1784] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:50:48 2022] DELETE /identity/v3/projects/bc9a189a2b2143dc90c4573f1da32f1c => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:48.774963 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fb07b-3016-482a-8d93-cde85b946410 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:48.787708 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-451fb07b-3016-482a-8d93-cde85b946410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:48.819276 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 891/1785] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Jul 25 08:50:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:49.012907 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fb07b-3016-482a-8d93-cde85b946410 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:49.021520 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee33de-033e-43dc-a594-5698ed33d932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:49.022515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee33de-033e-43dc-a594-5698ed33d932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:49.022792 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee33de-033e-43dc-a594-5698ed33d932 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:49.023067 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee33de-033e-43dc-a594-5698ed33d932 admin admin] PATH_INFO: `/v3/users/d242ffb1e9ea47cbab76960a549e543f` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:49.025123 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee33de-033e-43dc-a594-5698ed33d932 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d242ffb1e9ea47cbab76960a549e543f)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:49.029786 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee33de-033e-43dc-a594-5698ed33d932 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:49.351856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:49.470067 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-b2ee33de-033e-43dc-a594-5698ed33d932 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd242ffb1e9ea47cbab76960a549e543f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:49.473340 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-b2ee33de-033e-43dc-a594-5698ed33d932 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd242ffb1e9ea47cbab76960a549e543f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:49.473340 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-b2ee33de-033e-43dc-a594-5698ed33d932 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd242ffb1e9ea47cbab76960a549e543f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:49.500003 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-b2ee33de-033e-43dc-a594-5698ed33d932 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd242ffb1e9ea47cbab76960a549e543f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:49.506570 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6f535-79a8-4198-b22c-3970a267b869 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:49.508582 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-dac6f535-79a8-4198-b22c-3970a267b869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:49.526010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6f535-79a8-4198-b22c-3970a267b869 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:49.541289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89c24e-beb2-4668-8d4c-4123928cfef0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:49.541289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89c24e-beb2-4668-8d4c-4123928cfef0 service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:49.541289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89c24e-beb2-4668-8d4c-4123928cfef0 service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:49.541289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89c24e-beb2-4668-8d4c-4123928cfef0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:49.542329 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-5c89c24e-beb2-4668-8d4c-4123928cfef0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:49.552545 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89c24e-beb2-4668-8d4c-4123928cfef0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:49.554704 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89c24e-beb2-4668-8d4c-4123928cfef0 service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:49.578877 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 892/1786] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:50:49.624284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-b2ee33de-033e-43dc-a594-5698ed33d932 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd242ffb1e9ea47cbab76960a549e543f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:49.627388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:49.662305 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 895/1787] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:50:48 2022] DELETE /identity/v3/users/d242ffb1e9ea47cbab76960a549e543f => generated 0 bytes in 887 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:50.545028 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89c24e-beb2-4668-8d4c-4123928cfef0 service nova] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:50.547095 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-5c89c24e-beb2-4668-8d4c-4123928cfef0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:50.580556 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89c24e-beb2-4668-8d4c-4123928cfef0 service nova] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:50.780079 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee33de-033e-43dc-a594-5698ed33d932 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:50.783273 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-b2ee33de-033e-43dc-a594-5698ed33d932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:50.784124 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af0f77-98c1-49fc-bbc5-7fb742af3db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:50.785215 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af0f77-98c1-49fc-bbc5-7fb742af3db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:50.785657 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af0f77-98c1-49fc-bbc5-7fb742af3db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:50.786234 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af0f77-98c1-49fc-bbc5-7fb742af3db2 admin admin] PATH_INFO: `/v3/projects/a059fd0bb44d4277bfc23960a6d5a1fa` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:50.787931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af0f77-98c1-49fc-bbc5-7fb742af3db2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a059fd0bb44d4277bfc23960a6d5a1fa)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:50.790784 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af0f77-98c1-49fc-bbc5-7fb742af3db2 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:50.821223 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee33de-033e-43dc-a594-5698ed33d932 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:50.852283 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5be6e2-de18-4ad6-9c77-8decada46b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:50.858966 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5be6e2-de18-4ad6-9c77-8decada46b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:50.858966 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5be6e2-de18-4ad6-9c77-8decada46b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:50.858966 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5be6e2-de18-4ad6-9c77-8decada46b46 admin admin] PATH_INFO: `/v3/projects/95efeacd42ec4ad5ad7b7bbd326fdddd` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:50.858966 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5be6e2-de18-4ad6-9c77-8decada46b46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95efeacd42ec4ad5ad7b7bbd326fdddd)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:50.871932 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5be6e2-de18-4ad6-9c77-8decada46b46 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:51.026063 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-92af0f77-98c1-49fc-bbc5-7fb742af3db2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a059fd0bb44d4277bfc23960a6d5a1fa', 'request_id': 'req-92af0f77-98c1-49fc-bbc5-7fb742af3db2'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:51.057602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-92af0f77-98c1-49fc-bbc5-7fb742af3db2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a059fd0bb44d4277bfc23960a6d5a1fa', 'request_id': 'req-92af0f77-98c1-49fc-bbc5-7fb742af3db2'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:51.087697 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-92af0f77-98c1-49fc-bbc5-7fb742af3db2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a059fd0bb44d4277bfc23960a6d5a1fa', 'request_id': 'req-92af0f77-98c1-49fc-bbc5-7fb742af3db2'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:51.203593 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-92af0f77-98c1-49fc-bbc5-7fb742af3db2 admin admin] The token cache is being invalidate because project a059fd0bb44d4277bfc23960a6d5a1fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:50:51.204524 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-92af0f77-98c1-49fc-bbc5-7fb742af3db2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:51.205484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-92af0f77-98c1-49fc-bbc5-7fb742af3db2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:51.208044 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 893/1788] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:50:50 2022] DELETE /identity/v3/projects/a059fd0bb44d4277bfc23960a6d5a1fa => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:51.213178 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af0f77-98c1-49fc-bbc5-7fb742af3db2 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:51.214600 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-3e5be6e2-de18-4ad6-9c77-8decada46b46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95efeacd42ec4ad5ad7b7bbd326fdddd', 'request_id': 'req-3e5be6e2-de18-4ad6-9c77-8decada46b46'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:51.218166 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-92af0f77-98c1-49fc-bbc5-7fb742af3db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:51.233633 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-3e5be6e2-de18-4ad6-9c77-8decada46b46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95efeacd42ec4ad5ad7b7bbd326fdddd', 'request_id': 'req-3e5be6e2-de18-4ad6-9c77-8decada46b46'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:51.243144 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-3e5be6e2-de18-4ad6-9c77-8decada46b46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95efeacd42ec4ad5ad7b7bbd326fdddd', 'request_id': 'req-3e5be6e2-de18-4ad6-9c77-8decada46b46'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:51.314272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af0f77-98c1-49fc-bbc5-7fb742af3db2 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:51.351875 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-3e5be6e2-de18-4ad6-9c77-8decada46b46 admin admin] The token cache is being invalidate because project 95efeacd42ec4ad5ad7b7bbd326fdddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:50:51.352334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-3e5be6e2-de18-4ad6-9c77-8decada46b46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:51.362391 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-3e5be6e2-de18-4ad6-9c77-8decada46b46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:51.374584 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 896/1789] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:50:50 2022] DELETE /identity/v3/projects/95efeacd42ec4ad5ad7b7bbd326fdddd => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:51.379794 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5be6e2-de18-4ad6-9c77-8decada46b46 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:51.381227 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-3e5be6e2-de18-4ad6-9c77-8decada46b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:51.389230 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d304d-fbd1-468b-aaff-9998d0d54b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:51.390562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d304d-fbd1-468b-aaff-9998d0d54b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:51.391303 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d304d-fbd1-468b-aaff-9998d0d54b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:51.391813 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d304d-fbd1-468b-aaff-9998d0d54b6b admin admin] PATH_INFO: `/v3/users/24887858321641f691c072e7256a2c61` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:51.397226 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d304d-fbd1-468b-aaff-9998d0d54b6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=24887858321641f691c072e7256a2c61)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:51.400543 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d304d-fbd1-468b-aaff-9998d0d54b6b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:51.425634 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5be6e2-de18-4ad6-9c77-8decada46b46 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:51.441031 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885ad58-acd5-458f-ae2e-3949845f8df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:51.441979 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885ad58-acd5-458f-ae2e-3949845f8df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:51.442232 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885ad58-acd5-458f-ae2e-3949845f8df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:51.442513 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885ad58-acd5-458f-ae2e-3949845f8df6 admin admin] PATH_INFO: `/v3/users/87e33958a86e4a3395295918f68fcd97` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:51.453672 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885ad58-acd5-458f-ae2e-3949845f8df6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87e33958a86e4a3395295918f68fcd97)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:51.456891 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885ad58-acd5-458f-ae2e-3949845f8df6 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:51.888973 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:51.925647 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-8c7d304d-fbd1-468b-aaff-9998d0d54b6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24887858321641f691c072e7256a2c61'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:51.925647 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-8c7d304d-fbd1-468b-aaff-9998d0d54b6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24887858321641f691c072e7256a2c61'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:51.936018 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-8c7d304d-fbd1-468b-aaff-9998d0d54b6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24887858321641f691c072e7256a2c61'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:51.937167 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-8c7d304d-fbd1-468b-aaff-9998d0d54b6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24887858321641f691c072e7256a2c61'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:51.962038 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-f885ad58-acd5-458f-ae2e-3949845f8df6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87e33958a86e4a3395295918f68fcd97'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:51.963053 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-f885ad58-acd5-458f-ae2e-3949845f8df6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87e33958a86e4a3395295918f68fcd97'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:51.964071 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-f885ad58-acd5-458f-ae2e-3949845f8df6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87e33958a86e4a3395295918f68fcd97'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:51.991212 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-f885ad58-acd5-458f-ae2e-3949845f8df6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87e33958a86e4a3395295918f68fcd97'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:52.314984 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-8c7d304d-fbd1-468b-aaff-9998d0d54b6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24887858321641f691c072e7256a2c61'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:52.349270 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 894/1790] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:50:51 2022] DELETE /identity/v3/users/24887858321641f691c072e7256a2c61 => generated 0 bytes in 1134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:52.349270 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d304d-fbd1-468b-aaff-9998d0d54b6b admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:52.349556 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-8c7d304d-fbd1-468b-aaff-9998d0d54b6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:52.423110 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-f885ad58-acd5-458f-ae2e-3949845f8df6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87e33958a86e4a3395295918f68fcd97'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:52.425393 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:52.461089 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 897/1791] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:50:51 2022] DELETE /identity/v3/users/87e33958a86e4a3395295918f68fcd97 => generated 0 bytes in 1082 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:52.470116 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d304d-fbd1-468b-aaff-9998d0d54b6b admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:52.539336 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d13ab4-03f9-4cf2-8c57-71c9c7b02e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:52.540285 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d13ab4-03f9-4cf2-8c57-71c9c7b02e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:52.540568 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d13ab4-03f9-4cf2-8c57-71c9c7b02e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:52.540939 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d13ab4-03f9-4cf2-8c57-71c9c7b02e3c admin admin] PATH_INFO: `/v3/projects/f0081ec66238434d99afcd1e19f82cab` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:52.542349 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d13ab4-03f9-4cf2-8c57-71c9c7b02e3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0081ec66238434d99afcd1e19f82cab)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:52.545765 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d13ab4-03f9-4cf2-8c57-71c9c7b02e3c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:52.733558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-66d13ab4-03f9-4cf2-8c57-71c9c7b02e3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0081ec66238434d99afcd1e19f82cab', 'request_id': 'req-66d13ab4-03f9-4cf2-8c57-71c9c7b02e3c'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:52.760757 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-66d13ab4-03f9-4cf2-8c57-71c9c7b02e3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0081ec66238434d99afcd1e19f82cab', 'request_id': 'req-66d13ab4-03f9-4cf2-8c57-71c9c7b02e3c'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:52.771737 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-66d13ab4-03f9-4cf2-8c57-71c9c7b02e3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0081ec66238434d99afcd1e19f82cab', 'request_id': 'req-66d13ab4-03f9-4cf2-8c57-71c9c7b02e3c'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:52.900070 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-66d13ab4-03f9-4cf2-8c57-71c9c7b02e3c admin admin] The token cache is being invalidate because project f0081ec66238434d99afcd1e19f82cab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:50:52.901681 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-66d13ab4-03f9-4cf2-8c57-71c9c7b02e3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:52.904041 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-66d13ab4-03f9-4cf2-8c57-71c9c7b02e3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:52.911926 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 895/1792] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:50:52 2022] DELETE /identity/v3/projects/f0081ec66238434d99afcd1e19f82cab => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:52.916962 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d70ef-d630-44b7-af3a-0746a5ab1b84 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:52.917988 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d70ef-d630-44b7-af3a-0746a5ab1b84 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:52.918483 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d70ef-d630-44b7-af3a-0746a5ab1b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:52.955177 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-0b3d70ef-d630-44b7-af3a-0746a5ab1b84 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:52.960171 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-0b3d70ef-d630-44b7-af3a-0746a5ab1b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:53.054944 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 898/1793] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:53.063088 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3eb97-8329-423b-bf88-62e8d45bea56 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:53.063600 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3eb97-8329-423b-bf88-62e8d45bea56 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:53.063845 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3eb97-8329-423b-bf88-62e8d45bea56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:53.091449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-63a3eb97-8329-423b-bf88-62e8d45bea56 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:53.096913 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-63a3eb97-8329-423b-bf88-62e8d45bea56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:53.102565 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 896/1794] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:53.107718 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d70ef-d630-44b7-af3a-0746a5ab1b84 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:53.123400 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d70ef-d630-44b7-af3a-0746a5ab1b84 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:53.135873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3eb97-8329-423b-bf88-62e8d45bea56 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:53.137984 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-63a3eb97-8329-423b-bf88-62e8d45bea56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:53.141690 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604240d-c115-4dd2-8ae7-82b96b50f144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:53.144302 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604240d-c115-4dd2-8ae7-82b96b50f144 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:53.146277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604240d-c115-4dd2-8ae7-82b96b50f144 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:53.146277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604240d-c115-4dd2-8ae7-82b96b50f144 admin admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:53.146277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8604240d-c115-4dd2-8ae7-82b96b50f144 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:50:53.147202 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8604240d-c115-4dd2-8ae7-82b96b50f144 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:53.150361 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8604240d-c115-4dd2-8ae7-82b96b50f144 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:53.166975 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3eb97-8329-423b-bf88-62e8d45bea56 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:53.173286 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 899/1795] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:50:53.178844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604240d-c115-4dd2-8ae7-82b96b50f144 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:53.181097 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9df5a1-cb31-45b5-88d9-ba9722b0cd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:53.182188 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9df5a1-cb31-45b5-88d9-ba9722b0cd03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:53.182486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9df5a1-cb31-45b5-88d9-ba9722b0cd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:53.182766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9df5a1-cb31-45b5-88d9-ba9722b0cd03 admin admin] PATH_INFO: `/v3/projects/8df973a6570d4f85b0286b0748a48ccf` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:53.184330 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9df5a1-cb31-45b5-88d9-ba9722b0cd03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8df973a6570d4f85b0286b0748a48ccf)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:53.186458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9df5a1-cb31-45b5-88d9-ba9722b0cd03 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:53.208294 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604240d-c115-4dd2-8ae7-82b96b50f144 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:53.222987 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b4953-9129-4691-8149-f88e4dd8e347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:53.223867 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b4953-9129-4691-8149-f88e4dd8e347 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:53.224277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b4953-9129-4691-8149-f88e4dd8e347 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:53.224654 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b4953-9129-4691-8149-f88e4dd8e347 admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:53.225504 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b4953-9129-4691-8149-f88e4dd8e347 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:53.235744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b4953-9129-4691-8149-f88e4dd8e347 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:53.309629 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-bc9df5a1-cb31-45b5-88d9-ba9722b0cd03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8df973a6570d4f85b0286b0748a48ccf', 'request_id': 'req-bc9df5a1-cb31-45b5-88d9-ba9722b0cd03'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:53.318408 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-bc9df5a1-cb31-45b5-88d9-ba9722b0cd03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8df973a6570d4f85b0286b0748a48ccf', 'request_id': 'req-bc9df5a1-cb31-45b5-88d9-ba9722b0cd03'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:53.327848 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-bc9df5a1-cb31-45b5-88d9-ba9722b0cd03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8df973a6570d4f85b0286b0748a48ccf', 'request_id': 'req-bc9df5a1-cb31-45b5-88d9-ba9722b0cd03'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:53.343559 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:53.388160 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 900/1796] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:50:53 2022] POST /identity/v3/projects => generated 379 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:53.392037 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b4953-9129-4691-8149-f88e4dd8e347 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:53.454318 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-bc9df5a1-cb31-45b5-88d9-ba9722b0cd03 admin admin] The token cache is being invalidate because project 8df973a6570d4f85b0286b0748a48ccf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:50:53.466828 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-bc9df5a1-cb31-45b5-88d9-ba9722b0cd03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:53.466828 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-bc9df5a1-cb31-45b5-88d9-ba9722b0cd03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:53.466828 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 897/1797] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:50:53 2022] DELETE /identity/v3/projects/8df973a6570d4f85b0286b0748a48ccf => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:53.469768 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044b4a0-3134-4bfe-a250-1a63901d823f None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:53.470063 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044b4a0-3134-4bfe-a250-1a63901d823f None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:53.470890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044b4a0-3134-4bfe-a250-1a63901d823f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:53.498784 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-9044b4a0-3134-4bfe-a250-1a63901d823f None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:53.500734 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9044b4a0-3134-4bfe-a250-1a63901d823f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:53.549987 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b4953-9129-4691-8149-f88e4dd8e347 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:53.557080 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb38e2e-95fe-4b6d-8826-2b800b07149d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:53.557786 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb38e2e-95fe-4b6d-8826-2b800b07149d admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:53.558120 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb38e2e-95fe-4b6d-8826-2b800b07149d admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:53.558675 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb38e2e-95fe-4b6d-8826-2b800b07149d admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:53.559996 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb38e2e-95fe-4b6d-8826-2b800b07149d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:53.564398 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb38e2e-95fe-4b6d-8826-2b800b07149d admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:53.581505 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 898/1798] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:53.588937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328eb901-d759-410f-a8dc-ca9bc2a7f90f None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:53.589224 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328eb901-d759-410f-a8dc-ca9bc2a7f90f None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:53.589501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328eb901-d759-410f-a8dc-ca9bc2a7f90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:53.615752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:53.625247 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-328eb901-d759-410f-a8dc-ca9bc2a7f90f None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:53.629326 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-328eb901-d759-410f-a8dc-ca9bc2a7f90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:53.644124 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 899/1799] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:50:53.645390 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328eb901-d759-410f-a8dc-ca9bc2a7f90f None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:53.660531 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328eb901-d759-410f-a8dc-ca9bc2a7f90f None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:53.665629 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75bad3-21bd-4ae6-93c4-b9ec62d6fb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:53.666147 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75bad3-21bd-4ae6-93c4-b9ec62d6fb2e admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:53.666499 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75bad3-21bd-4ae6-93c4-b9ec62d6fb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:53.666845 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75bad3-21bd-4ae6-93c4-b9ec62d6fb2e admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:53.667917 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75bad3-21bd-4ae6-93c4-b9ec62d6fb2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:50:53.668313 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75bad3-21bd-4ae6-93c4-b9ec62d6fb2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:53.670086 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75bad3-21bd-4ae6-93c4-b9ec62d6fb2e admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:53.685929 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 900/1800] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:50:53.690597 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75bad3-21bd-4ae6-93c4-b9ec62d6fb2e admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:53.695381 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 901/1801] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:50:53 2022] POST /identity/v3/users => generated 290 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:50:53.700388 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb38e2e-95fe-4b6d-8826-2b800b07149d admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:53.703013 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75bad3-21bd-4ae6-93c4-b9ec62d6fb2e admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:53.703523 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-5fb38e2e-95fe-4b6d-8826-2b800b07149d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:53.709054 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ede62-8678-4462-8db5-de173978381c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:53.709853 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ede62-8678-4462-8db5-de173978381c admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:53.710196 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ede62-8678-4462-8db5-de173978381c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:53.710425 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ede62-8678-4462-8db5-de173978381c admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:53.711129 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ede62-8678-4462-8db5-de173978381c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:53.713275 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ede62-8678-4462-8db5-de173978381c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:53.726012 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb38e2e-95fe-4b6d-8826-2b800b07149d admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:53.738935 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326ad84-9731-4c91-9321-06a1f2b25215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:53.738935 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326ad84-9731-4c91-9321-06a1f2b25215 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:53.738935 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326ad84-9731-4c91-9321-06a1f2b25215 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:53.738935 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326ad84-9731-4c91-9321-06a1f2b25215 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:53.740054 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b326ad84-9731-4c91-9321-06a1f2b25215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:53.740054 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b326ad84-9731-4c91-9321-06a1f2b25215 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:53.755496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 902/1802] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:53.759837 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326ad84-9731-4c91-9321-06a1f2b25215 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:53.769917 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326ad84-9731-4c91-9321-06a1f2b25215 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:53.774432 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd175318-ee26-483f-a35a-9528f7bb0161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:53.775098 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd175318-ee26-483f-a35a-9528f7bb0161 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:53.775380 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd175318-ee26-483f-a35a-9528f7bb0161 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:53.775684 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd175318-ee26-483f-a35a-9528f7bb0161 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:53.776401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd175318-ee26-483f-a35a-9528f7bb0161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:53.777966 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd175318-ee26-483f-a35a-9528f7bb0161 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:53.789277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 903/1803] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:50:53.794691 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd175318-ee26-483f-a35a-9528f7bb0161 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:53.807942 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd175318-ee26-483f-a35a-9528f7bb0161 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:53.812911 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98544e-98d3-428a-9929-38bccba68002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:53.813873 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98544e-98d3-428a-9929-38bccba68002 admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:53.815030 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98544e-98d3-428a-9929-38bccba68002 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:53.815879 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98544e-98d3-428a-9929-38bccba68002 admin admin] PATH_INFO: `/v3/projects/ac234ba3363547708b129747173931b5/users/ad2bf1cc2c794832864a6637299cc8f9/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:53.837549 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be98544e-98d3-428a-9929-38bccba68002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac234ba3363547708b129747173931b5, user_id=ad2bf1cc2c794832864a6637299cc8f9, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:53.842659 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be98544e-98d3-428a-9929-38bccba68002 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:53.849044 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 901/1804] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:50:53 2022] POST /identity/v3/projects => generated 365 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:50:53.849787 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ede62-8678-4462-8db5-de173978381c admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:53.851419 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-351ede62-8678-4462-8db5-de173978381c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:53.915081 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 904/1805] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:53 2022] PUT /identity/v3/projects/ac234ba3363547708b129747173931b5/users/ad2bf1cc2c794832864a6637299cc8f9/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:53.915919 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98544e-98d3-428a-9929-38bccba68002 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:53.935799 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ede62-8678-4462-8db5-de173978381c admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:53.992144 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98544e-98d3-428a-9929-38bccba68002 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:53.997167 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305133a-f6f9-46dd-8067-9f404403f4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:53.997842 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305133a-f6f9-46dd-8067-9f404403f4a4 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:53.998127 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305133a-f6f9-46dd-8067-9f404403f4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:53.998401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305133a-f6f9-46dd-8067-9f404403f4a4 admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:53.999092 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305133a-f6f9-46dd-8067-9f404403f4a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:54.001087 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305133a-f6f9-46dd-8067-9f404403f4a4 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:54.010180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5e0e4-283e-49b8-8ee7-40dc3265bfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:54.011713 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5e0e4-283e-49b8-8ee7-40dc3265bfe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:54.012200 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5e0e4-283e-49b8-8ee7-40dc3265bfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:54.012686 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5e0e4-283e-49b8-8ee7-40dc3265bfe0 admin admin] PATH_INFO: `/v3/projects/a0d75dcef57d4917b3a335c279962ed2` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:54.014668 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b5e0e4-283e-49b8-8ee7-40dc3265bfe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0d75dcef57d4917b3a335c279962ed2)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:54.018803 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b5e0e4-283e-49b8-8ee7-40dc3265bfe0 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:54.092035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 905/1806] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:50:53 2022] POST /identity/v3/users => generated 283 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:54.093329 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e340b25-a87a-4645-af4c-3e5087b55ff8 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:54.093620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e340b25-a87a-4645-af4c-3e5087b55ff8 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:54.093896 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e340b25-a87a-4645-af4c-3e5087b55ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:54.123000 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-8e340b25-a87a-4645-af4c-3e5087b55ff8 None None] MFA Rules not processed for user `ad2bf1cc2c794832864a6637299cc8f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:54.124240 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-8e340b25-a87a-4645-af4c-3e5087b55ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:54.138759 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-32b5e0e4-283e-49b8-8ee7-40dc3265bfe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0d75dcef57d4917b3a335c279962ed2', 'request_id': 'req-32b5e0e4-283e-49b8-8ee7-40dc3265bfe0'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:54.145829 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-32b5e0e4-283e-49b8-8ee7-40dc3265bfe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0d75dcef57d4917b3a335c279962ed2', 'request_id': 'req-32b5e0e4-283e-49b8-8ee7-40dc3265bfe0'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:54.151468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-32b5e0e4-283e-49b8-8ee7-40dc3265bfe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0d75dcef57d4917b3a335c279962ed2', 'request_id': 'req-32b5e0e4-283e-49b8-8ee7-40dc3265bfe0'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:54.196532 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 906/1807] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:54.200794 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e340b25-a87a-4645-af4c-3e5087b55ff8 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:54.206624 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-32b5e0e4-283e-49b8-8ee7-40dc3265bfe0 admin admin] The token cache is being invalidate because project a0d75dcef57d4917b3a335c279962ed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:50:54.212613 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-32b5e0e4-283e-49b8-8ee7-40dc3265bfe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:54.212613 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-32b5e0e4-283e-49b8-8ee7-40dc3265bfe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:54.212613 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 902/1808] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:50:53 2022] DELETE /identity/v3/projects/a0d75dcef57d4917b3a335c279962ed2 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:54.212613 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5e0e4-283e-49b8-8ee7-40dc3265bfe0 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:54.212613 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-32b5e0e4-283e-49b8-8ee7-40dc3265bfe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:54.278424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e340b25-a87a-4645-af4c-3e5087b55ff8 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:54.285119 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8cae4-5661-4108-9b6e-46708e4dc451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:54.285804 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8cae4-5661-4108-9b6e-46708e4dc451 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:54.286089 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8cae4-5661-4108-9b6e-46708e4dc451 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:54.286365 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8cae4-5661-4108-9b6e-46708e4dc451 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:54.287090 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5e0e4-283e-49b8-8ee7-40dc3265bfe0 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:54.287882 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8cae4-5661-4108-9b6e-46708e4dc451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:54.289733 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8cae4-5661-4108-9b6e-46708e4dc451 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:54.292245 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632a610-f38c-43f8-9826-43100f8e327b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:54.293058 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632a610-f38c-43f8-9826-43100f8e327b admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:54.293489 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632a610-f38c-43f8-9826-43100f8e327b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:54.293638 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632a610-f38c-43f8-9826-43100f8e327b admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:54.294351 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2632a610-f38c-43f8-9826-43100f8e327b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:54.298191 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2632a610-f38c-43f8-9826-43100f8e327b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:54.301106 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 907/1809] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:54.302829 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a9c50-2be8-4191-93d7-89eefe18e89a None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:54.302829 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a9c50-2be8-4191-93d7-89eefe18e89a None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:54.303026 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a9c50-2be8-4191-93d7-89eefe18e89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:54.324282 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-990a9c50-2be8-4191-93d7-89eefe18e89a None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:54.327847 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-990a9c50-2be8-4191-93d7-89eefe18e89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:54.334284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 908/1810] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:54.335028 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a9c50-2be8-4191-93d7-89eefe18e89a None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:54.336383 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-990a9c50-2be8-4191-93d7-89eefe18e89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:54.350606 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a9c50-2be8-4191-93d7-89eefe18e89a None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:54.353719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e547384-82b8-4366-9d1b-8ac223e3692d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:54.354403 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e547384-82b8-4366-9d1b-8ac223e3692d admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:54.354691 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e547384-82b8-4366-9d1b-8ac223e3692d admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:54.354970 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e547384-82b8-4366-9d1b-8ac223e3692d admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:54.355731 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e547384-82b8-4366-9d1b-8ac223e3692d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:54.357355 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e547384-82b8-4366-9d1b-8ac223e3692d admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:54.368028 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 909/1811] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:54.369238 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62570284-cbd8-4913-aa9d-6dc7c6beef20 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:54.369603 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62570284-cbd8-4913-aa9d-6dc7c6beef20 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:54.369805 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62570284-cbd8-4913-aa9d-6dc7c6beef20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:54.374438 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 903/1812] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:50:54 2022] POST /identity/v3/projects => generated 381 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:54.374438 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632a610-f38c-43f8-9826-43100f8e327b admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:54.391489 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-62570284-cbd8-4913-aa9d-6dc7c6beef20 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:54.393288 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-62570284-cbd8-4913-aa9d-6dc7c6beef20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:54.446444 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632a610-f38c-43f8-9826-43100f8e327b admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:54.467557 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8ac22-74e8-41e4-9b6e-d7be5dfb1d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:54.471751 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8ac22-74e8-41e4-9b6e-d7be5dfb1d68 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:54.471751 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8ac22-74e8-41e4-9b6e-d7be5dfb1d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:54.471751 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8ac22-74e8-41e4-9b6e-d7be5dfb1d68 admin admin] PATH_INFO: `/v3/projects/c3c4c43e0d47442bb6669f2091d1dc6e/users/a09cbd90d8a2438c8751186473154ea4/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:54.492297 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 910/1813] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:54.493592 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62570284-cbd8-4913-aa9d-6dc7c6beef20 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:54.495701 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d8ac22-74e8-41e4-9b6e-d7be5dfb1d68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c4c43e0d47442bb6669f2091d1dc6e, user_id=a09cbd90d8a2438c8751186473154ea4, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:54.498498 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d8ac22-74e8-41e4-9b6e-d7be5dfb1d68 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:54.510117 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62570284-cbd8-4913-aa9d-6dc7c6beef20 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:54.515640 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49eb96-a2a2-4282-8106-9a6bee9198f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:54.517679 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49eb96-a2a2-4282-8106-9a6bee9198f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:54.519575 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49eb96-a2a2-4282-8106-9a6bee9198f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:54.519888 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49eb96-a2a2-4282-8106-9a6bee9198f9 admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:54.520614 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49eb96-a2a2-4282-8106-9a6bee9198f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:54.522570 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49eb96-a2a2-4282-8106-9a6bee9198f9 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:54.585055 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 904/1814] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:54 2022] PUT /identity/v3/projects/c3c4c43e0d47442bb6669f2091d1dc6e/users/a09cbd90d8a2438c8751186473154ea4/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:54.585891 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8ac22-74e8-41e4-9b6e-d7be5dfb1d68 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:54.613022 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 911/1815] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:50:54 2022] POST /identity/v3/users => generated 297 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:54.615646 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0540a32-a061-484c-9b5d-ad9612a89ec4 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:54.616109 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0540a32-a061-484c-9b5d-ad9612a89ec4 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:54.616827 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0540a32-a061-484c-9b5d-ad9612a89ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:54.651181 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-f0540a32-a061-484c-9b5d-ad9612a89ec4 None None] MFA Rules not processed for user `a09cbd90d8a2438c8751186473154ea4`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:54.652725 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-f0540a32-a061-484c-9b5d-ad9612a89ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:54.653812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8ac22-74e8-41e4-9b6e-d7be5dfb1d68 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:54.661040 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875cb230-2209-437b-8bb8-c30bea5302d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:54.661794 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875cb230-2209-437b-8bb8-c30bea5302d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:54.662565 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875cb230-2209-437b-8bb8-c30bea5302d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:54.662919 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875cb230-2209-437b-8bb8-c30bea5302d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:54.663776 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875cb230-2209-437b-8bb8-c30bea5302d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:50:54.664201 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875cb230-2209-437b-8bb8-c30bea5302d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:54.665846 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875cb230-2209-437b-8bb8-c30bea5302d1 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:54.680764 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 905/1816] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:50:54.681642 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875cb230-2209-437b-8bb8-c30bea5302d1 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:54.696460 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875cb230-2209-437b-8bb8-c30bea5302d1 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:54.705715 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713bd359-40b5-4c04-bed5-292bd9ba6132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:54.708221 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bd359-40b5-4c04-bed5-292bd9ba6132 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:54.708221 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bd359-40b5-4c04-bed5-292bd9ba6132 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:54.708221 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bd359-40b5-4c04-bed5-292bd9ba6132 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:54.708976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713bd359-40b5-4c04-bed5-292bd9ba6132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:54.710602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713bd359-40b5-4c04-bed5-292bd9ba6132 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:54.728321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 906/1817] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:54.729198 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713bd359-40b5-4c04-bed5-292bd9ba6132 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:54.739059 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:54.744292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713bd359-40b5-4c04-bed5-292bd9ba6132 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:54.754608 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 912/1818] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:54 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:54.754608 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0540a32-a061-484c-9b5d-ad9612a89ec4 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:54.755032 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf351f0-dc2e-4728-8ea7-6bb6ea0adee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:54.755032 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf351f0-dc2e-4728-8ea7-6bb6ea0adee2 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:54.755032 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf351f0-dc2e-4728-8ea7-6bb6ea0adee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:54.755032 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf351f0-dc2e-4728-8ea7-6bb6ea0adee2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:54.755344 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf351f0-dc2e-4728-8ea7-6bb6ea0adee2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:54.756836 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf351f0-dc2e-4728-8ea7-6bb6ea0adee2 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:54.760316 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0540a32-a061-484c-9b5d-ad9612a89ec4 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:54.784559 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f1451-5d94-44c2-98d1-22e5f8da9f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:54.786248 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f1451-5d94-44c2-98d1-22e5f8da9f55 admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:54.786840 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f1451-5d94-44c2-98d1-22e5f8da9f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:54.787311 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f1451-5d94-44c2-98d1-22e5f8da9f55 admin admin] PATH_INFO: `/v3/projects/098fe6560a2c45daaf3596b6258a3b64/users/f97aaa5a8c404b10b0a861df291fd82b/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:54.809571 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f1451-5d94-44c2-98d1-22e5f8da9f55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=098fe6560a2c45daaf3596b6258a3b64, user_id=f97aaa5a8c404b10b0a861df291fd82b, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:54.813956 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f1451-5d94-44c2-98d1-22e5f8da9f55 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:54.869492 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 907/1819] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:50:54 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:54.869492 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf351f0-dc2e-4728-8ea7-6bb6ea0adee2 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:54.896173 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:54.904430 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 913/1820] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:54 2022] PUT /identity/v3/projects/098fe6560a2c45daaf3596b6258a3b64/users/f97aaa5a8c404b10b0a861df291fd82b/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:54.905398 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f1451-5d94-44c2-98d1-22e5f8da9f55 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:55.011495 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f1451-5d94-44c2-98d1-22e5f8da9f55 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:55.021028 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727d673-36fd-4975-a519-53e234018808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:55.022330 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727d673-36fd-4975-a519-53e234018808 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:55.022797 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727d673-36fd-4975-a519-53e234018808 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:55.023473 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727d673-36fd-4975-a519-53e234018808 admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:55.024771 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727d673-36fd-4975-a519-53e234018808 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:55.025806 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf351f0-dc2e-4728-8ea7-6bb6ea0adee2 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:55.028235 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727d673-36fd-4975-a519-53e234018808 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:55.035093 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465e793-66f1-460c-85c3-3ee0d64fcf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:55.036337 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465e793-66f1-460c-85c3-3ee0d64fcf82 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:55.036898 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465e793-66f1-460c-85c3-3ee0d64fcf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:55.037446 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465e793-66f1-460c-85c3-3ee0d64fcf82 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:55.038911 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465e793-66f1-460c-85c3-3ee0d64fcf82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:55.042365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465e793-66f1-460c-85c3-3ee0d64fcf82 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:55.126944 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 914/1821] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:50:54 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:55.127702 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727d673-36fd-4975-a519-53e234018808 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:55.139366 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727d673-36fd-4975-a519-53e234018808 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:55.145260 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269b24e-7f6a-4a06-86fb-0ad58ef11315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:55.146100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269b24e-7f6a-4a06-86fb-0ad58ef11315 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:55.146507 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269b24e-7f6a-4a06-86fb-0ad58ef11315 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:55.146877 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269b24e-7f6a-4a06-86fb-0ad58ef11315 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:55.147963 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269b24e-7f6a-4a06-86fb-0ad58ef11315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:55.150777 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269b24e-7f6a-4a06-86fb-0ad58ef11315 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:55.157662 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 908/1822] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:50:54 2022] POST /identity/v3/projects => generated 365 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:55.159406 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465e793-66f1-460c-85c3-3ee0d64fcf82 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:55.174267 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 915/1823] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:55.174267 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269b24e-7f6a-4a06-86fb-0ad58ef11315 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:55.193097 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269b24e-7f6a-4a06-86fb-0ad58ef11315 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:55.244515 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465e793-66f1-460c-85c3-3ee0d64fcf82 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:55.250149 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f6c1a-570a-4c50-9196-40c3e0c2c4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:55.250926 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f6c1a-570a-4c50-9196-40c3e0c2c4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:55.251329 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f6c1a-570a-4c50-9196-40c3e0c2c4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:55.252309 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f6c1a-570a-4c50-9196-40c3e0c2c4a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:55.253171 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f6c1a-570a-4c50-9196-40c3e0c2c4a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:55.255039 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f6c1a-570a-4c50-9196-40c3e0c2c4a0 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:55.268485 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 909/1824] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:55.269725 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f6c1a-570a-4c50-9196-40c3e0c2c4a0 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:55.282119 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f6c1a-570a-4c50-9196-40c3e0c2c4a0 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:55.289758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6df77-86ee-4e88-a81f-c6edfb937dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:55.291069 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9477f15-3089-4369-a251-036ff38a33e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:55.291335 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6df77-86ee-4e88-a81f-c6edfb937dae admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:55.291710 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6df77-86ee-4e88-a81f-c6edfb937dae admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:55.292102 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9477f15-3089-4369-a251-036ff38a33e7 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:55.292284 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6df77-86ee-4e88-a81f-c6edfb937dae admin admin] PATH_INFO: `/v3/projects/098fe6560a2c45daaf3596b6258a3b64/users/f97aaa5a8c404b10b0a861df291fd82b/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:55.292560 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9477f15-3089-4369-a251-036ff38a33e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:55.292928 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9477f15-3089-4369-a251-036ff38a33e7 admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:55.293817 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9477f15-3089-4369-a251-036ff38a33e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:55.295491 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6df77-86ee-4e88-a81f-c6edfb937dae admin admin] RBAC: Authorizing `identity:create_grant(project_id=098fe6560a2c45daaf3596b6258a3b64, user_id=f97aaa5a8c404b10b0a861df291fd82b, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:55.296241 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9477f15-3089-4369-a251-036ff38a33e7 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:55.300992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6df77-86ee-4e88-a81f-c6edfb937dae admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:55.320178 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 910/1825] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:55 2022] PUT /identity/v3/projects/098fe6560a2c45daaf3596b6258a3b64/users/f97aaa5a8c404b10b0a861df291fd82b/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:55.321525 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6df77-86ee-4e88-a81f-c6edfb937dae admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:55.393941 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 916/1826] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:50:55 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:55.396015 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9bd6c-4257-4143-9aa7-46990e1b4e66 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:55.396682 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9bd6c-4257-4143-9aa7-46990e1b4e66 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:55.397510 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9bd6c-4257-4143-9aa7-46990e1b4e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:55.436444 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6df77-86ee-4e88-a81f-c6edfb937dae admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:55.445154 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00477176-3904-40d6-941d-2c3c85e97edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:55.446330 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00477176-3904-40d6-941d-2c3c85e97edd admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:55.446798 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00477176-3904-40d6-941d-2c3c85e97edd admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:55.447252 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00477176-3904-40d6-941d-2c3c85e97edd admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:55.447707 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-87a9bd6c-4257-4143-9aa7-46990e1b4e66 None None] MFA Rules not processed for user `f97aaa5a8c404b10b0a861df291fd82b`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:55.448572 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00477176-3904-40d6-941d-2c3c85e97edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:55.449534 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-87a9bd6c-4257-4143-9aa7-46990e1b4e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:55.451312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00477176-3904-40d6-941d-2c3c85e97edd admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:55.471684 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 911/1827] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:55.473611 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00477176-3904-40d6-941d-2c3c85e97edd admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:55.494097 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00477176-3904-40d6-941d-2c3c85e97edd admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:55.504799 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695d4e8-9c72-49cc-943b-6c31456b73a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:55.509969 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695d4e8-9c72-49cc-943b-6c31456b73a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:55.509969 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695d4e8-9c72-49cc-943b-6c31456b73a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:55.509969 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695d4e8-9c72-49cc-943b-6c31456b73a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:55.509969 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8695d4e8-9c72-49cc-943b-6c31456b73a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:55.512566 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8695d4e8-9c72-49cc-943b-6c31456b73a2 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:55.528899 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 912/1828] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:55.530575 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695d4e8-9c72-49cc-943b-6c31456b73a2 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:55.547777 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695d4e8-9c72-49cc-943b-6c31456b73a2 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:55.559090 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2255f-b6f8-46a3-a222-debf53017053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:55.560974 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2255f-b6f8-46a3-a222-debf53017053 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:55.561662 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2255f-b6f8-46a3-a222-debf53017053 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:55.562163 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2255f-b6f8-46a3-a222-debf53017053 admin admin] PATH_INFO: `/v3/projects/54773ddf1fe14d739c665a472784c0f8/users/832796e6769449159084be26f39f13ec/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:55.588991 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 917/1829] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:55 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:55.590332 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9bd6c-4257-4143-9aa7-46990e1b4e66 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:55.593250 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2255f-b6f8-46a3-a222-debf53017053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54773ddf1fe14d739c665a472784c0f8, user_id=832796e6769449159084be26f39f13ec, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:55.603598 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2255f-b6f8-46a3-a222-debf53017053 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:55.638314 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9bd6c-4257-4143-9aa7-46990e1b4e66 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:55.646314 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3eecd-bef8-4dc6-b5f4-aa035b20385d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:55.647785 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3eecd-bef8-4dc6-b5f4-aa035b20385d admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:55.648342 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3eecd-bef8-4dc6-b5f4-aa035b20385d admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:55.648875 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3eecd-bef8-4dc6-b5f4-aa035b20385d admin admin] PATH_INFO: `/v3/projects/3af62983d09c44acb2ceda34341d7172/users/43e6b77a18654b4899ec29717d7b631e/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:55.674211 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3eecd-bef8-4dc6-b5f4-aa035b20385d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3af62983d09c44acb2ceda34341d7172, user_id=43e6b77a18654b4899ec29717d7b631e, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:55.679642 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3eecd-bef8-4dc6-b5f4-aa035b20385d admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:55.683216 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 913/1830] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:55 2022] PUT /identity/v3/projects/54773ddf1fe14d739c665a472784c0f8/users/832796e6769449159084be26f39f13ec/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:55.691510 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2255f-b6f8-46a3-a222-debf53017053 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:55.691510 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d0a2255f-b6f8-46a3-a222-debf53017053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:55.697697 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:55.763980 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 918/1831] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:55 2022] PUT /identity/v3/projects/3af62983d09c44acb2ceda34341d7172/users/43e6b77a18654b4899ec29717d7b631e/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:55.766160 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89183d0-040a-4c63-b142-cfdc41aedb0e None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:55.766701 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89183d0-040a-4c63-b142-cfdc41aedb0e None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:55.767171 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89183d0-040a-4c63-b142-cfdc41aedb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:55.774659 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2255f-b6f8-46a3-a222-debf53017053 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:55.793194 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:55.807200 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-b89183d0-040a-4c63-b142-cfdc41aedb0e None None] MFA Rules not processed for user `832796e6769449159084be26f39f13ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:55.809240 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-b89183d0-040a-4c63-b142-cfdc41aedb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:55.842649 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630baad-deac-4d5e-9766-c4a2c33b4361 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:55.842649 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630baad-deac-4d5e-9766-c4a2c33b4361 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:55.842649 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630baad-deac-4d5e-9766-c4a2c33b4361 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:55.842649 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630baad-deac-4d5e-9766-c4a2c33b4361 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:55.902284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 919/1832] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:55.904939 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89183d0-040a-4c63-b142-cfdc41aedb0e None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:55.950957 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630baad-deac-4d5e-9766-c4a2c33b4361 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:55.963767 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630baad-deac-4d5e-9766-c4a2c33b4361 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:55.966734 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 914/1833] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:55 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:55.968274 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630baad-deac-4d5e-9766-c4a2c33b4361 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:55.982169 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:56.039378 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89183d0-040a-4c63-b142-cfdc41aedb0e None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:56.042929 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630baad-deac-4d5e-9766-c4a2c33b4361 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:56.048272 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a3330-2a8f-4b74-bbbb-29fb6531bb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:56.049944 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a3330-2a8f-4b74-bbbb-29fb6531bb93 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:56.050415 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a3330-2a8f-4b74-bbbb-29fb6531bb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:56.050867 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a3330-2a8f-4b74-bbbb-29fb6531bb93 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:56.051748 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a3330-2a8f-4b74-bbbb-29fb6531bb93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:56.054644 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a3330-2a8f-4b74-bbbb-29fb6531bb93 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:56.061529 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e175d4-c5f8-4e3b-9b3a-db2214590305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:56.062331 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e175d4-c5f8-4e3b-9b3a-db2214590305 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:56.062777 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e175d4-c5f8-4e3b-9b3a-db2214590305 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:56.063243 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e175d4-c5f8-4e3b-9b3a-db2214590305 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:56.064460 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e175d4-c5f8-4e3b-9b3a-db2214590305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:56.069472 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e175d4-c5f8-4e3b-9b3a-db2214590305 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:56.077295 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 920/1834] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:50:56.083710 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a3330-2a8f-4b74-bbbb-29fb6531bb93 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:56.098771 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a3330-2a8f-4b74-bbbb-29fb6531bb93 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:56.105394 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4ae4c-a07f-44bb-8a8b-bb0c8196b92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:56.106410 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4ae4c-a07f-44bb-8a8b-bb0c8196b92c admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:56.106908 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4ae4c-a07f-44bb-8a8b-bb0c8196b92c admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:56.107287 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4ae4c-a07f-44bb-8a8b-bb0c8196b92c admin admin] PATH_INFO: `/v3/projects/3af62983d09c44acb2ceda34341d7172/users/43e6b77a18654b4899ec29717d7b631e/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:56.109660 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4ae4c-a07f-44bb-8a8b-bb0c8196b92c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3af62983d09c44acb2ceda34341d7172, user_id=43e6b77a18654b4899ec29717d7b631e, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:56.113738 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4ae4c-a07f-44bb-8a8b-bb0c8196b92c admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:56.128242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 921/1835] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:56 2022] PUT /identity/v3/projects/3af62983d09c44acb2ceda34341d7172/users/43e6b77a18654b4899ec29717d7b631e/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:50:56.148902 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60adc94f-7c86-410a-b12e-ab49f5d8849b None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:56.149339 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60adc94f-7c86-410a-b12e-ab49f5d8849b None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:56.150324 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60adc94f-7c86-410a-b12e-ab49f5d8849b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:56.197969 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 915/1836] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:50:55 2022] POST /identity/v3/projects => generated 385 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:56.199868 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e175d4-c5f8-4e3b-9b3a-db2214590305 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:56.217706 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-60adc94f-7c86-410a-b12e-ab49f5d8849b None None] MFA Rules not processed for user `43e6b77a18654b4899ec29717d7b631e`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:56.219075 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-60adc94f-7c86-410a-b12e-ab49f5d8849b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:56.298102 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e175d4-c5f8-4e3b-9b3a-db2214590305 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:56.303967 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df780082-8085-47a8-bdcf-f2af37125900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:56.306735 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df780082-8085-47a8-bdcf-f2af37125900 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:56.306735 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df780082-8085-47a8-bdcf-f2af37125900 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:56.306735 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df780082-8085-47a8-bdcf-f2af37125900 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:56.306735 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df780082-8085-47a8-bdcf-f2af37125900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:56.307957 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df780082-8085-47a8-bdcf-f2af37125900 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:56.318774 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 922/1837] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:56 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:56.319889 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60adc94f-7c86-410a-b12e-ab49f5d8849b None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:56.376300 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60adc94f-7c86-410a-b12e-ab49f5d8849b None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:56.380809 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66529e32-74a6-4a3f-8c16-7bca0aebc1fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:56.381454 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66529e32-74a6-4a3f-8c16-7bca0aebc1fd service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:56.381744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66529e32-74a6-4a3f-8c16-7bca0aebc1fd service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:56.382041 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66529e32-74a6-4a3f-8c16-7bca0aebc1fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:56.383957 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-66529e32-74a6-4a3f-8c16-7bca0aebc1fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:56.412538 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 916/1838] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:50:56 2022] POST /identity/v3/users => generated 299 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:50:56.412538 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df780082-8085-47a8-bdcf-f2af37125900 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:56.422695 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df780082-8085-47a8-bdcf-f2af37125900 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:56.427999 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a411e9-12d0-4729-8ee6-2347cf79fafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:56.428679 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a411e9-12d0-4729-8ee6-2347cf79fafd admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:56.431691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a411e9-12d0-4729-8ee6-2347cf79fafd admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:56.431691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a411e9-12d0-4729-8ee6-2347cf79fafd admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:56.431691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a411e9-12d0-4729-8ee6-2347cf79fafd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:56.431942 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a411e9-12d0-4729-8ee6-2347cf79fafd admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:56.444049 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 917/1839] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:50:56.447014 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66529e32-74a6-4a3f-8c16-7bca0aebc1fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:56.448200 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a411e9-12d0-4729-8ee6-2347cf79fafd admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:56.448575 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66529e32-74a6-4a3f-8c16-7bca0aebc1fd service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:56.458369 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 923/1840] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:56.458934 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a411e9-12d0-4729-8ee6-2347cf79fafd admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:56.464074 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab784b1-e7fa-4af8-862e-e21ad392f48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:56.464962 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab784b1-e7fa-4af8-862e-e21ad392f48b admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:56.465245 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab784b1-e7fa-4af8-862e-e21ad392f48b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:56.465521 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab784b1-e7fa-4af8-862e-e21ad392f48b admin admin] PATH_INFO: `/v3/projects/807e3b1516b845958beb90062121dbd9/users/572976aab66e4323aa439781a50d2bf0/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:56.481940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab784b1-e7fa-4af8-862e-e21ad392f48b admin admin] RBAC: Authorizing `identity:create_grant(project_id=807e3b1516b845958beb90062121dbd9, user_id=572976aab66e4323aa439781a50d2bf0, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:56.484712 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab784b1-e7fa-4af8-862e-e21ad392f48b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:56.589548 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 918/1841] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:56 2022] PUT /identity/v3/projects/807e3b1516b845958beb90062121dbd9/users/572976aab66e4323aa439781a50d2bf0/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:50:56.593601 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66529e32-74a6-4a3f-8c16-7bca0aebc1fd service cinder] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:56.604478 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66529e32-74a6-4a3f-8c16-7bca0aebc1fd service cinder] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:56.671495 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab784b1-e7fa-4af8-862e-e21ad392f48b admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:56.674738 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-eab784b1-e7fa-4af8-862e-e21ad392f48b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:56.684414 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d05ec6-8207-45a8-b4cc-36d96e646cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:56.685091 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d05ec6-8207-45a8-b4cc-36d96e646cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:56.685372 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d05ec6-8207-45a8-b4cc-36d96e646cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:56.685649 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d05ec6-8207-45a8-b4cc-36d96e646cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:56.686427 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d05ec6-8207-45a8-b4cc-36d96e646cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:56.688098 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d05ec6-8207-45a8-b4cc-36d96e646cf1 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:56.703443 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 924/1842] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:50:56.704990 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d05ec6-8207-45a8-b4cc-36d96e646cf1 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:56.722199 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d05ec6-8207-45a8-b4cc-36d96e646cf1 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:56.723553 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d26fd5-eb96-4be0-9f6c-cbb1bd1957d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:56.724497 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d26fd5-eb96-4be0-9f6c-cbb1bd1957d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:56.724781 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d26fd5-eb96-4be0-9f6c-cbb1bd1957d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:56.725061 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d26fd5-eb96-4be0-9f6c-cbb1bd1957d7 admin admin] PATH_INFO: `/v3/projects/807e3b1516b845958beb90062121dbd9/users/572976aab66e4323aa439781a50d2bf0/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:56.727133 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d26fd5-eb96-4be0-9f6c-cbb1bd1957d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=807e3b1516b845958beb90062121dbd9, user_id=572976aab66e4323aa439781a50d2bf0, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:56.730066 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d26fd5-eb96-4be0-9f6c-cbb1bd1957d7 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:56.741616 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 925/1843] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:50:56 2022] PUT /identity/v3/projects/807e3b1516b845958beb90062121dbd9/users/572976aab66e4323aa439781a50d2bf0/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:56.753156 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d4b88-51a4-433c-b466-58e9257f8a01 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:56.756912 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d4b88-51a4-433c-b466-58e9257f8a01 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:56.756912 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d4b88-51a4-433c-b466-58e9257f8a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:56.768787 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab784b1-e7fa-4af8-862e-e21ad392f48b admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:56.789319 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-212d4b88-51a4-433c-b466-58e9257f8a01 None None] MFA Rules not processed for user `572976aab66e4323aa439781a50d2bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:56.790655 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-212d4b88-51a4-433c-b466-58e9257f8a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:56.846891 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d5209-671e-4c68-a54b-f5d04cb3a380 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:56.847557 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d5209-671e-4c68-a54b-f5d04cb3a380 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:56.847882 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d5209-671e-4c68-a54b-f5d04cb3a380 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:56.848168 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d5209-671e-4c68-a54b-f5d04cb3a380 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:56.896193 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 926/1844] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:50:56.916639 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d5209-671e-4c68-a54b-f5d04cb3a380 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:56.918244 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d5209-671e-4c68-a54b-f5d04cb3a380 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:56.929048 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 919/1845] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:56 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:56.966398 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:57.054678 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d4b88-51a4-433c-b466-58e9257f8a01 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:57.064751 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d4b88-51a4-433c-b466-58e9257f8a01 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:57.068630 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4932c7-231e-490b-b466-1b2e6af36b6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:57.069267 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:57.070108 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4932c7-231e-490b-b466-1b2e6af36b6b service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:57.070394 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4932c7-231e-490b-b466-1b2e6af36b6b service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:57.070674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4932c7-231e-490b-b466-1b2e6af36b6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:57.082791 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4932c7-231e-490b-b466-1b2e6af36b6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:57.084570 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4932c7-231e-490b-b466-1b2e6af36b6b service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:57.096647 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 927/1846] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:57.163110 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d5209-671e-4c68-a54b-f5d04cb3a380 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:57.171804 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d5209-671e-4c68-a54b-f5d04cb3a380 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:57.180484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6d06a-0d39-4477-a083-c6b67646a785 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:57.180484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6d06a-0d39-4477-a083-c6b67646a785 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:57.180484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6d06a-0d39-4477-a083-c6b67646a785 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:57.180484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6d06a-0d39-4477-a083-c6b67646a785 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:57.243576 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6d06a-0d39-4477-a083-c6b67646a785 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:57.245128 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6d06a-0d39-4477-a083-c6b67646a785 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:57.256403 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 920/1847] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:57 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:50:57.986884 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:58.589675 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:58.874748 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4932c7-231e-490b-b466-1b2e6af36b6b service cinder] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:58.914874 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:58.956145 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4932c7-231e-490b-b466-1b2e6af36b6b service cinder] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:58.956145 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aecfa5-9e11-477c-9e86-d70d9547e6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:58.956145 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aecfa5-9e11-477c-9e86-d70d9547e6fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:58.956145 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aecfa5-9e11-477c-9e86-d70d9547e6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:58.956487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aecfa5-9e11-477c-9e86-d70d9547e6fe admin admin] PATH_INFO: `/v3/users/832796e6769449159084be26f39f13ec` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:58.956487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aecfa5-9e11-477c-9e86-d70d9547e6fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=832796e6769449159084be26f39f13ec)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:58.956487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aecfa5-9e11-477c-9e86-d70d9547e6fe admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:59.203305 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-01aecfa5-9e11-477c-9e86-d70d9547e6fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '832796e6769449159084be26f39f13ec'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:59.204065 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-01aecfa5-9e11-477c-9e86-d70d9547e6fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '832796e6769449159084be26f39f13ec'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:59.205135 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-01aecfa5-9e11-477c-9e86-d70d9547e6fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '832796e6769449159084be26f39f13ec'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:59.214200 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-01aecfa5-9e11-477c-9e86-d70d9547e6fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '832796e6769449159084be26f39f13ec'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:59.297399 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-01aecfa5-9e11-477c-9e86-d70d9547e6fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '832796e6769449159084be26f39f13ec'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:50:59.317449 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 928/1848] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:50:58 2022] DELETE /identity/v3/users/832796e6769449159084be26f39f13ec => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:50:59.322634 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500b434-0407-4e78-a6ee-c0606d92b918 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:59.323000 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500b434-0407-4e78-a6ee-c0606d92b918 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:59.323350 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500b434-0407-4e78-a6ee-c0606d92b918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:59.350184 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-8500b434-0407-4e78-a6ee-c0606d92b918 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:50:59.351594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-8500b434-0407-4e78-a6ee-c0606d92b918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:59.409483 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:50:59.438826 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 921/1849] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:50:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:50:59.451033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aecfa5-9e11-477c-9e86-d70d9547e6fe admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:50:59.452756 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-01aecfa5-9e11-477c-9e86-d70d9547e6fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:50:59.517337 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aecfa5-9e11-477c-9e86-d70d9547e6fe admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:50:59.521522 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250e6a4-8076-4663-8d7e-fd9913ad9b84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:50:59.522202 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250e6a4-8076-4663-8d7e-fd9913ad9b84 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:50:59.522499 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250e6a4-8076-4663-8d7e-fd9913ad9b84 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:50:59.522759 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250e6a4-8076-4663-8d7e-fd9913ad9b84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:50:59.541114 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250e6a4-8076-4663-8d7e-fd9913ad9b84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:50:59.542728 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250e6a4-8076-4663-8d7e-fd9913ad9b84 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:50:59.561254 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 929/1850] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:50:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:51:00.082741 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500b434-0407-4e78-a6ee-c0606d92b918 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:00.084235 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-8500b434-0407-4e78-a6ee-c0606d92b918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:00.096303 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500b434-0407-4e78-a6ee-c0606d92b918 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:00.101493 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8f9dc-f989-4b85-acf3-7e20f321d411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:00.102328 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8f9dc-f989-4b85-acf3-7e20f321d411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:00.102614 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8f9dc-f989-4b85-acf3-7e20f321d411 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:00.102890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8f9dc-f989-4b85-acf3-7e20f321d411 admin admin] PATH_INFO: `/v3/projects/54773ddf1fe14d739c665a472784c0f8` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:00.104121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8f9dc-f989-4b85-acf3-7e20f321d411 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54773ddf1fe14d739c665a472784c0f8)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:00.106033 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8f9dc-f989-4b85-acf3-7e20f321d411 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:00.206351 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:00.279700 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f7f8f9dc-f989-4b85-acf3-7e20f321d411 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54773ddf1fe14d739c665a472784c0f8', 'request_id': 'req-f7f8f9dc-f989-4b85-acf3-7e20f321d411'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:00.287333 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f7f8f9dc-f989-4b85-acf3-7e20f321d411 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54773ddf1fe14d739c665a472784c0f8', 'request_id': 'req-f7f8f9dc-f989-4b85-acf3-7e20f321d411'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:00.294022 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f7f8f9dc-f989-4b85-acf3-7e20f321d411 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54773ddf1fe14d739c665a472784c0f8', 'request_id': 'req-f7f8f9dc-f989-4b85-acf3-7e20f321d411'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:00.407631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f7f8f9dc-f989-4b85-acf3-7e20f321d411 admin admin] The token cache is being invalidate because project 54773ddf1fe14d739c665a472784c0f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:51:00.407977 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f7f8f9dc-f989-4b85-acf3-7e20f321d411 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:00.416454 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f7f8f9dc-f989-4b85-acf3-7e20f321d411 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:00.418628 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 922/1851] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:51:00 2022] DELETE /identity/v3/projects/54773ddf1fe14d739c665a472784c0f8 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:00.422393 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250e6a4-8076-4663-8d7e-fd9913ad9b84 service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:00.432740 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250e6a4-8076-4663-8d7e-fd9913ad9b84 service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:00.498724 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:00.509207 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a776e-e7a7-40e9-9038-36613e03f4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:00.510110 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a776e-e7a7-40e9-9038-36613e03f4ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:00.510392 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a776e-e7a7-40e9-9038-36613e03f4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:00.510696 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a776e-e7a7-40e9-9038-36613e03f4ce admin admin] PATH_INFO: `/v3/users/572976aab66e4323aa439781a50d2bf0` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:00.511974 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a776e-e7a7-40e9-9038-36613e03f4ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=572976aab66e4323aa439781a50d2bf0)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:00.513878 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a776e-e7a7-40e9-9038-36613e03f4ce admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:00.682996 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-c45a776e-e7a7-40e9-9038-36613e03f4ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '572976aab66e4323aa439781a50d2bf0'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:00.683848 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-c45a776e-e7a7-40e9-9038-36613e03f4ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '572976aab66e4323aa439781a50d2bf0'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:00.684514 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-c45a776e-e7a7-40e9-9038-36613e03f4ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '572976aab66e4323aa439781a50d2bf0'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:00.692730 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-c45a776e-e7a7-40e9-9038-36613e03f4ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '572976aab66e4323aa439781a50d2bf0'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:00.805766 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-c45a776e-e7a7-40e9-9038-36613e03f4ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '572976aab66e4323aa439781a50d2bf0'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:00.824574 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 930/1852] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:51:00 2022] DELETE /identity/v3/users/572976aab66e4323aa439781a50d2bf0 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:01.089319 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:01.299153 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8f9dc-f989-4b85-acf3-7e20f321d411 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:01.301474 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f7f8f9dc-f989-4b85-acf3-7e20f321d411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:01.318997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8f9dc-f989-4b85-acf3-7e20f321d411 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:01.345855 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a776e-e7a7-40e9-9038-36613e03f4ce admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:01.348169 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-c45a776e-e7a7-40e9-9038-36613e03f4ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:01.376371 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f734e73-9733-4f70-9c8a-7b581185d578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:01.377540 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f734e73-9733-4f70-9c8a-7b581185d578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:01.377826 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f734e73-9733-4f70-9c8a-7b581185d578 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:01.378140 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f734e73-9733-4f70-9c8a-7b581185d578 admin admin] PATH_INFO: `/v3/projects/807e3b1516b845958beb90062121dbd9` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:01.379376 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f734e73-9733-4f70-9c8a-7b581185d578 admin admin] RBAC: Authorizing `identity:delete_project(project_id=807e3b1516b845958beb90062121dbd9)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:01.381445 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f734e73-9733-4f70-9c8a-7b581185d578 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:01.414918 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a776e-e7a7-40e9-9038-36613e03f4ce admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:01.419638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813098d-9e3c-443c-a46d-517193388ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:01.420528 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813098d-9e3c-443c-a46d-517193388ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:01.420815 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813098d-9e3c-443c-a46d-517193388ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:01.421125 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813098d-9e3c-443c-a46d-517193388ef0 admin admin] PATH_INFO: `/v3/users/a09cbd90d8a2438c8751186473154ea4` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:01.422310 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5813098d-9e3c-443c-a46d-517193388ef0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a09cbd90d8a2438c8751186473154ea4)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:01.424291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5813098d-9e3c-443c-a46d-517193388ef0 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:01.492310 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6f734e73-9733-4f70-9c8a-7b581185d578 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '807e3b1516b845958beb90062121dbd9', 'request_id': 'req-6f734e73-9733-4f70-9c8a-7b581185d578'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:01.498805 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6f734e73-9733-4f70-9c8a-7b581185d578 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '807e3b1516b845958beb90062121dbd9', 'request_id': 'req-6f734e73-9733-4f70-9c8a-7b581185d578'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:01.505416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6f734e73-9733-4f70-9c8a-7b581185d578 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '807e3b1516b845958beb90062121dbd9', 'request_id': 'req-6f734e73-9733-4f70-9c8a-7b581185d578'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:01.560013 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6f734e73-9733-4f70-9c8a-7b581185d578 admin admin] The token cache is being invalidate because project 807e3b1516b845958beb90062121dbd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:51:01.560300 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6f734e73-9733-4f70-9c8a-7b581185d578 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:01.561132 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6f734e73-9733-4f70-9c8a-7b581185d578 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:01.562914 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 923/1853] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:51:01 2022] DELETE /identity/v3/projects/807e3b1516b845958beb90062121dbd9 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:01.569631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446eb9e6-b089-4950-81de-dc1eb27b1d90 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:01.570696 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446eb9e6-b089-4950-81de-dc1eb27b1d90 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:01.570982 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446eb9e6-b089-4950-81de-dc1eb27b1d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:01.573523 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5813098d-9e3c-443c-a46d-517193388ef0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a09cbd90d8a2438c8751186473154ea4'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:01.574268 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5813098d-9e3c-443c-a46d-517193388ef0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a09cbd90d8a2438c8751186473154ea4'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:01.575027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5813098d-9e3c-443c-a46d-517193388ef0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a09cbd90d8a2438c8751186473154ea4'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:01.584035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5813098d-9e3c-443c-a46d-517193388ef0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a09cbd90d8a2438c8751186473154ea4'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:01.594291 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-446eb9e6-b089-4950-81de-dc1eb27b1d90 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:01.595512 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-446eb9e6-b089-4950-81de-dc1eb27b1d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:01.606118 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:01.651146 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5813098d-9e3c-443c-a46d-517193388ef0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a09cbd90d8a2438c8751186473154ea4'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:01.662616 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 924/1854] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:01.670280 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff6dea-e5ae-4901-92d2-a032aa3581e7 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:01.670750 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff6dea-e5ae-4901-92d2-a032aa3581e7 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:01.671043 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff6dea-e5ae-4901-92d2-a032aa3581e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:01.671967 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:01.693710 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 931/1855] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:51:01 2022] DELETE /identity/v3/users/a09cbd90d8a2438c8751186473154ea4 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:51:01.699140 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dfa47-e91c-48c9-8d3a-35dec6b56725 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:01.699140 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dfa47-e91c-48c9-8d3a-35dec6b56725 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:01.699140 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dfa47-e91c-48c9-8d3a-35dec6b56725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:01.700278 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-0aff6dea-e5ae-4901-92d2-a032aa3581e7 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:01.701519 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0aff6dea-e5ae-4901-92d2-a032aa3581e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:01.719939 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-993dfa47-e91c-48c9-8d3a-35dec6b56725 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:01.721236 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-993dfa47-e91c-48c9-8d3a-35dec6b56725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:01.768512 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 925/1856] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:51:01.772919 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff6dea-e5ae-4901-92d2-a032aa3581e7 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:01.783568 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff6dea-e5ae-4901-92d2-a032aa3581e7 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:01.793135 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 932/1857] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:01.793338 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351ca89-92fd-4fb3-883e-8d49901bcde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:01.793338 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351ca89-92fd-4fb3-883e-8d49901bcde8 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:01.793338 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351ca89-92fd-4fb3-883e-8d49901bcde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:01.793338 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351ca89-92fd-4fb3-883e-8d49901bcde8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:01.793665 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a351ca89-92fd-4fb3-883e-8d49901bcde8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:51:01.793665 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a351ca89-92fd-4fb3-883e-8d49901bcde8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:01.794062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a351ca89-92fd-4fb3-883e-8d49901bcde8 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:01.800913 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dfa47-e91c-48c9-8d3a-35dec6b56725 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:01.802922 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-993dfa47-e91c-48c9-8d3a-35dec6b56725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:01.809183 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 926/1858] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:51:01.813194 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351ca89-92fd-4fb3-883e-8d49901bcde8 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:01.832121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351ca89-92fd-4fb3-883e-8d49901bcde8 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:01.833351 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48aba62-09db-45f1-9f30-151ebc1ae407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:01.834010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48aba62-09db-45f1-9f30-151ebc1ae407 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:01.834293 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48aba62-09db-45f1-9f30-151ebc1ae407 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:01.834624 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48aba62-09db-45f1-9f30-151ebc1ae407 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:01.835351 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48aba62-09db-45f1-9f30-151ebc1ae407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:01.837354 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48aba62-09db-45f1-9f30-151ebc1ae407 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:01.863749 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dfa47-e91c-48c9-8d3a-35dec6b56725 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:01.867869 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4eb1f-9af5-4029-b977-4051a3595bfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:01.868544 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4eb1f-9af5-4029-b977-4051a3595bfa service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:01.868829 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4eb1f-9af5-4029-b977-4051a3595bfa service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:01.869136 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4eb1f-9af5-4029-b977-4051a3595bfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:01.878209 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4eb1f-9af5-4029-b977-4051a3595bfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:01.879673 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4eb1f-9af5-4029-b977-4051a3595bfa service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:01.889266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 933/1859] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:51:01.920387 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 927/1860] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:51:01 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:51:01.922054 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4eb1f-9af5-4029-b977-4051a3595bfa service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:01.934177 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4eb1f-9af5-4029-b977-4051a3595bfa service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:02.002327 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b2221-b0b9-4cba-a554-987c55a6d4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:02.003043 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b2221-b0b9-4cba-a554-987c55a6d4d0 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:02.003425 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b2221-b0b9-4cba-a554-987c55a6d4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:02.003724 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b2221-b0b9-4cba-a554-987c55a6d4d0 admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:02.004444 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b2221-b0b9-4cba-a554-987c55a6d4d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:02.006401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b2221-b0b9-4cba-a554-987c55a6d4d0 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:02.102704 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 934/1861] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:51:01 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:02.106542 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48aba62-09db-45f1-9f30-151ebc1ae407 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:02.131476 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48aba62-09db-45f1-9f30-151ebc1ae407 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:02.139022 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a5d6e-7d08-4db2-be93-379404fce69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:02.139752 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a5d6e-7d08-4db2-be93-379404fce69e admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:02.140193 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a5d6e-7d08-4db2-be93-379404fce69e admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:02.140640 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a5d6e-7d08-4db2-be93-379404fce69e admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:02.141735 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49a5d6e-7d08-4db2-be93-379404fce69e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:02.143637 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49a5d6e-7d08-4db2-be93-379404fce69e admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:02.155656 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 928/1862] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:51:02.160392 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b2221-b0b9-4cba-a554-987c55a6d4d0 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:02.171578 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b2221-b0b9-4cba-a554-987c55a6d4d0 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:02.176430 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd662e-45f1-4f62-9c57-9b6c5d9fa536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:02.177108 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd662e-45f1-4f62-9c57-9b6c5d9fa536 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:02.177415 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd662e-45f1-4f62-9c57-9b6c5d9fa536 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:02.177678 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd662e-45f1-4f62-9c57-9b6c5d9fa536 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:02.178455 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd662e-45f1-4f62-9c57-9b6c5d9fa536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:02.180134 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd662e-45f1-4f62-9c57-9b6c5d9fa536 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:02.196103 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 935/1863] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:51:02.197715 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a5d6e-7d08-4db2-be93-379404fce69e admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:02.212211 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a5d6e-7d08-4db2-be93-379404fce69e admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:02.223555 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a2e9a-3ea1-4d52-9c51-0db05fc24088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:02.226601 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:02.227939 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a2e9a-3ea1-4d52-9c51-0db05fc24088 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:02.227939 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a2e9a-3ea1-4d52-9c51-0db05fc24088 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:02.227939 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a2e9a-3ea1-4d52-9c51-0db05fc24088 admin admin] PATH_INFO: `/v3/projects/e8baf1d629994cdd83fee8248703768a/users/b8dc95bdb75d4a4b8e9a5337c80f9eaf/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:02.246551 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a2e9a-3ea1-4d52-9c51-0db05fc24088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8baf1d629994cdd83fee8248703768a, user_id=b8dc95bdb75d4a4b8e9a5337c80f9eaf, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:02.250969 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a2e9a-3ea1-4d52-9c51-0db05fc24088 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:02.333144 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 929/1864] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:51:02 2022] PUT /identity/v3/projects/e8baf1d629994cdd83fee8248703768a/users/b8dc95bdb75d4a4b8e9a5337c80f9eaf/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:02.334989 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79569bc7-fdb6-4083-bc08-3032e105ee28 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:02.335343 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79569bc7-fdb6-4083-bc08-3032e105ee28 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:02.335842 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79569bc7-fdb6-4083-bc08-3032e105ee28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:02.367082 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:02.370297 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-79569bc7-fdb6-4083-bc08-3032e105ee28 None None] MFA Rules not processed for user `b8dc95bdb75d4a4b8e9a5337c80f9eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:02.371759 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-79569bc7-fdb6-4083-bc08-3032e105ee28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:02.436551 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a2e9a-3ea1-4d52-9c51-0db05fc24088 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:02.438454 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-252a2e9a-3ea1-4d52-9c51-0db05fc24088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:02.439306 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 936/1865] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:02.451744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79569bc7-fdb6-4083-bc08-3032e105ee28 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:02.453113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-79569bc7-fdb6-4083-bc08-3032e105ee28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:02.509170 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a2e9a-3ea1-4d52-9c51-0db05fc24088 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:02.514353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eafebba-8c3a-41f0-a007-772f4a703a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:02.515397 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafebba-8c3a-41f0-a007-772f4a703a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:02.515534 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79569bc7-fdb6-4083-bc08-3032e105ee28 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:02.515721 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafebba-8c3a-41f0-a007-772f4a703a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:02.516006 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafebba-8c3a-41f0-a007-772f4a703a03 admin admin] PATH_INFO: `/v3/projects/c3c4c43e0d47442bb6669f2091d1dc6e` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:02.517330 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eafebba-8c3a-41f0-a007-772f4a703a03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3c4c43e0d47442bb6669f2091d1dc6e)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:02.519827 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eafebba-8c3a-41f0-a007-772f4a703a03 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:02.519975 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f9801-0774-4fbd-8397-422d3f328313 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:02.520993 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f9801-0774-4fbd-8397-422d3f328313 service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:02.521407 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f9801-0774-4fbd-8397-422d3f328313 service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:02.525273 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f9801-0774-4fbd-8397-422d3f328313 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:02.531963 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f9801-0774-4fbd-8397-422d3f328313 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:02.533411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f9801-0774-4fbd-8397-422d3f328313 service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:02.543139 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 937/1866] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:51:02.562800 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f9801-0774-4fbd-8397-422d3f328313 service cinder] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:02.573795 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f9801-0774-4fbd-8397-422d3f328313 service cinder] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:02.578558 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a39a7d-4d24-449a-8507-3689239b64c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:02.579422 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a39a7d-4d24-449a-8507-3689239b64c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:02.579751 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a39a7d-4d24-449a-8507-3689239b64c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:02.580034 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a39a7d-4d24-449a-8507-3689239b64c0 admin admin] PATH_INFO: `/v3/users/b8dc95bdb75d4a4b8e9a5337c80f9eaf` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:02.581773 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a39a7d-4d24-449a-8507-3689239b64c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8dc95bdb75d4a4b8e9a5337c80f9eaf)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:02.583821 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a39a7d-4d24-449a-8507-3689239b64c0 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:02.630070 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3eafebba-8c3a-41f0-a007-772f4a703a03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3c4c43e0d47442bb6669f2091d1dc6e', 'request_id': 'req-3eafebba-8c3a-41f0-a007-772f4a703a03'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:02.636478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3eafebba-8c3a-41f0-a007-772f4a703a03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3c4c43e0d47442bb6669f2091d1dc6e', 'request_id': 'req-3eafebba-8c3a-41f0-a007-772f4a703a03'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:02.642090 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3eafebba-8c3a-41f0-a007-772f4a703a03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3c4c43e0d47442bb6669f2091d1dc6e', 'request_id': 'req-3eafebba-8c3a-41f0-a007-772f4a703a03'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:02.737101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3eafebba-8c3a-41f0-a007-772f4a703a03 admin admin] The token cache is being invalidate because project c3c4c43e0d47442bb6669f2091d1dc6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:51:02.737378 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3eafebba-8c3a-41f0-a007-772f4a703a03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:02.739281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3eafebba-8c3a-41f0-a007-772f4a703a03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:02.740888 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 930/1867] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:51:02 2022] DELETE /identity/v3/projects/c3c4c43e0d47442bb6669f2091d1dc6e => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:02.744786 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eafebba-8c3a-41f0-a007-772f4a703a03 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:02.746186 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-3eafebba-8c3a-41f0-a007-772f4a703a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:02.763143 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:02.772703 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-e7a39a7d-4d24-449a-8507-3689239b64c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8dc95bdb75d4a4b8e9a5337c80f9eaf'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:02.773541 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-e7a39a7d-4d24-449a-8507-3689239b64c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8dc95bdb75d4a4b8e9a5337c80f9eaf'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:02.774321 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-e7a39a7d-4d24-449a-8507-3689239b64c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8dc95bdb75d4a4b8e9a5337c80f9eaf'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:02.782097 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-e7a39a7d-4d24-449a-8507-3689239b64c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8dc95bdb75d4a4b8e9a5337c80f9eaf'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:02.821406 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eafebba-8c3a-41f0-a007-772f4a703a03 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:02.825987 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431d72c-9436-4b7e-88fc-506566818693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:02.826861 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431d72c-9436-4b7e-88fc-506566818693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:02.827144 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431d72c-9436-4b7e-88fc-506566818693 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:02.827420 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431d72c-9436-4b7e-88fc-506566818693 admin admin] PATH_INFO: `/v3/users/43e6b77a18654b4899ec29717d7b631e` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:02.828666 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431d72c-9436-4b7e-88fc-506566818693 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43e6b77a18654b4899ec29717d7b631e)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:02.830605 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431d72c-9436-4b7e-88fc-506566818693 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:02.862746 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-e7a39a7d-4d24-449a-8507-3689239b64c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8dc95bdb75d4a4b8e9a5337c80f9eaf'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:02.881862 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 938/1868] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:51:02 2022] DELETE /identity/v3/users/b8dc95bdb75d4a4b8e9a5337c80f9eaf => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:51:02.886609 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5a443-1ebc-4c7a-9279-449ba9962661 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:02.886905 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5a443-1ebc-4c7a-9279-449ba9962661 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:02.887189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5a443-1ebc-4c7a-9279-449ba9962661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:02.907896 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-d1a5a443-1ebc-4c7a-9279-449ba9962661 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:02.909156 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-d1a5a443-1ebc-4c7a-9279-449ba9962661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:02.922628 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:02.971804 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 939/1869] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:51:02.982241 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5a443-1ebc-4c7a-9279-449ba9962661 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:02.983687 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-d1a5a443-1ebc-4c7a-9279-449ba9962661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:03.043793 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5a443-1ebc-4c7a-9279-449ba9962661 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:03.047507 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a98857-af97-422f-a6b9-567aa0a8817f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:03.048189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a98857-af97-422f-a6b9-567aa0a8817f service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:03.048475 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a98857-af97-422f-a6b9-567aa0a8817f service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:03.048755 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a98857-af97-422f-a6b9-567aa0a8817f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:03.049509 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6431d72c-9436-4b7e-88fc-506566818693 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43e6b77a18654b4899ec29717d7b631e'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:03.050761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6431d72c-9436-4b7e-88fc-506566818693 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43e6b77a18654b4899ec29717d7b631e'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:03.057927 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6431d72c-9436-4b7e-88fc-506566818693 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43e6b77a18654b4899ec29717d7b631e'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:03.058591 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6431d72c-9436-4b7e-88fc-506566818693 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43e6b77a18654b4899ec29717d7b631e'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:03.058953 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a98857-af97-422f-a6b9-567aa0a8817f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:03.060431 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a98857-af97-422f-a6b9-567aa0a8817f service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:03.070536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 940/1870] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:51:03.137560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6431d72c-9436-4b7e-88fc-506566818693 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43e6b77a18654b4899ec29717d7b631e'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:03.161330 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 931/1871] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:51:02 2022] DELETE /identity/v3/users/43e6b77a18654b4899ec29717d7b631e => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:51:03.808875 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a98857-af97-422f-a6b9-567aa0a8817f service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:03.812047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-67a98857-af97-422f-a6b9-567aa0a8817f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:03.821050 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431d72c-9436-4b7e-88fc-506566818693 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:03.822728 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6431d72c-9436-4b7e-88fc-506566818693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:03.835315 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a98857-af97-422f-a6b9-567aa0a8817f service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:03.935390 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431d72c-9436-4b7e-88fc-506566818693 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:03.936336 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f2b0e-e673-4eba-a40f-8052c0759791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:03.937437 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f2b0e-e673-4eba-a40f-8052c0759791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:03.937801 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f2b0e-e673-4eba-a40f-8052c0759791 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:03.938150 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f2b0e-e673-4eba-a40f-8052c0759791 admin admin] PATH_INFO: `/v3/projects/e8baf1d629994cdd83fee8248703768a` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:03.944276 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f2b0e-e673-4eba-a40f-8052c0759791 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8baf1d629994cdd83fee8248703768a)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:03.946235 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b4dab-b238-4fe4-9fd5-c3d9c83d5a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:03.951488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b4dab-b238-4fe4-9fd5-c3d9c83d5a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:03.951488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b4dab-b238-4fe4-9fd5-c3d9c83d5a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:03.951488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b4dab-b238-4fe4-9fd5-c3d9c83d5a0a admin admin] PATH_INFO: `/v3/projects/3af62983d09c44acb2ceda34341d7172` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:03.951488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b4dab-b238-4fe4-9fd5-c3d9c83d5a0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3af62983d09c44acb2ceda34341d7172)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:03.952121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f2b0e-e673-4eba-a40f-8052c0759791 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:03.952209 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b4dab-b238-4fe4-9fd5-c3d9c83d5a0a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:04.043512 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:04.054132 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-e44b4dab-b238-4fe4-9fd5-c3d9c83d5a0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3af62983d09c44acb2ceda34341d7172', 'request_id': 'req-e44b4dab-b238-4fe4-9fd5-c3d9c83d5a0a'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:04.060722 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-e44b4dab-b238-4fe4-9fd5-c3d9c83d5a0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3af62983d09c44acb2ceda34341d7172', 'request_id': 'req-e44b4dab-b238-4fe4-9fd5-c3d9c83d5a0a'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:04.068579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-e44b4dab-b238-4fe4-9fd5-c3d9c83d5a0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3af62983d09c44acb2ceda34341d7172', 'request_id': 'req-e44b4dab-b238-4fe4-9fd5-c3d9c83d5a0a'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:04.079555 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-265f2b0e-e673-4eba-a40f-8052c0759791 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8baf1d629994cdd83fee8248703768a', 'request_id': 'req-265f2b0e-e673-4eba-a40f-8052c0759791'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:04.087254 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-265f2b0e-e673-4eba-a40f-8052c0759791 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8baf1d629994cdd83fee8248703768a', 'request_id': 'req-265f2b0e-e673-4eba-a40f-8052c0759791'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:04.094702 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-265f2b0e-e673-4eba-a40f-8052c0759791 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8baf1d629994cdd83fee8248703768a', 'request_id': 'req-265f2b0e-e673-4eba-a40f-8052c0759791'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:04.096701 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:04.125962 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-e44b4dab-b238-4fe4-9fd5-c3d9c83d5a0a admin admin] The token cache is being invalidate because project 3af62983d09c44acb2ceda34341d7172 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:51:04.126260 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-e44b4dab-b238-4fe4-9fd5-c3d9c83d5a0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:04.126906 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-e44b4dab-b238-4fe4-9fd5-c3d9c83d5a0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:04.129142 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 932/1872] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:51:03 2022] DELETE /identity/v3/projects/3af62983d09c44acb2ceda34341d7172 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:04.134191 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6badc-bb17-4535-9251-ace88fb4382b None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:04.134486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6badc-bb17-4535-9251-ace88fb4382b None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:04.134769 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6badc-bb17-4535-9251-ace88fb4382b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:04.155428 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-6bf6badc-bb17-4535-9251-ace88fb4382b None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:04.156956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6bf6badc-bb17-4535-9251-ace88fb4382b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:04.183082 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-265f2b0e-e673-4eba-a40f-8052c0759791 admin admin] The token cache is being invalidate because project e8baf1d629994cdd83fee8248703768a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:51:04.183437 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-265f2b0e-e673-4eba-a40f-8052c0759791 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:04.184117 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-265f2b0e-e673-4eba-a40f-8052c0759791 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:04.185804 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 941/1873] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:51:03 2022] DELETE /identity/v3/projects/e8baf1d629994cdd83fee8248703768a => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:04.192316 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9b73e-9cdb-4a0a-bd76-301407c27925 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:04.192605 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9b73e-9cdb-4a0a-bd76-301407c27925 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:04.193003 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9b73e-9cdb-4a0a-bd76-301407c27925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:04.213778 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-f2f9b73e-9cdb-4a0a-bd76-301407c27925 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:04.215005 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-f2f9b73e-9cdb-4a0a-bd76-301407c27925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:04.218343 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 933/1874] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:51:04.224060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 942/1875] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:51:04.229399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae1aeb-5c82-483a-acb4-e5ef2277becc None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:04.229835 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae1aeb-5c82-483a-acb4-e5ef2277becc None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:04.230122 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae1aeb-5c82-483a-acb4-e5ef2277becc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:04.232832 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c062ab-631f-4a56-8417-181cecd032ac None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:04.233377 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c062ab-631f-4a56-8417-181cecd032ac None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:04.233661 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c062ab-631f-4a56-8417-181cecd032ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:04.250008 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-54ae1aeb-5c82-483a-acb4-e5ef2277becc None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:04.251227 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-54ae1aeb-5c82-483a-acb4-e5ef2277becc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:04.254038 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-76c062ab-631f-4a56-8417-181cecd032ac None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:04.255218 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-76c062ab-631f-4a56-8417-181cecd032ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:04.259212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 934/1876] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:04.263309 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae1aeb-5c82-483a-acb4-e5ef2277becc None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:04.263469 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 943/1877] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:04.267240 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c062ab-631f-4a56-8417-181cecd032ac None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:04.273330 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae1aeb-5c82-483a-acb4-e5ef2277becc None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:04.276984 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c062ab-631f-4a56-8417-181cecd032ac None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:04.277985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d8cd9-2962-4f6e-8767-b7a727ec72b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:04.278642 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d8cd9-2962-4f6e-8767-b7a727ec72b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:04.278957 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d8cd9-2962-4f6e-8767-b7a727ec72b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:04.279240 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d8cd9-2962-4f6e-8767-b7a727ec72b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:04.280042 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d8cd9-2962-4f6e-8767-b7a727ec72b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:51:04.280355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d8cd9-2962-4f6e-8767-b7a727ec72b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:04.282181 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df513544-dc8f-4406-a4b1-e558e0a38709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:04.282325 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d8cd9-2962-4f6e-8767-b7a727ec72b9 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:04.282838 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df513544-dc8f-4406-a4b1-e558e0a38709 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:04.283123 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df513544-dc8f-4406-a4b1-e558e0a38709 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:04.283400 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df513544-dc8f-4406-a4b1-e558e0a38709 admin admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:04.284159 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df513544-dc8f-4406-a4b1-e558e0a38709 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:51:04.285113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df513544-dc8f-4406-a4b1-e558e0a38709 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:04.287059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df513544-dc8f-4406-a4b1-e558e0a38709 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:04.294676 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 935/1878] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:51:04.299187 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d8cd9-2962-4f6e-8767-b7a727ec72b9 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:04.302250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 944/1879] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:51:04.304330 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df513544-dc8f-4406-a4b1-e558e0a38709 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:04.309772 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d8cd9-2962-4f6e-8767-b7a727ec72b9 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:04.314340 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df513544-dc8f-4406-a4b1-e558e0a38709 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:04.314483 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296c3d1-210d-4217-85ab-228478f9a95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:04.315089 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296c3d1-210d-4217-85ab-228478f9a95a admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:04.315383 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296c3d1-210d-4217-85ab-228478f9a95a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:04.315804 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296c3d1-210d-4217-85ab-228478f9a95a admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:04.316704 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296c3d1-210d-4217-85ab-228478f9a95a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:04.318643 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296c3d1-210d-4217-85ab-228478f9a95a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:04.319138 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f79a7a-bfa8-4ee5-9568-9f09f710ee8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:04.319825 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f79a7a-bfa8-4ee5-9568-9f09f710ee8a admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:04.320114 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f79a7a-bfa8-4ee5-9568-9f09f710ee8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:04.320395 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f79a7a-bfa8-4ee5-9568-9f09f710ee8a admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:04.321144 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f79a7a-bfa8-4ee5-9568-9f09f710ee8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:04.323037 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f79a7a-bfa8-4ee5-9568-9f09f710ee8a admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:04.420353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 936/1880] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:51:04 2022] POST /identity/v3/projects => generated 369 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:51:04.424449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296c3d1-210d-4217-85ab-228478f9a95a admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:04.445161 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 945/1881] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:51:04 2022] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:51:04.449043 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f79a7a-bfa8-4ee5-9568-9f09f710ee8a admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:04.502401 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296c3d1-210d-4217-85ab-228478f9a95a admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:04.524612 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f79a7a-bfa8-4ee5-9568-9f09f710ee8a admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:04.530671 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d1114-0e54-494c-8ea0-3dfafba0ac0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:04.531923 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:04.532267 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d1114-0e54-494c-8ea0-3dfafba0ac0b admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:04.532564 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d1114-0e54-494c-8ea0-3dfafba0ac0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:04.532848 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d1114-0e54-494c-8ea0-3dfafba0ac0b admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:04.533556 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d1114-0e54-494c-8ea0-3dfafba0ac0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:04.535944 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d1114-0e54-494c-8ea0-3dfafba0ac0b admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:04.575226 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad388f9f-6b9d-4092-9e62-f55f01bd5f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:04.575968 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad388f9f-6b9d-4092-9e62-f55f01bd5f9b admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:04.576350 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad388f9f-6b9d-4092-9e62-f55f01bd5f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:04.576529 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad388f9f-6b9d-4092-9e62-f55f01bd5f9b admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:04.577234 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad388f9f-6b9d-4092-9e62-f55f01bd5f9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:04.579199 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad388f9f-6b9d-4092-9e62-f55f01bd5f9b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:04.677424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 946/1882] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:51:04 2022] POST /identity/v3/users => generated 288 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:04.680809 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d1114-0e54-494c-8ea0-3dfafba0ac0b admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:04.693315 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d1114-0e54-494c-8ea0-3dfafba0ac0b admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:04.705402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 937/1883] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:51:04 2022] POST /identity/v3/users => generated 285 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:51:04.718664 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad388f9f-6b9d-4092-9e62-f55f01bd5f9b admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:04.724603 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9e5d4-8c28-40d8-97c1-948cefc213e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:04.725541 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9e5d4-8c28-40d8-97c1-948cefc213e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:04.725945 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9e5d4-8c28-40d8-97c1-948cefc213e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:04.726371 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9e5d4-8c28-40d8-97c1-948cefc213e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:04.727199 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9e5d4-8c28-40d8-97c1-948cefc213e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:04.728936 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9e5d4-8c28-40d8-97c1-948cefc213e1 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:04.731185 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad388f9f-6b9d-4092-9e62-f55f01bd5f9b admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:04.740546 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8823c4-d5e7-4ba2-8196-4ca60131fd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:04.741613 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8823c4-d5e7-4ba2-8196-4ca60131fd8a admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:04.742049 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8823c4-d5e7-4ba2-8196-4ca60131fd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:04.742505 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8823c4-d5e7-4ba2-8196-4ca60131fd8a admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:04.743403 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8823c4-d5e7-4ba2-8196-4ca60131fd8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:04.745938 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8823c4-d5e7-4ba2-8196-4ca60131fd8a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:04.762184 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 947/1884] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:51:04.763440 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9e5d4-8c28-40d8-97c1-948cefc213e1 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:04.777399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 938/1885] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:51:04.784960 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca890f-0ef3-4455-a5b9-334331c67c46 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:04.785666 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca890f-0ef3-4455-a5b9-334331c67c46 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:04.786108 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca890f-0ef3-4455-a5b9-334331c67c46 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:04.790388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 939/1886] 10.222.0.18 () {54 vars in 921 bytes} [Mon Jul 25 08:51:04 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:51:04.790722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9e5d4-8c28-40d8-97c1-948cefc213e1 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:04.791586 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca890f-0ef3-4455-a5b9-334331c67c46 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:04.806315 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575da367-9218-4585-8d04-3f9bfda5d25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:04.809222 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575da367-9218-4585-8d04-3f9bfda5d25a admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:04.813188 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575da367-9218-4585-8d04-3f9bfda5d25a admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:04.813188 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575da367-9218-4585-8d04-3f9bfda5d25a admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:04.813188 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575da367-9218-4585-8d04-3f9bfda5d25a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:04.813188 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575da367-9218-4585-8d04-3f9bfda5d25a admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:04.814218 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca890f-0ef3-4455-a5b9-334331c67c46 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:04.821132 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e475da1-7682-44e6-872d-17b6e185fd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:04.822016 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e475da1-7682-44e6-872d-17b6e185fd76 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:04.822543 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e475da1-7682-44e6-872d-17b6e185fd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:04.823027 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e475da1-7682-44e6-872d-17b6e185fd76 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:04.823987 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e475da1-7682-44e6-872d-17b6e185fd76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:04.826265 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e475da1-7682-44e6-872d-17b6e185fd76 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:04.839787 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 940/1887] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:51:04.844106 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e475da1-7682-44e6-872d-17b6e185fd76 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:04.857148 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e475da1-7682-44e6-872d-17b6e185fd76 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:04.865306 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 948/1888] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:51:04.866737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f43db-3450-4eee-aa24-b784d4e6cec4 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:04.867031 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f43db-3450-4eee-aa24-b784d4e6cec4 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:04.867308 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f43db-3450-4eee-aa24-b784d4e6cec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:04.869325 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e37eb-c2d9-4520-8cd9-1105ebd2d388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:04.870254 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e37eb-c2d9-4520-8cd9-1105ebd2d388 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:04.870543 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e37eb-c2d9-4520-8cd9-1105ebd2d388 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:04.870828 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e37eb-c2d9-4520-8cd9-1105ebd2d388 admin admin] PATH_INFO: `/v3/projects/446ea5108b844ae580aec785f852aa9e/users/05d73930bb6b48239550b5930035dd4a/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:04.890002 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-796f43db-3450-4eee-aa24-b784d4e6cec4 None None] MFA Rules not processed for user `1c1a08d3a76643a9996dc0daa8714ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:04.891526 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-796f43db-3450-4eee-aa24-b784d4e6cec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:04.891978 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e37eb-c2d9-4520-8cd9-1105ebd2d388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=446ea5108b844ae580aec785f852aa9e, user_id=05d73930bb6b48239550b5930035dd4a, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:04.895136 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e37eb-c2d9-4520-8cd9-1105ebd2d388 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:04.965720 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 949/1889] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Jul 25 08:51:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:04.966760 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f43db-3450-4eee-aa24-b784d4e6cec4 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:04.972156 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:04.979458 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f43db-3450-4eee-aa24-b784d4e6cec4 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:04.986007 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1102c2-b1cf-49c3-98db-f0e22c0f724c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:04.986939 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1102c2-b1cf-49c3-98db-f0e22c0f724c admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:04.994976 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1102c2-b1cf-49c3-98db-f0e22c0f724c admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:04.994976 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1102c2-b1cf-49c3-98db-f0e22c0f724c admin admin] PATH_INFO: `/v3/projects/82a56c2722fc4fc09d872e8c6b11f405/users/11a67f54e9dd4cc38f3c6ea90d3a6c37/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:05.004478 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1102c2-b1cf-49c3-98db-f0e22c0f724c admin admin] RBAC: Authorizing `identity:create_grant(project_id=82a56c2722fc4fc09d872e8c6b11f405, user_id=11a67f54e9dd4cc38f3c6ea90d3a6c37, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:05.007337 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1102c2-b1cf-49c3-98db-f0e22c0f724c admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:05.025049 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 941/1890] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:51:04 2022] PUT /identity/v3/projects/446ea5108b844ae580aec785f852aa9e/users/05d73930bb6b48239550b5930035dd4a/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:05.025913 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e37eb-c2d9-4520-8cd9-1105ebd2d388 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:05.027640 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4f4e37eb-c2d9-4520-8cd9-1105ebd2d388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:05.093120 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 950/1891] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:51:04 2022] PUT /identity/v3/projects/82a56c2722fc4fc09d872e8c6b11f405/users/11a67f54e9dd4cc38f3c6ea90d3a6c37/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:05.094541 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465b6e2-ff59-43a8-bb04-6f4dd953f49c None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:05.094835 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465b6e2-ff59-43a8-bb04-6f4dd953f49c None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:05.095115 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465b6e2-ff59-43a8-bb04-6f4dd953f49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:05.125672 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e37eb-c2d9-4520-8cd9-1105ebd2d388 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:05.127534 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-3465b6e2-ff59-43a8-bb04-6f4dd953f49c None None] MFA Rules not processed for user `05d73930bb6b48239550b5930035dd4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:05.129915 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-3465b6e2-ff59-43a8-bb04-6f4dd953f49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:05.211147 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 951/1892] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:05 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:05.211147 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8404bbd-b57c-4fd4-8f01-84abc88dc4e2 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:05.211147 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8404bbd-b57c-4fd4-8f01-84abc88dc4e2 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:05.211147 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8404bbd-b57c-4fd4-8f01-84abc88dc4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:05.218116 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07a007-902d-4829-8eba-b1b9379a6b69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:05.218116 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07a007-902d-4829-8eba-b1b9379a6b69 service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:05.218116 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07a007-902d-4829-8eba-b1b9379a6b69 service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:05.218116 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07a007-902d-4829-8eba-b1b9379a6b69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:05.226140 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:05.227739 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a07a007-902d-4829-8eba-b1b9379a6b69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:05.229587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a07a007-902d-4829-8eba-b1b9379a6b69 service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:05.238919 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-b8404bbd-b57c-4fd4-8f01-84abc88dc4e2 None None] MFA Rules not processed for user `11a67f54e9dd4cc38f3c6ea90d3a6c37`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:05.240286 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-b8404bbd-b57c-4fd4-8f01-84abc88dc4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:05.242821 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 942/1893] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:51:05.243493 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07a007-902d-4829-8eba-b1b9379a6b69 service nova] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:05.319077 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 952/1894] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:05.323410 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8404bbd-b57c-4fd4-8f01-84abc88dc4e2 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:05.328291 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07a007-902d-4829-8eba-b1b9379a6b69 service nova] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:05.335127 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d41f12-18f8-4485-9a56-1ecd65891714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:05.337783 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d41f12-18f8-4485-9a56-1ecd65891714 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:05.337783 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d41f12-18f8-4485-9a56-1ecd65891714 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:05.337783 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d41f12-18f8-4485-9a56-1ecd65891714 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:05.337783 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d41f12-18f8-4485-9a56-1ecd65891714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:05.338568 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8404bbd-b57c-4fd4-8f01-84abc88dc4e2 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:05.339011 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d41f12-18f8-4485-9a56-1ecd65891714 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:05.343846 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a213e9-90e3-4cc2-a545-08d53a3f1a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:05.344472 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a213e9-90e3-4cc2-a545-08d53a3f1a52 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:05.344955 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a213e9-90e3-4cc2-a545-08d53a3f1a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:05.345076 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a213e9-90e3-4cc2-a545-08d53a3f1a52 admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:05.346048 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a213e9-90e3-4cc2-a545-08d53a3f1a52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:05.348510 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a213e9-90e3-4cc2-a545-08d53a3f1a52 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:05.418885 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 943/1895] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:51:05 2022] POST /identity/v3/projects => generated 367 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:05.422886 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d41f12-18f8-4485-9a56-1ecd65891714 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:05.444018 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 953/1896] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:51:05 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:51:05.455850 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a213e9-90e3-4cc2-a545-08d53a3f1a52 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:05.488963 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d41f12-18f8-4485-9a56-1ecd65891714 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:05.495703 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:05.520128 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a213e9-90e3-4cc2-a545-08d53a3f1a52 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:05.525722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45638675-a662-4227-ad68-e7c0f6dbd24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:05.526434 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45638675-a662-4227-ad68-e7c0f6dbd24b admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:05.526718 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45638675-a662-4227-ad68-e7c0f6dbd24b admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:05.526998 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45638675-a662-4227-ad68-e7c0f6dbd24b admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:05.527760 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45638675-a662-4227-ad68-e7c0f6dbd24b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:05.529779 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45638675-a662-4227-ad68-e7c0f6dbd24b admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:05.547667 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e06aa9-ea99-401b-8cd3-b799d5d39e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:05.548355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e06aa9-ea99-401b-8cd3-b799d5d39e6a admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:05.548639 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e06aa9-ea99-401b-8cd3-b799d5d39e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:05.548959 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e06aa9-ea99-401b-8cd3-b799d5d39e6a admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:05.549666 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e06aa9-ea99-401b-8cd3-b799d5d39e6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:05.552511 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e06aa9-ea99-401b-8cd3-b799d5d39e6a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:05.594939 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 954/1897] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:51:05 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:05.598862 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45638675-a662-4227-ad68-e7c0f6dbd24b admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:05.608757 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45638675-a662-4227-ad68-e7c0f6dbd24b admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:05.614320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc828dfa-b4da-4d1e-a5c2-5cb1fe2c6750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:05.615318 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc828dfa-b4da-4d1e-a5c2-5cb1fe2c6750 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:05.615637 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc828dfa-b4da-4d1e-a5c2-5cb1fe2c6750 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:05.615934 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc828dfa-b4da-4d1e-a5c2-5cb1fe2c6750 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:05.616703 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc828dfa-b4da-4d1e-a5c2-5cb1fe2c6750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:05.618396 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc828dfa-b4da-4d1e-a5c2-5cb1fe2c6750 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:05.619151 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 944/1898] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:51:05 2022] POST /identity/v3/users => generated 290 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:51:05.623348 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e06aa9-ea99-401b-8cd3-b799d5d39e6a admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:05.633296 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 955/1899] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:51:05.634336 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc828dfa-b4da-4d1e-a5c2-5cb1fe2c6750 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:05.636567 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e06aa9-ea99-401b-8cd3-b799d5d39e6a admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:05.641601 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831b337-4bb1-4ed5-8036-4dbb3c86a6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:05.642339 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831b337-4bb1-4ed5-8036-4dbb3c86a6ab admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:05.648209 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831b337-4bb1-4ed5-8036-4dbb3c86a6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:05.648209 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831b337-4bb1-4ed5-8036-4dbb3c86a6ab admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:05.648209 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831b337-4bb1-4ed5-8036-4dbb3c86a6ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:05.648471 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc828dfa-b4da-4d1e-a5c2-5cb1fe2c6750 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:05.648559 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831b337-4bb1-4ed5-8036-4dbb3c86a6ab admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:05.649327 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fceb1d-b7f1-43d6-bf7a-2519b7b3eaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:05.650298 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fceb1d-b7f1-43d6-bf7a-2519b7b3eaba admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:05.650584 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fceb1d-b7f1-43d6-bf7a-2519b7b3eaba admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:05.650867 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fceb1d-b7f1-43d6-bf7a-2519b7b3eaba admin admin] PATH_INFO: `/v3/projects/d94bf305c76f4f4192863b8040b3ffe8/users/39aa401047aa44e3adddeb217c9162b7/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:05.656585 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 945/1900] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:51:05.661312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831b337-4bb1-4ed5-8036-4dbb3c86a6ab admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:05.667143 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fceb1d-b7f1-43d6-bf7a-2519b7b3eaba admin admin] RBAC: Authorizing `identity:create_grant(project_id=d94bf305c76f4f4192863b8040b3ffe8, user_id=39aa401047aa44e3adddeb217c9162b7, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:05.669990 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fceb1d-b7f1-43d6-bf7a-2519b7b3eaba admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:05.672178 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831b337-4bb1-4ed5-8036-4dbb3c86a6ab admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:05.677871 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585dbd68-7655-4f3e-b518-a8091ec1089e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:05.678767 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585dbd68-7655-4f3e-b518-a8091ec1089e admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:05.679076 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585dbd68-7655-4f3e-b518-a8091ec1089e admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:05.679352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585dbd68-7655-4f3e-b518-a8091ec1089e admin admin] PATH_INFO: `/v3/projects/dd3da824c1d8411ea4cee1a175cf182e/users/ba33bbe8cfe94b2db2aa9c137274584f/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:05.681923 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:05.696928 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585dbd68-7655-4f3e-b518-a8091ec1089e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd3da824c1d8411ea4cee1a175cf182e, user_id=ba33bbe8cfe94b2db2aa9c137274584f, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:05.699490 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585dbd68-7655-4f3e-b518-a8091ec1089e admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:05.749258 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 956/1901] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:51:05 2022] PUT /identity/v3/projects/d94bf305c76f4f4192863b8040b3ffe8/users/39aa401047aa44e3adddeb217c9162b7/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:05.753827 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fceb1d-b7f1-43d6-bf7a-2519b7b3eaba admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:05.766459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 946/1902] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:51:05 2022] PUT /identity/v3/projects/dd3da824c1d8411ea4cee1a175cf182e/users/ba33bbe8cfe94b2db2aa9c137274584f/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:51:05.772996 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585dbd68-7655-4f3e-b518-a8091ec1089e admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:05.820797 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fceb1d-b7f1-43d6-bf7a-2519b7b3eaba admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:05.841112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585dbd68-7655-4f3e-b518-a8091ec1089e admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:05.846082 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b8246-ffb3-4efb-b318-656066183b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:05.846772 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b8246-ffb3-4efb-b318-656066183b6c admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:05.847275 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b8246-ffb3-4efb-b318-656066183b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:05.847910 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b8246-ffb3-4efb-b318-656066183b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:05.848667 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b8246-ffb3-4efb-b318-656066183b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:05.850321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b8246-ffb3-4efb-b318-656066183b6c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:05.864722 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 947/1903] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:51:05.865815 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b8246-ffb3-4efb-b318-656066183b6c admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:05.875994 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b8246-ffb3-4efb-b318-656066183b6c admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:05.883036 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66ebc5-5554-494f-a05d-862123fb2c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:05.884071 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66ebc5-5554-494f-a05d-862123fb2c2b admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:05.884262 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66ebc5-5554-494f-a05d-862123fb2c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:05.884574 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66ebc5-5554-494f-a05d-862123fb2c2b admin admin] PATH_INFO: `/v3/projects/dd3da824c1d8411ea4cee1a175cf182e/users/ba33bbe8cfe94b2db2aa9c137274584f/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:05.886337 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3b1e3-966d-423d-bf0d-c4bc129d5e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:05.886576 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb66ebc5-5554-494f-a05d-862123fb2c2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd3da824c1d8411ea4cee1a175cf182e, user_id=ba33bbe8cfe94b2db2aa9c137274584f, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:05.887019 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3b1e3-966d-423d-bf0d-c4bc129d5e62 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:05.887312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3b1e3-966d-423d-bf0d-c4bc129d5e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:05.887683 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3b1e3-966d-423d-bf0d-c4bc129d5e62 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:05.888345 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f3b1e3-966d-423d-bf0d-c4bc129d5e62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:05.889276 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb66ebc5-5554-494f-a05d-862123fb2c2b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:05.890116 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f3b1e3-966d-423d-bf0d-c4bc129d5e62 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:05.902494 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 957/1904] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:51:05.903653 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 948/1905] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:51:05 2022] PUT /identity/v3/projects/dd3da824c1d8411ea4cee1a175cf182e/users/ba33bbe8cfe94b2db2aa9c137274584f/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:05.912713 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3b1e3-966d-423d-bf0d-c4bc129d5e62 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:05.917816 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466da4b-34ba-4201-a281-460a18fdf8de None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:05.918116 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466da4b-34ba-4201-a281-460a18fdf8de None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:05.918399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466da4b-34ba-4201-a281-460a18fdf8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:05.924168 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3b1e3-966d-423d-bf0d-c4bc129d5e62 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:05.966728 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:05.968395 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-9466da4b-34ba-4201-a281-460a18fdf8de None None] MFA Rules not processed for user `ba33bbe8cfe94b2db2aa9c137274584f`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:05.969817 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9466da4b-34ba-4201-a281-460a18fdf8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:06.006040 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc907ea-2bb9-4f1a-8381-bb7ec88c4c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:06.006040 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc907ea-2bb9-4f1a-8381-bb7ec88c4c05 admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:06.006040 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc907ea-2bb9-4f1a-8381-bb7ec88c4c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:06.006040 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc907ea-2bb9-4f1a-8381-bb7ec88c4c05 admin admin] PATH_INFO: `/v3/projects/d94bf305c76f4f4192863b8040b3ffe8/users/39aa401047aa44e3adddeb217c9162b7/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:06.008244 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc907ea-2bb9-4f1a-8381-bb7ec88c4c05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d94bf305c76f4f4192863b8040b3ffe8, user_id=39aa401047aa44e3adddeb217c9162b7, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:06.012907 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc907ea-2bb9-4f1a-8381-bb7ec88c4c05 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:06.037323 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 958/1906] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:51:05 2022] PUT /identity/v3/projects/d94bf305c76f4f4192863b8040b3ffe8/users/39aa401047aa44e3adddeb217c9162b7/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:06.038971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e577f72-e4a5-4815-a0f0-9944178150a2 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:06.039267 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e577f72-e4a5-4815-a0f0-9944178150a2 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:06.039553 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e577f72-e4a5-4815-a0f0-9944178150a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:06.078268 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-9e577f72-e4a5-4815-a0f0-9944178150a2 None None] MFA Rules not processed for user `39aa401047aa44e3adddeb217c9162b7`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:06.080736 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-9e577f72-e4a5-4815-a0f0-9944178150a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:06.136880 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 949/1907] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:05 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:51:06.143905 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466da4b-34ba-4201-a281-460a18fdf8de None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:06.145682 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9466da4b-34ba-4201-a281-460a18fdf8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:06.174303 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 959/1908] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:06 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:06.199878 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e577f72-e4a5-4815-a0f0-9944178150a2 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:06.201674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-9e577f72-e4a5-4815-a0f0-9944178150a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:06.231371 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466da4b-34ba-4201-a281-460a18fdf8de None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:06.235249 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:06.268878 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e577f72-e4a5-4815-a0f0-9944178150a2 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:06.273177 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aab027-6018-4628-846e-12ef1e335eef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:06.274011 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aab027-6018-4628-846e-12ef1e335eef service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:06.274312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aab027-6018-4628-846e-12ef1e335eef service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:06.274581 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aab027-6018-4628-846e-12ef1e335eef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:06.287142 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6041ca-ae08-4a5c-99f7-3f6afa936152 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:06.288372 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6041ca-ae08-4a5c-99f7-3f6afa936152 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:06.289394 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6041ca-ae08-4a5c-99f7-3f6afa936152 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:06.289676 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6041ca-ae08-4a5c-99f7-3f6afa936152 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:06.349810 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aab027-6018-4628-846e-12ef1e335eef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:06.351354 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aab027-6018-4628-846e-12ef1e335eef service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:06.361240 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 960/1909] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:51:06.363244 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6041ca-ae08-4a5c-99f7-3f6afa936152 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:06.364763 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6041ca-ae08-4a5c-99f7-3f6afa936152 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:06.375557 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 950/1910] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:06 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:51:06.614020 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aab027-6018-4628-846e-12ef1e335eef service cinder] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:06.622627 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aab027-6018-4628-846e-12ef1e335eef service cinder] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:06.626265 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e7097-d789-4bee-b405-b68fe6ceae2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:06.626896 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e7097-d789-4bee-b405-b68fe6ceae2a service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:06.627226 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e7097-d789-4bee-b405-b68fe6ceae2a service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:06.627500 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e7097-d789-4bee-b405-b68fe6ceae2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:06.632997 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:06.685981 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e7097-d789-4bee-b405-b68fe6ceae2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:06.687423 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e7097-d789-4bee-b405-b68fe6ceae2a service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:06.698034 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 961/1911] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:06 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:51:11.586198 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6041ca-ae08-4a5c-99f7-3f6afa936152 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:11.653662 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6041ca-ae08-4a5c-99f7-3f6afa936152 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:11.658538 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd2a54-464c-47dc-8a53-5449207330c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:11.660169 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd2a54-464c-47dc-8a53-5449207330c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:11.660460 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd2a54-464c-47dc-8a53-5449207330c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:11.660743 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd2a54-464c-47dc-8a53-5449207330c0 admin admin] PATH_INFO: `/v3/users/05d73930bb6b48239550b5930035dd4a` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:11.661956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd2a54-464c-47dc-8a53-5449207330c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05d73930bb6b48239550b5930035dd4a)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:11.663906 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd2a54-464c-47dc-8a53-5449207330c0 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:11.825153 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-47dd2a54-464c-47dc-8a53-5449207330c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05d73930bb6b48239550b5930035dd4a'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:11.825728 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-47dd2a54-464c-47dc-8a53-5449207330c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05d73930bb6b48239550b5930035dd4a'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:11.832611 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-47dd2a54-464c-47dc-8a53-5449207330c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05d73930bb6b48239550b5930035dd4a'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:11.833344 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-47dd2a54-464c-47dc-8a53-5449207330c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05d73930bb6b48239550b5930035dd4a'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:11.835997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:11.931216 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-47dd2a54-464c-47dc-8a53-5449207330c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05d73930bb6b48239550b5930035dd4a'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:11.950609 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 951/1912] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:51:11 2022] DELETE /identity/v3/users/05d73930bb6b48239550b5930035dd4a => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:11.955087 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83437c-1483-430c-91ed-045d102076d6 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:11.955635 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83437c-1483-430c-91ed-045d102076d6 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:11.955756 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83437c-1483-430c-91ed-045d102076d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:11.976435 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-8a83437c-1483-430c-91ed-045d102076d6 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:11.977908 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-8a83437c-1483-430c-91ed-045d102076d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:12.037974 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 962/1913] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:12.048188 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd2a54-464c-47dc-8a53-5449207330c0 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:12.049598 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-47dd2a54-464c-47dc-8a53-5449207330c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:12.113242 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd2a54-464c-47dc-8a53-5449207330c0 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:12.116999 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3707b-e3cc-4455-9033-7838eddd2890 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:12.117699 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3707b-e3cc-4455-9033-7838eddd2890 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:12.117984 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3707b-e3cc-4455-9033-7838eddd2890 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:12.118261 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3707b-e3cc-4455-9033-7838eddd2890 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:12.130031 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3707b-e3cc-4455-9033-7838eddd2890 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:12.131821 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3707b-e3cc-4455-9033-7838eddd2890 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:12.144528 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 952/1914] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:51:12.659179 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83437c-1483-430c-91ed-045d102076d6 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:12.660914 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-8a83437c-1483-430c-91ed-045d102076d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:12.674457 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83437c-1483-430c-91ed-045d102076d6 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:12.680149 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c329b9-02ce-4a6f-b51c-82aaa5d393cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:12.681030 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c329b9-02ce-4a6f-b51c-82aaa5d393cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:12.681315 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c329b9-02ce-4a6f-b51c-82aaa5d393cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:12.681592 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c329b9-02ce-4a6f-b51c-82aaa5d393cc admin admin] PATH_INFO: `/v3/projects/446ea5108b844ae580aec785f852aa9e` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:12.682818 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c329b9-02ce-4a6f-b51c-82aaa5d393cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=446ea5108b844ae580aec785f852aa9e)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:12.684961 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c329b9-02ce-4a6f-b51c-82aaa5d393cc admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:12.823509 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-44c329b9-02ce-4a6f-b51c-82aaa5d393cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '446ea5108b844ae580aec785f852aa9e', 'request_id': 'req-44c329b9-02ce-4a6f-b51c-82aaa5d393cc'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:12.830002 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-44c329b9-02ce-4a6f-b51c-82aaa5d393cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '446ea5108b844ae580aec785f852aa9e', 'request_id': 'req-44c329b9-02ce-4a6f-b51c-82aaa5d393cc'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:12.837153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-44c329b9-02ce-4a6f-b51c-82aaa5d393cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '446ea5108b844ae580aec785f852aa9e', 'request_id': 'req-44c329b9-02ce-4a6f-b51c-82aaa5d393cc'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:12.902491 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-44c329b9-02ce-4a6f-b51c-82aaa5d393cc admin admin] The token cache is being invalidate because project 446ea5108b844ae580aec785f852aa9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:51:12.902700 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-44c329b9-02ce-4a6f-b51c-82aaa5d393cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:12.903370 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-44c329b9-02ce-4a6f-b51c-82aaa5d393cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:12.904983 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 963/1915] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:51:12 2022] DELETE /identity/v3/projects/446ea5108b844ae580aec785f852aa9e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:12.909327 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3707b-e3cc-4455-9033-7838eddd2890 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:12.919220 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3707b-e3cc-4455-9033-7838eddd2890 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:12.978496 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d745d1-6606-4a5f-ad08-0c0893ea9be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:12.979364 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d745d1-6606-4a5f-ad08-0c0893ea9be1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:12.979675 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d745d1-6606-4a5f-ad08-0c0893ea9be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:12.979956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d745d1-6606-4a5f-ad08-0c0893ea9be1 admin admin] PATH_INFO: `/v3/users/ba33bbe8cfe94b2db2aa9c137274584f` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:12.981149 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d745d1-6606-4a5f-ad08-0c0893ea9be1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba33bbe8cfe94b2db2aa9c137274584f)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:12.983074 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d745d1-6606-4a5f-ad08-0c0893ea9be1 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:13.111098 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b3d745d1-6606-4a5f-ad08-0c0893ea9be1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba33bbe8cfe94b2db2aa9c137274584f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:13.111786 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b3d745d1-6606-4a5f-ad08-0c0893ea9be1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba33bbe8cfe94b2db2aa9c137274584f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:13.119172 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b3d745d1-6606-4a5f-ad08-0c0893ea9be1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba33bbe8cfe94b2db2aa9c137274584f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:13.119871 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b3d745d1-6606-4a5f-ad08-0c0893ea9be1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba33bbe8cfe94b2db2aa9c137274584f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:13.211413 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b3d745d1-6606-4a5f-ad08-0c0893ea9be1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba33bbe8cfe94b2db2aa9c137274584f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:13.226700 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:13.233007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 953/1916] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:51:12 2022] DELETE /identity/v3/users/ba33bbe8cfe94b2db2aa9c137274584f => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:13.819247 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c329b9-02ce-4a6f-b51c-82aaa5d393cc admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:13.821016 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-44c329b9-02ce-4a6f-b51c-82aaa5d393cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:13.835953 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c329b9-02ce-4a6f-b51c-82aaa5d393cc admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:13.865498 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:13.899540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945dd777-3c80-4d76-a58e-ddd81ebbbeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:13.900538 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945dd777-3c80-4d76-a58e-ddd81ebbbeb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:13.900993 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945dd777-3c80-4d76-a58e-ddd81ebbbeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:13.901280 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945dd777-3c80-4d76-a58e-ddd81ebbbeb2 admin admin] PATH_INFO: `/v3/projects/dd3da824c1d8411ea4cee1a175cf182e` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:13.902716 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945dd777-3c80-4d76-a58e-ddd81ebbbeb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd3da824c1d8411ea4cee1a175cf182e)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:13.904990 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945dd777-3c80-4d76-a58e-ddd81ebbbeb2 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:14.000592 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-945dd777-3c80-4d76-a58e-ddd81ebbbeb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd3da824c1d8411ea4cee1a175cf182e', 'request_id': 'req-945dd777-3c80-4d76-a58e-ddd81ebbbeb2'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:14.007782 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-945dd777-3c80-4d76-a58e-ddd81ebbbeb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd3da824c1d8411ea4cee1a175cf182e', 'request_id': 'req-945dd777-3c80-4d76-a58e-ddd81ebbbeb2'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:14.013350 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-945dd777-3c80-4d76-a58e-ddd81ebbbeb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd3da824c1d8411ea4cee1a175cf182e', 'request_id': 'req-945dd777-3c80-4d76-a58e-ddd81ebbbeb2'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:14.090986 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-945dd777-3c80-4d76-a58e-ddd81ebbbeb2 admin admin] The token cache is being invalidate because project dd3da824c1d8411ea4cee1a175cf182e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:51:14.091284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-945dd777-3c80-4d76-a58e-ddd81ebbbeb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:14.091924 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-945dd777-3c80-4d76-a58e-ddd81ebbbeb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:14.093520 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 964/1917] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:51:13 2022] DELETE /identity/v3/projects/dd3da824c1d8411ea4cee1a175cf182e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:14.098807 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40abf6-bcc2-4c4a-856d-9d133aafebd6 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:14.100236 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40abf6-bcc2-4c4a-856d-9d133aafebd6 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:14.100236 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40abf6-bcc2-4c4a-856d-9d133aafebd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:14.120409 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-6d40abf6-bcc2-4c4a-856d-9d133aafebd6 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:14.121620 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6d40abf6-bcc2-4c4a-856d-9d133aafebd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:14.182316 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 954/1918] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:14.190067 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782839f1-605d-4289-a5f4-921dc8b90e39 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:14.190375 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782839f1-605d-4289-a5f4-921dc8b90e39 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:14.191244 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782839f1-605d-4289-a5f4-921dc8b90e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:14.211140 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-782839f1-605d-4289-a5f4-921dc8b90e39 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:14.212434 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-782839f1-605d-4289-a5f4-921dc8b90e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:14.220236 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 965/1919] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:14.225000 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40abf6-bcc2-4c4a-856d-9d133aafebd6 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:14.234902 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40abf6-bcc2-4c4a-856d-9d133aafebd6 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:14.240546 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299512e-12e2-4a1b-af5f-bc300513dc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:14.241241 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299512e-12e2-4a1b-af5f-bc300513dc47 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:14.241595 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299512e-12e2-4a1b-af5f-bc300513dc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:14.241880 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299512e-12e2-4a1b-af5f-bc300513dc47 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:14.242617 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299512e-12e2-4a1b-af5f-bc300513dc47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:51:14.242930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299512e-12e2-4a1b-af5f-bc300513dc47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:14.244580 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299512e-12e2-4a1b-af5f-bc300513dc47 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:14.256239 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 955/1920] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:51:14.260336 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782839f1-605d-4289-a5f4-921dc8b90e39 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:14.269522 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782839f1-605d-4289-a5f4-921dc8b90e39 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:14.274099 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b97dd1-6c4e-4706-b7aa-73af7df016d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:14.274753 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b97dd1-6c4e-4706-b7aa-73af7df016d8 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:14.275054 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b97dd1-6c4e-4706-b7aa-73af7df016d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:14.275334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b97dd1-6c4e-4706-b7aa-73af7df016d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:14.276162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b97dd1-6c4e-4706-b7aa-73af7df016d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:14.278090 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b97dd1-6c4e-4706-b7aa-73af7df016d8 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:14.378517 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 966/1921] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:51:14 2022] POST /identity/v3/projects => generated 391 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:14.382821 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299512e-12e2-4a1b-af5f-bc300513dc47 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:14.393347 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299512e-12e2-4a1b-af5f-bc300513dc47 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:14.459041 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b1922-7ac0-4f2f-b80f-86f65689a5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:14.459970 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b1922-7ac0-4f2f-b80f-86f65689a5b8 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:14.461411 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b1922-7ac0-4f2f-b80f-86f65689a5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:14.461789 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b1922-7ac0-4f2f-b80f-86f65689a5b8 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:14.462571 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b1922-7ac0-4f2f-b80f-86f65689a5b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:14.464484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b1922-7ac0-4f2f-b80f-86f65689a5b8 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:14.552693 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 956/1922] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:51:14 2022] POST /identity/v3/users => generated 296 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:51:14.560128 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b97dd1-6c4e-4706-b7aa-73af7df016d8 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:14.572862 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b97dd1-6c4e-4706-b7aa-73af7df016d8 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:14.577769 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22ccd2-9fc5-4695-bb5e-b75e77ab01d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:14.578452 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22ccd2-9fc5-4695-bb5e-b75e77ab01d9 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:14.578765 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22ccd2-9fc5-4695-bb5e-b75e77ab01d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:14.579043 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22ccd2-9fc5-4695-bb5e-b75e77ab01d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:14.579820 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22ccd2-9fc5-4695-bb5e-b75e77ab01d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:14.582161 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22ccd2-9fc5-4695-bb5e-b75e77ab01d9 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:14.593184 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 967/1923] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:51:14.597045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b1922-7ac0-4f2f-b80f-86f65689a5b8 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:14.607519 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b1922-7ac0-4f2f-b80f-86f65689a5b8 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:14.613127 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6880561-70cc-4561-8b53-d2a40cdf30e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:14.613711 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6880561-70cc-4561-8b53-d2a40cdf30e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:14.614257 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6880561-70cc-4561-8b53-d2a40cdf30e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:14.614504 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6880561-70cc-4561-8b53-d2a40cdf30e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:14.615256 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6880561-70cc-4561-8b53-d2a40cdf30e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:14.617687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6880561-70cc-4561-8b53-d2a40cdf30e4 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:14.629883 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 957/1924] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:51:14.634248 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22ccd2-9fc5-4695-bb5e-b75e77ab01d9 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:14.646485 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22ccd2-9fc5-4695-bb5e-b75e77ab01d9 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:14.651700 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b884f7-372c-4c53-9174-fce1924daa00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:14.652797 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b884f7-372c-4c53-9174-fce1924daa00 admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:14.653057 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b884f7-372c-4c53-9174-fce1924daa00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:14.653481 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b884f7-372c-4c53-9174-fce1924daa00 admin admin] PATH_INFO: `/v3/projects/febb4d9ec414429aad6ac7ba139a1f57/users/0376c2c849e0490b8dfd77bcf14ec63f/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:14.673294 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b884f7-372c-4c53-9174-fce1924daa00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=febb4d9ec414429aad6ac7ba139a1f57, user_id=0376c2c849e0490b8dfd77bcf14ec63f, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:14.677440 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b884f7-372c-4c53-9174-fce1924daa00 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:14.774535 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 968/1925] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:51:14 2022] PUT /identity/v3/projects/febb4d9ec414429aad6ac7ba139a1f57/users/0376c2c849e0490b8dfd77bcf14ec63f/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:14.787904 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6567fc8-405c-4337-9122-635db1bef40a None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:14.788202 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6567fc8-405c-4337-9122-635db1bef40a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:14.788497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6567fc8-405c-4337-9122-635db1bef40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:14.829560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-e6567fc8-405c-4337-9122-635db1bef40a None None] MFA Rules not processed for user `0376c2c849e0490b8dfd77bcf14ec63f`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:14.830797 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-e6567fc8-405c-4337-9122-635db1bef40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:14.900764 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:14.913111 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 958/1926] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:14.917595 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b884f7-372c-4c53-9174-fce1924daa00 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:14.977937 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:14.982918 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b884f7-372c-4c53-9174-fce1924daa00 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:14.988409 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9d422-4cd8-47b9-a2cb-672993433074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:14.989075 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9d422-4cd8-47b9-a2cb-672993433074 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:14.989388 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9d422-4cd8-47b9-a2cb-672993433074 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:14.989666 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9d422-4cd8-47b9-a2cb-672993433074 admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:14.990360 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9d422-4cd8-47b9-a2cb-672993433074 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:14.992307 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9d422-4cd8-47b9-a2cb-672993433074 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:15.098802 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 969/1927] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:51:14 2022] POST /identity/v3/projects => generated 391 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:15.102978 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6567fc8-405c-4337-9122-635db1bef40a None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:15.115508 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6567fc8-405c-4337-9122-635db1bef40a None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:15.179522 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199078df-8792-49e4-90bb-8ecca3dc6156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:15.180241 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199078df-8792-49e4-90bb-8ecca3dc6156 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:15.180530 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199078df-8792-49e4-90bb-8ecca3dc6156 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:15.180821 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199078df-8792-49e4-90bb-8ecca3dc6156 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:15.181515 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199078df-8792-49e4-90bb-8ecca3dc6156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:15.183440 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199078df-8792-49e4-90bb-8ecca3dc6156 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:15.325963 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 959/1928] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:51:15 2022] POST /identity/v3/users => generated 302 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:15.329934 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9d422-4cd8-47b9-a2cb-672993433074 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:15.340768 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9d422-4cd8-47b9-a2cb-672993433074 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:15.345797 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd8853-4e1a-4082-a492-b0dc56a21ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:15.346446 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd8853-4e1a-4082-a492-b0dc56a21ceb admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:15.347373 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd8853-4e1a-4082-a492-b0dc56a21ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:15.347676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd8853-4e1a-4082-a492-b0dc56a21ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:15.348420 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd8853-4e1a-4082-a492-b0dc56a21ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:15.350033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd8853-4e1a-4082-a492-b0dc56a21ceb admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:15.361071 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 970/1929] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:51:15.366264 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199078df-8792-49e4-90bb-8ecca3dc6156 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:15.376494 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199078df-8792-49e4-90bb-8ecca3dc6156 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:15.381218 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8745b-b53d-48de-af41-6ec40d7044eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:15.382144 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8745b-b53d-48de-af41-6ec40d7044eb admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:15.382446 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8745b-b53d-48de-af41-6ec40d7044eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:15.382710 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8745b-b53d-48de-af41-6ec40d7044eb admin admin] PATH_INFO: `/v3/projects/d8624bd9bfec47b4bdb635d41476d17a/users/9c4494db2ff54d33988973fe1cb76fe9/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:15.398316 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae8745b-b53d-48de-af41-6ec40d7044eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8624bd9bfec47b4bdb635d41476d17a, user_id=9c4494db2ff54d33988973fe1cb76fe9, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:15.401049 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae8745b-b53d-48de-af41-6ec40d7044eb admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:15.480114 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 960/1930] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:51:15 2022] PUT /identity/v3/projects/d8624bd9bfec47b4bdb635d41476d17a/users/9c4494db2ff54d33988973fe1cb76fe9/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:15.484201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd8853-4e1a-4082-a492-b0dc56a21ceb admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:15.495178 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd8853-4e1a-4082-a492-b0dc56a21ceb admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:15.563298 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9afe1-8c7f-40df-92a3-535abccec21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:15.564011 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9afe1-8c7f-40df-92a3-535abccec21a admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:15.564296 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9afe1-8c7f-40df-92a3-535abccec21a admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:15.564571 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9afe1-8c7f-40df-92a3-535abccec21a admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:15.565307 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c9afe1-8c7f-40df-92a3-535abccec21a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:15.566944 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c9afe1-8c7f-40df-92a3-535abccec21a admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:15.588808 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 971/1931] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:51:15.600293 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8745b-b53d-48de-af41-6ec40d7044eb admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:15.617472 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8745b-b53d-48de-af41-6ec40d7044eb admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:15.623047 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b5c21-7e18-4586-a0f0-49bbd8a1afc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:15.623986 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b5c21-7e18-4586-a0f0-49bbd8a1afc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:15.624281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b5c21-7e18-4586-a0f0-49bbd8a1afc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:15.624567 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b5c21-7e18-4586-a0f0-49bbd8a1afc9 admin admin] PATH_INFO: `/v3/projects/d8624bd9bfec47b4bdb635d41476d17a/users/9c4494db2ff54d33988973fe1cb76fe9/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:15.626659 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b5c21-7e18-4586-a0f0-49bbd8a1afc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8624bd9bfec47b4bdb635d41476d17a, user_id=9c4494db2ff54d33988973fe1cb76fe9, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:15.630295 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b5c21-7e18-4586-a0f0-49bbd8a1afc9 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:15.646623 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 961/1932] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:51:15 2022] PUT /identity/v3/projects/d8624bd9bfec47b4bdb635d41476d17a/users/9c4494db2ff54d33988973fe1cb76fe9/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:15.657247 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261db19-06e3-4f3a-b394-75d391c0810c None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:15.657780 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261db19-06e3-4f3a-b394-75d391c0810c None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:15.658233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261db19-06e3-4f3a-b394-75d391c0810c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:15.698423 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-d261db19-06e3-4f3a-b394-75d391c0810c None None] MFA Rules not processed for user `9c4494db2ff54d33988973fe1cb76fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:15.699869 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-d261db19-06e3-4f3a-b394-75d391c0810c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:15.801047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 972/1933] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:15 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:15.812471 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b5c21-7e18-4586-a0f0-49bbd8a1afc9 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:15.814463 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-040b5c21-7e18-4586-a0f0-49bbd8a1afc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:15.907927 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b5c21-7e18-4586-a0f0-49bbd8a1afc9 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:15.914670 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa927dee-ef9f-493b-a40e-028c53fb9b60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:15.915458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa927dee-ef9f-493b-a40e-028c53fb9b60 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:15.915892 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa927dee-ef9f-493b-a40e-028c53fb9b60 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:15.916417 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa927dee-ef9f-493b-a40e-028c53fb9b60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:15.943714 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa927dee-ef9f-493b-a40e-028c53fb9b60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:15.945301 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa927dee-ef9f-493b-a40e-028c53fb9b60 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:15.964280 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 962/1934] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:15 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:51:16.059302 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261db19-06e3-4f3a-b394-75d391c0810c None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:16.061318 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-d261db19-06e3-4f3a-b394-75d391c0810c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:16.125753 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa927dee-ef9f-493b-a40e-028c53fb9b60 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:16.127210 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-aa927dee-ef9f-493b-a40e-028c53fb9b60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:16.141955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa927dee-ef9f-493b-a40e-028c53fb9b60 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:16.147255 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70dbec-3933-4ee5-a11d-6c8d45059d7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:16.148001 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70dbec-3933-4ee5-a11d-6c8d45059d7f service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:16.152945 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70dbec-3933-4ee5-a11d-6c8d45059d7f service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:16.152945 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70dbec-3933-4ee5-a11d-6c8d45059d7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:16.173467 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:16.191249 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261db19-06e3-4f3a-b394-75d391c0810c None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:16.215141 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543fb5e-b125-48b6-9304-cfeb436094b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:16.215141 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543fb5e-b125-48b6-9304-cfeb436094b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:16.215361 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543fb5e-b125-48b6-9304-cfeb436094b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:16.221707 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543fb5e-b125-48b6-9304-cfeb436094b6 admin admin] PATH_INFO: `/v3/users/11a67f54e9dd4cc38f3c6ea90d3a6c37` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:16.221707 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543fb5e-b125-48b6-9304-cfeb436094b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11a67f54e9dd4cc38f3c6ea90d3a6c37)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:16.227278 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543fb5e-b125-48b6-9304-cfeb436094b6 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:16.236274 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:16.251999 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70dbec-3933-4ee5-a11d-6c8d45059d7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:16.253693 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70dbec-3933-4ee5-a11d-6c8d45059d7f service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:16.263947 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 963/1935] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:51:16.265008 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70dbec-3933-4ee5-a11d-6c8d45059d7f service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:16.266476 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-ad70dbec-3933-4ee5-a11d-6c8d45059d7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:16.286525 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70dbec-3933-4ee5-a11d-6c8d45059d7f service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:16.296278 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38982f5-fd04-474d-b0aa-ed4e0fcfe958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:16.299133 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38982f5-fd04-474d-b0aa-ed4e0fcfe958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:16.300498 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38982f5-fd04-474d-b0aa-ed4e0fcfe958 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:16.300632 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38982f5-fd04-474d-b0aa-ed4e0fcfe958 admin admin] PATH_INFO: `/v3/users/ad2bf1cc2c794832864a6637299cc8f9` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:16.301944 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38982f5-fd04-474d-b0aa-ed4e0fcfe958 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad2bf1cc2c794832864a6637299cc8f9)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:16.304025 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38982f5-fd04-474d-b0aa-ed4e0fcfe958 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:16.505563 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5543fb5e-b125-48b6-9304-cfeb436094b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11a67f54e9dd4cc38f3c6ea90d3a6c37'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:16.506243 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5543fb5e-b125-48b6-9304-cfeb436094b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11a67f54e9dd4cc38f3c6ea90d3a6c37'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:16.506953 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5543fb5e-b125-48b6-9304-cfeb436094b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11a67f54e9dd4cc38f3c6ea90d3a6c37'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:16.514572 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5543fb5e-b125-48b6-9304-cfeb436094b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11a67f54e9dd4cc38f3c6ea90d3a6c37'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:16.543188 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f38982f5-fd04-474d-b0aa-ed4e0fcfe958 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad2bf1cc2c794832864a6637299cc8f9'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:16.543188 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f38982f5-fd04-474d-b0aa-ed4e0fcfe958 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad2bf1cc2c794832864a6637299cc8f9'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:16.548791 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f38982f5-fd04-474d-b0aa-ed4e0fcfe958 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad2bf1cc2c794832864a6637299cc8f9'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:16.549423 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f38982f5-fd04-474d-b0aa-ed4e0fcfe958 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad2bf1cc2c794832864a6637299cc8f9'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:16.617728 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5543fb5e-b125-48b6-9304-cfeb436094b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11a67f54e9dd4cc38f3c6ea90d3a6c37'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:16.636994 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 973/1936] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:51:16 2022] DELETE /identity/v3/users/11a67f54e9dd4cc38f3c6ea90d3a6c37 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:16.641405 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975482df-cc81-465d-886f-9c30c8d40538 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:16.641695 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975482df-cc81-465d-886f-9c30c8d40538 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:16.641972 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975482df-cc81-465d-886f-9c30c8d40538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:16.662789 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-975482df-cc81-465d-886f-9c30c8d40538 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:16.664122 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-975482df-cc81-465d-886f-9c30c8d40538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:16.714071 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f38982f5-fd04-474d-b0aa-ed4e0fcfe958 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad2bf1cc2c794832864a6637299cc8f9'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:16.735837 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 974/1937] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:51:16.741350 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 964/1938] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:51:16 2022] DELETE /identity/v3/users/ad2bf1cc2c794832864a6637299cc8f9 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:16.745981 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db017a7e-39ed-4c6f-8218-b6501d7f93e3 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:16.746278 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db017a7e-39ed-4c6f-8218-b6501d7f93e3 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:16.746561 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db017a7e-39ed-4c6f-8218-b6501d7f93e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:16.746845 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38982f5-fd04-474d-b0aa-ed4e0fcfe958 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:16.748299 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f38982f5-fd04-474d-b0aa-ed4e0fcfe958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:16.765499 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-db017a7e-39ed-4c6f-8218-b6501d7f93e3 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:16.766711 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-db017a7e-39ed-4c6f-8218-b6501d7f93e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:16.820592 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38982f5-fd04-474d-b0aa-ed4e0fcfe958 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:16.825832 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59f25e-d806-472c-b022-5ba817d4f479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:16.826946 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59f25e-d806-472c-b022-5ba817d4f479 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:16.827236 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59f25e-d806-472c-b022-5ba817d4f479 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:16.827523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59f25e-d806-472c-b022-5ba817d4f479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:16.841698 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 975/1939] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:16.856069 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db017a7e-39ed-4c6f-8218-b6501d7f93e3 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:16.868270 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db017a7e-39ed-4c6f-8218-b6501d7f93e3 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:16.872231 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743aff7-4d4c-45fb-8619-a22949026b02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:16.875070 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743aff7-4d4c-45fb-8619-a22949026b02 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:16.875070 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743aff7-4d4c-45fb-8619-a22949026b02 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:16.875070 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743aff7-4d4c-45fb-8619-a22949026b02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:16.885044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743aff7-4d4c-45fb-8619-a22949026b02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:16.886515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743aff7-4d4c-45fb-8619-a22949026b02 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:16.891698 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:16.900301 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 976/1940] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:51:16.935920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e59f25e-d806-472c-b022-5ba817d4f479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:16.937931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e59f25e-d806-472c-b022-5ba817d4f479 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:16.972711 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 965/1941] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:51:17.785355 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743aff7-4d4c-45fb-8619-a22949026b02 service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:17.786917 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-4743aff7-4d4c-45fb-8619-a22949026b02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:17.802898 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59f25e-d806-472c-b022-5ba817d4f479 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:17.807037 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-8e59f25e-d806-472c-b022-5ba817d4f479 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:17.807171 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743aff7-4d4c-45fb-8619-a22949026b02 service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:17.817625 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93295ca2-4ede-4d1d-87f8-ce37a749183d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:17.818231 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59f25e-d806-472c-b022-5ba817d4f479 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:17.818451 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93295ca2-4ede-4d1d-87f8-ce37a749183d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:17.818740 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93295ca2-4ede-4d1d-87f8-ce37a749183d admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:17.819100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93295ca2-4ede-4d1d-87f8-ce37a749183d admin admin] PATH_INFO: `/v3/projects/ac234ba3363547708b129747173931b5` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:17.820232 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93295ca2-4ede-4d1d-87f8-ce37a749183d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac234ba3363547708b129747173931b5)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:17.822188 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93295ca2-4ede-4d1d-87f8-ce37a749183d admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:17.823139 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e024984-3caa-470c-9fb2-062df4689129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:17.824072 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e024984-3caa-470c-9fb2-062df4689129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:17.824354 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e024984-3caa-470c-9fb2-062df4689129 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:17.824633 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e024984-3caa-470c-9fb2-062df4689129 admin admin] PATH_INFO: `/v3/projects/82a56c2722fc4fc09d872e8c6b11f405` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:17.825851 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e024984-3caa-470c-9fb2-062df4689129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82a56c2722fc4fc09d872e8c6b11f405)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:17.828314 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e024984-3caa-470c-9fb2-062df4689129 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:17.830566 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:17.927290 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-93295ca2-4ede-4d1d-87f8-ce37a749183d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac234ba3363547708b129747173931b5', 'request_id': 'req-93295ca2-4ede-4d1d-87f8-ce37a749183d'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:17.936733 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-93295ca2-4ede-4d1d-87f8-ce37a749183d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac234ba3363547708b129747173931b5', 'request_id': 'req-93295ca2-4ede-4d1d-87f8-ce37a749183d'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:17.943371 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-93295ca2-4ede-4d1d-87f8-ce37a749183d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac234ba3363547708b129747173931b5', 'request_id': 'req-93295ca2-4ede-4d1d-87f8-ce37a749183d'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:17.950449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-0e024984-3caa-470c-9fb2-062df4689129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82a56c2722fc4fc09d872e8c6b11f405', 'request_id': 'req-0e024984-3caa-470c-9fb2-062df4689129'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:17.956626 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-0e024984-3caa-470c-9fb2-062df4689129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82a56c2722fc4fc09d872e8c6b11f405', 'request_id': 'req-0e024984-3caa-470c-9fb2-062df4689129'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:17.962041 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-0e024984-3caa-470c-9fb2-062df4689129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82a56c2722fc4fc09d872e8c6b11f405', 'request_id': 'req-0e024984-3caa-470c-9fb2-062df4689129'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:18.022208 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-93295ca2-4ede-4d1d-87f8-ce37a749183d admin admin] The token cache is being invalidate because project ac234ba3363547708b129747173931b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:51:18.025536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-93295ca2-4ede-4d1d-87f8-ce37a749183d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:18.025536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-93295ca2-4ede-4d1d-87f8-ce37a749183d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:18.025536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 977/1942] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:51:17 2022] DELETE /identity/v3/projects/ac234ba3363547708b129747173931b5 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:18.028725 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93295ca2-4ede-4d1d-87f8-ce37a749183d admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:18.030113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-93295ca2-4ede-4d1d-87f8-ce37a749183d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:18.092681 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93295ca2-4ede-4d1d-87f8-ce37a749183d admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:18.109365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-0e024984-3caa-470c-9fb2-062df4689129 admin admin] The token cache is being invalidate because project 82a56c2722fc4fc09d872e8c6b11f405 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:51:18.109960 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-0e024984-3caa-470c-9fb2-062df4689129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:18.110353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-0e024984-3caa-470c-9fb2-062df4689129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:18.112398 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 966/1943] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:51:17 2022] DELETE /identity/v3/projects/82a56c2722fc4fc09d872e8c6b11f405 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:51:18.117646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e024984-3caa-470c-9fb2-062df4689129 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:18.118994 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0e024984-3caa-470c-9fb2-062df4689129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:18.168897 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266bd5f-d768-4f27-a719-99ab817b40ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:18.170081 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266bd5f-d768-4f27-a719-99ab817b40ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:18.170310 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266bd5f-d768-4f27-a719-99ab817b40ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:18.170569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266bd5f-d768-4f27-a719-99ab817b40ad admin admin] PATH_INFO: `/v3/users/f97aaa5a8c404b10b0a861df291fd82b` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:18.171818 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266bd5f-d768-4f27-a719-99ab817b40ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=f97aaa5a8c404b10b0a861df291fd82b)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:18.173938 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266bd5f-d768-4f27-a719-99ab817b40ad admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:18.194878 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e024984-3caa-470c-9fb2-062df4689129 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:18.199787 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bdf96-19f7-46f5-b115-0df60babda80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:18.200674 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bdf96-19f7-46f5-b115-0df60babda80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:18.200962 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bdf96-19f7-46f5-b115-0df60babda80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:18.201231 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bdf96-19f7-46f5-b115-0df60babda80 admin admin] PATH_INFO: `/v3/users/39aa401047aa44e3adddeb217c9162b7` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:18.202924 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8bdf96-19f7-46f5-b115-0df60babda80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39aa401047aa44e3adddeb217c9162b7)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:18.204572 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8bdf96-19f7-46f5-b115-0df60babda80 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:18.314990 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:18.335708 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-f266bd5f-d768-4f27-a719-99ab817b40ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f97aaa5a8c404b10b0a861df291fd82b'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:18.338282 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-f266bd5f-d768-4f27-a719-99ab817b40ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f97aaa5a8c404b10b0a861df291fd82b'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:18.338282 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-f266bd5f-d768-4f27-a719-99ab817b40ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f97aaa5a8c404b10b0a861df291fd82b'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:18.346130 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-f266bd5f-d768-4f27-a719-99ab817b40ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f97aaa5a8c404b10b0a861df291fd82b'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:18.382129 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-9c8bdf96-19f7-46f5-b115-0df60babda80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39aa401047aa44e3adddeb217c9162b7'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:18.382841 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-9c8bdf96-19f7-46f5-b115-0df60babda80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39aa401047aa44e3adddeb217c9162b7'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:18.402210 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-9c8bdf96-19f7-46f5-b115-0df60babda80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39aa401047aa44e3adddeb217c9162b7'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:18.405721 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-9c8bdf96-19f7-46f5-b115-0df60babda80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39aa401047aa44e3adddeb217c9162b7'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:18.440533 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-f266bd5f-d768-4f27-a719-99ab817b40ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f97aaa5a8c404b10b0a861df291fd82b'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:18.471097 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 978/1944] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:51:18 2022] DELETE /identity/v3/users/f97aaa5a8c404b10b0a861df291fd82b => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:51:18.519982 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-9c8bdf96-19f7-46f5-b115-0df60babda80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39aa401047aa44e3adddeb217c9162b7'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:18.561969 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 967/1945] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:51:18 2022] DELETE /identity/v3/users/39aa401047aa44e3adddeb217c9162b7 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:19.868000 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266bd5f-d768-4f27-a719-99ab817b40ad admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:19.868000 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-f266bd5f-d768-4f27-a719-99ab817b40ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:19.952658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bdf96-19f7-46f5-b115-0df60babda80 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:19.952658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9c8bdf96-19f7-46f5-b115-0df60babda80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:19.981979 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:20.049485 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266bd5f-d768-4f27-a719-99ab817b40ad admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:20.102578 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bdf96-19f7-46f5-b115-0df60babda80 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:20.108161 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d94210-cf6a-4fab-876f-4e5a585c3c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:20.109212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d94210-cf6a-4fab-876f-4e5a585c3c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:20.109578 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d94210-cf6a-4fab-876f-4e5a585c3c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:20.109871 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d94210-cf6a-4fab-876f-4e5a585c3c99 admin admin] PATH_INFO: `/v3/projects/d94bf305c76f4f4192863b8040b3ffe8` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:20.111222 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d94210-cf6a-4fab-876f-4e5a585c3c99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d94bf305c76f4f4192863b8040b3ffe8)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:20.113370 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d94210-cf6a-4fab-876f-4e5a585c3c99 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:20.191985 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb188e-1bff-450a-917d-49f5eb4714ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:20.193278 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb188e-1bff-450a-917d-49f5eb4714ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:20.199135 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb188e-1bff-450a-917d-49f5eb4714ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:20.199135 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb188e-1bff-450a-917d-49f5eb4714ed admin admin] PATH_INFO: `/v3/projects/098fe6560a2c45daaf3596b6258a3b64` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:20.199135 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb188e-1bff-450a-917d-49f5eb4714ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=098fe6560a2c45daaf3596b6258a3b64)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:20.199135 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb188e-1bff-450a-917d-49f5eb4714ed admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:20.286211 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b7d94210-cf6a-4fab-876f-4e5a585c3c99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd94bf305c76f4f4192863b8040b3ffe8', 'request_id': 'req-b7d94210-cf6a-4fab-876f-4e5a585c3c99'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:20.293496 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b7d94210-cf6a-4fab-876f-4e5a585c3c99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd94bf305c76f4f4192863b8040b3ffe8', 'request_id': 'req-b7d94210-cf6a-4fab-876f-4e5a585c3c99'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:20.299267 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b7d94210-cf6a-4fab-876f-4e5a585c3c99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd94bf305c76f4f4192863b8040b3ffe8', 'request_id': 'req-b7d94210-cf6a-4fab-876f-4e5a585c3c99'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:20.327255 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-8acb188e-1bff-450a-917d-49f5eb4714ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '098fe6560a2c45daaf3596b6258a3b64', 'request_id': 'req-8acb188e-1bff-450a-917d-49f5eb4714ed'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:20.334402 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-8acb188e-1bff-450a-917d-49f5eb4714ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '098fe6560a2c45daaf3596b6258a3b64', 'request_id': 'req-8acb188e-1bff-450a-917d-49f5eb4714ed'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:20.338896 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:20.341418 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-8acb188e-1bff-450a-917d-49f5eb4714ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '098fe6560a2c45daaf3596b6258a3b64', 'request_id': 'req-8acb188e-1bff-450a-917d-49f5eb4714ed'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:20.396610 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b7d94210-cf6a-4fab-876f-4e5a585c3c99 admin admin] The token cache is being invalidate because project d94bf305c76f4f4192863b8040b3ffe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:51:20.396610 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b7d94210-cf6a-4fab-876f-4e5a585c3c99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:20.396610 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b7d94210-cf6a-4fab-876f-4e5a585c3c99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:20.397237 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 968/1946] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:51:19 2022] DELETE /identity/v3/projects/d94bf305c76f4f4192863b8040b3ffe8 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:20.402022 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae278a82-90f2-43bb-8e80-1e4ae62d6d12 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:20.402997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae278a82-90f2-43bb-8e80-1e4ae62d6d12 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:20.403361 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae278a82-90f2-43bb-8e80-1e4ae62d6d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:20.430639 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-ae278a82-90f2-43bb-8e80-1e4ae62d6d12 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:20.431911 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-ae278a82-90f2-43bb-8e80-1e4ae62d6d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:20.481319 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-8acb188e-1bff-450a-917d-49f5eb4714ed admin admin] The token cache is being invalidate because project 098fe6560a2c45daaf3596b6258a3b64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:51:20.482306 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-8acb188e-1bff-450a-917d-49f5eb4714ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:20.483482 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-8acb188e-1bff-450a-917d-49f5eb4714ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:20.485661 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 979/1947] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:51:19 2022] DELETE /identity/v3/projects/098fe6560a2c45daaf3596b6258a3b64 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:20.490925 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09888c-bf33-4461-b80c-0d409f678ec5 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:20.491217 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09888c-bf33-4461-b80c-0d409f678ec5 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:20.491500 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09888c-bf33-4461-b80c-0d409f678ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:20.521249 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 969/1948] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:51:20.522037 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-4b09888c-bf33-4461-b80c-0d409f678ec5 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:20.524016 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-4b09888c-bf33-4461-b80c-0d409f678ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:20.529609 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ef0a5-e175-416e-bdd7-1de8bc07db23 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:20.529904 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ef0a5-e175-416e-bdd7-1de8bc07db23 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:20.530217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ef0a5-e175-416e-bdd7-1de8bc07db23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:20.546919 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 980/1949] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:51:20.548849 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc089f2-74e1-482a-badd-7d68a1a01ad8 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:20.549145 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc089f2-74e1-482a-badd-7d68a1a01ad8 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:20.549428 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc089f2-74e1-482a-badd-7d68a1a01ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:20.559444 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-9e3ef0a5-e175-416e-bdd7-1de8bc07db23 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:20.561873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9e3ef0a5-e175-416e-bdd7-1de8bc07db23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:20.571864 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 970/1950] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:20.575857 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ef0a5-e175-416e-bdd7-1de8bc07db23 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:20.576768 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-5fc089f2-74e1-482a-badd-7d68a1a01ad8 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:20.578272 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-5fc089f2-74e1-482a-badd-7d68a1a01ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:20.586831 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ef0a5-e175-416e-bdd7-1de8bc07db23 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:20.588921 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 981/1951] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:51:20.593282 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc089f2-74e1-482a-badd-7d68a1a01ad8 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:20.596174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83a068-6769-475f-ad0f-5617e857af99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:20.597019 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83a068-6769-475f-ad0f-5617e857af99 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:20.597887 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83a068-6769-475f-ad0f-5617e857af99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:20.598589 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83a068-6769-475f-ad0f-5617e857af99 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:20.599313 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83a068-6769-475f-ad0f-5617e857af99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:51:20.599919 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83a068-6769-475f-ad0f-5617e857af99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:20.602187 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83a068-6769-475f-ad0f-5617e857af99 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:20.605997 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc089f2-74e1-482a-badd-7d68a1a01ad8 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:20.611793 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7311f3a-0dd4-41bc-8344-8b5b70603b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:20.612623 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7311f3a-0dd4-41bc-8344-8b5b70603b1d admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:20.612785 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7311f3a-0dd4-41bc-8344-8b5b70603b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:20.613227 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7311f3a-0dd4-41bc-8344-8b5b70603b1d admin admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:20.614191 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7311f3a-0dd4-41bc-8344-8b5b70603b1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:51:20.614502 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7311f3a-0dd4-41bc-8344-8b5b70603b1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:20.616247 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7311f3a-0dd4-41bc-8344-8b5b70603b1d admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:20.617901 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 971/1952] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:51:20.628676 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83a068-6769-475f-ad0f-5617e857af99 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:20.639538 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 982/1953] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:51:20.640898 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7311f3a-0dd4-41bc-8344-8b5b70603b1d admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:20.647136 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83a068-6769-475f-ad0f-5617e857af99 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:20.652139 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7311f3a-0dd4-41bc-8344-8b5b70603b1d admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:20.653900 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa2b51-566e-4a57-bcdf-1aae76a13715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:20.654954 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa2b51-566e-4a57-bcdf-1aae76a13715 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:20.655646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa2b51-566e-4a57-bcdf-1aae76a13715 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:20.656443 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa2b51-566e-4a57-bcdf-1aae76a13715 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:20.657454 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa2b51-566e-4a57-bcdf-1aae76a13715 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:20.658461 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb59851-7ad2-42af-95f1-e188c862eabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:20.659414 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb59851-7ad2-42af-95f1-e188c862eabe admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:20.660307 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa2b51-566e-4a57-bcdf-1aae76a13715 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:20.660471 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb59851-7ad2-42af-95f1-e188c862eabe admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:20.661311 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb59851-7ad2-42af-95f1-e188c862eabe admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:20.662238 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb59851-7ad2-42af-95f1-e188c862eabe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:20.664481 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb59851-7ad2-42af-95f1-e188c862eabe admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:20.773040 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:20.779679 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 972/1954] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:51:20 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:20.784990 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa2b51-566e-4a57-bcdf-1aae76a13715 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:20.802812 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 983/1955] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:51:20 2022] POST /identity/v3/projects => generated 369 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:51:20.804266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb59851-7ad2-42af-95f1-e188c862eabe admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:20.884454 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa2b51-566e-4a57-bcdf-1aae76a13715 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:20.941997 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb59851-7ad2-42af-95f1-e188c862eabe admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:20.961866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34664d86-dd1a-42a0-939b-d0efc4aba8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:20.962563 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34664d86-dd1a-42a0-939b-d0efc4aba8f3 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:20.962852 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34664d86-dd1a-42a0-939b-d0efc4aba8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:20.963135 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34664d86-dd1a-42a0-939b-d0efc4aba8f3 admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:20.963944 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34664d86-dd1a-42a0-939b-d0efc4aba8f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:20.965898 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34664d86-dd1a-42a0-939b-d0efc4aba8f3 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:20.969575 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083970c-dcdd-4716-9aea-7f626c2123cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:20.975167 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083970c-dcdd-4716-9aea-7f626c2123cc admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:20.975823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083970c-dcdd-4716-9aea-7f626c2123cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:20.984479 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083970c-dcdd-4716-9aea-7f626c2123cc admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:20.985421 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083970c-dcdd-4716-9aea-7f626c2123cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:20.987567 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083970c-dcdd-4716-9aea-7f626c2123cc admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:21.061478 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 984/1956] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:51:20 2022] POST /identity/v3/users => generated 285 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:21.065200 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34664d86-dd1a-42a0-939b-d0efc4aba8f3 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:21.080930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 973/1957] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:51:20 2022] POST /identity/v3/users => generated 287 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:21.086074 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083970c-dcdd-4716-9aea-7f626c2123cc admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:21.091829 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34664d86-dd1a-42a0-939b-d0efc4aba8f3 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:21.101373 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083970c-dcdd-4716-9aea-7f626c2123cc admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:21.102190 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6090e6-3ae2-434a-b8a9-b5d38de27f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:21.103832 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6090e6-3ae2-434a-b8a9-b5d38de27f78 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:21.104137 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6090e6-3ae2-434a-b8a9-b5d38de27f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:21.104419 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6090e6-3ae2-434a-b8a9-b5d38de27f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:21.106008 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6090e6-3ae2-434a-b8a9-b5d38de27f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:21.112068 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6090e6-3ae2-434a-b8a9-b5d38de27f78 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:21.115869 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799236a-67f9-4942-8a90-9528b8b9d4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:21.116571 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799236a-67f9-4942-8a90-9528b8b9d4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:21.116929 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799236a-67f9-4942-8a90-9528b8b9d4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:21.117225 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799236a-67f9-4942-8a90-9528b8b9d4d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:21.117957 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799236a-67f9-4942-8a90-9528b8b9d4d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:21.119588 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799236a-67f9-4942-8a90-9528b8b9d4d9 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:21.121571 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 985/1958] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:51:21.125143 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6090e6-3ae2-434a-b8a9-b5d38de27f78 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:21.141269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6090e6-3ae2-434a-b8a9-b5d38de27f78 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:21.143418 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de38db-131f-498d-a622-b1ca82f2711c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:21.144174 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de38db-131f-498d-a622-b1ca82f2711c admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:21.144468 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de38db-131f-498d-a622-b1ca82f2711c admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:21.144754 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de38db-131f-498d-a622-b1ca82f2711c admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:21.145558 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de38db-131f-498d-a622-b1ca82f2711c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:21.146993 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 974/1959] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:51:21.147208 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de38db-131f-498d-a622-b1ca82f2711c admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:21.151318 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799236a-67f9-4942-8a90-9528b8b9d4d9 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:21.161574 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 986/1960] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:51:21.164767 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799236a-67f9-4942-8a90-9528b8b9d4d9 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:21.169564 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042aa9c-cbfb-48e6-ab0d-cc08f6e8a69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:21.170413 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042aa9c-cbfb-48e6-ab0d-cc08f6e8a69f admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:21.170855 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042aa9c-cbfb-48e6-ab0d-cc08f6e8a69f admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:21.171121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042aa9c-cbfb-48e6-ab0d-cc08f6e8a69f admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:21.171971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042aa9c-cbfb-48e6-ab0d-cc08f6e8a69f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:21.174214 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042aa9c-cbfb-48e6-ab0d-cc08f6e8a69f admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:21.174600 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de38db-131f-498d-a622-b1ca82f2711c admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:21.192481 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 975/1961] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:51:21.198319 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042aa9c-cbfb-48e6-ab0d-cc08f6e8a69f admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:21.205866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042aa9c-cbfb-48e6-ab0d-cc08f6e8a69f admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:21.208291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de38db-131f-498d-a622-b1ca82f2711c admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:21.213235 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969defd-175e-4022-8848-f8c84c58f331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:21.215698 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969defd-175e-4022-8848-f8c84c58f331 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:21.216707 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969defd-175e-4022-8848-f8c84c58f331 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:21.217999 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae33938-1818-4f89-a33e-df3bc184b52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:21.218960 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae33938-1818-4f89-a33e-df3bc184b52b admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:21.219853 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae33938-1818-4f89-a33e-df3bc184b52b admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:21.220083 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969defd-175e-4022-8848-f8c84c58f331 admin admin] PATH_INFO: `/v3/projects/c014bbe61f164cd39ed33e63b4e36b04/users/bd7f5bd2d0b24b85b7617d95a1cd3d29/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:21.220260 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae33938-1818-4f89-a33e-df3bc184b52b admin admin] PATH_INFO: `/v3/projects/f14646fd5bab4cd5af1d9af5e17ab8b8/users/f52d0221315b4dc0a293ac651dad05df/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:21.245630 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae33938-1818-4f89-a33e-df3bc184b52b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f14646fd5bab4cd5af1d9af5e17ab8b8, user_id=f52d0221315b4dc0a293ac651dad05df, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:21.246930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6969defd-175e-4022-8848-f8c84c58f331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c014bbe61f164cd39ed33e63b4e36b04, user_id=bd7f5bd2d0b24b85b7617d95a1cd3d29, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:21.248645 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae33938-1818-4f89-a33e-df3bc184b52b admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:21.252320 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6969defd-175e-4022-8848-f8c84c58f331 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:21.345449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 976/1962] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:51:21 2022] PUT /identity/v3/projects/c014bbe61f164cd39ed33e63b4e36b04/users/bd7f5bd2d0b24b85b7617d95a1cd3d29/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:21.364069 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 987/1963] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:51:21 2022] PUT /identity/v3/projects/f14646fd5bab4cd5af1d9af5e17ab8b8/users/f52d0221315b4dc0a293ac651dad05df/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:51:21.365312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3edba-f563-42dc-beb3-71949ca47090 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:21.365881 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3edba-f563-42dc-beb3-71949ca47090 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:21.366312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3edba-f563-42dc-beb3-71949ca47090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:21.374212 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd6ede-5663-4221-9435-c08a8f41566c None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:21.374604 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd6ede-5663-4221-9435-c08a8f41566c None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:21.374986 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd6ede-5663-4221-9435-c08a8f41566c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:21.410757 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-b1a3edba-f563-42dc-beb3-71949ca47090 None None] MFA Rules not processed for user `bd7f5bd2d0b24b85b7617d95a1cd3d29`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:21.412375 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b1a3edba-f563-42dc-beb3-71949ca47090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:21.427142 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-8ccd6ede-5663-4221-9435-c08a8f41566c None None] MFA Rules not processed for user `f52d0221315b4dc0a293ac651dad05df`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:21.428731 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-8ccd6ede-5663-4221-9435-c08a8f41566c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:21.477467 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:21.478010 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=92,keystone:DELETE=2,keystone:INSERT=6 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:21.508838 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 977/1964] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:21.519764 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 988/1965] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:51:21.522704 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3edba-f563-42dc-beb3-71949ca47090 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:21.524150 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b1a3edba-f563-42dc-beb3-71949ca47090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:21.526727 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd6ede-5663-4221-9435-c08a8f41566c None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:21.583300 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3edba-f563-42dc-beb3-71949ca47090 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:21.587125 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74301dd-6dbb-4996-b792-d675c7ebf34f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:21.587823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74301dd-6dbb-4996-b792-d675c7ebf34f service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:21.588111 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74301dd-6dbb-4996-b792-d675c7ebf34f service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:21.588402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74301dd-6dbb-4996-b792-d675c7ebf34f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:21.602640 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74301dd-6dbb-4996-b792-d675c7ebf34f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:21.603283 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd6ede-5663-4221-9435-c08a8f41566c None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:21.604977 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74301dd-6dbb-4996-b792-d675c7ebf34f service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:21.608653 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed81b5f-9935-46ca-8ab8-edb2350423fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:21.609660 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed81b5f-9935-46ca-8ab8-edb2350423fe admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:21.609962 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed81b5f-9935-46ca-8ab8-edb2350423fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:21.610296 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed81b5f-9935-46ca-8ab8-edb2350423fe admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:21.611057 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed81b5f-9935-46ca-8ab8-edb2350423fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:21.613928 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed81b5f-9935-46ca-8ab8-edb2350423fe admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:21.617249 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 978/1966] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:51:21.740435 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 989/1967] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:51:21 2022] POST /identity/v3/projects => generated 367 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:51:21.745093 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74301dd-6dbb-4996-b792-d675c7ebf34f service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:21.761442 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74301dd-6dbb-4996-b792-d675c7ebf34f service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:21.855023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615e612-ff7a-4607-aafb-07eefc341f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:21.855932 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615e612-ff7a-4607-aafb-07eefc341f08 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:21.856229 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615e612-ff7a-4607-aafb-07eefc341f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:21.856512 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615e612-ff7a-4607-aafb-07eefc341f08 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:21.857355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5615e612-ff7a-4607-aafb-07eefc341f08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:21.859989 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5615e612-ff7a-4607-aafb-07eefc341f08 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:21.944212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 979/1968] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:51:21 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:21.948219 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed81b5f-9935-46ca-8ab8-edb2350423fe admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:21.959405 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed81b5f-9935-46ca-8ab8-edb2350423fe admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:21.964089 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cd6bb-b997-43bc-a0bb-0ab78c5a2c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:21.964759 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cd6bb-b997-43bc-a0bb-0ab78c5a2c46 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:21.965042 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cd6bb-b997-43bc-a0bb-0ab78c5a2c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:21.965317 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cd6bb-b997-43bc-a0bb-0ab78c5a2c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:21.966057 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5cd6bb-b997-43bc-a0bb-0ab78c5a2c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:21.967686 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5cd6bb-b997-43bc-a0bb-0ab78c5a2c46 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:21.979204 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 990/1969] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:51:21.983747 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615e612-ff7a-4607-aafb-07eefc341f08 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:21.995963 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615e612-ff7a-4607-aafb-07eefc341f08 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:22.000597 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c27f8e-bc53-49ec-a0a3-062519f59010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:22.001504 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c27f8e-bc53-49ec-a0a3-062519f59010 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:22.001786 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c27f8e-bc53-49ec-a0a3-062519f59010 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:22.002061 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c27f8e-bc53-49ec-a0a3-062519f59010 admin admin] PATH_INFO: `/v3/projects/63c87e90cfab4f6f8805df6f39a59a2c/users/b951eb57766544d38847b08fb8bd4aed/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:22.018020 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c27f8e-bc53-49ec-a0a3-062519f59010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63c87e90cfab4f6f8805df6f39a59a2c, user_id=b951eb57766544d38847b08fb8bd4aed, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:22.021143 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c27f8e-bc53-49ec-a0a3-062519f59010 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:22.109222 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 980/1970] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:51:21 2022] PUT /identity/v3/projects/63c87e90cfab4f6f8805df6f39a59a2c/users/b951eb57766544d38847b08fb8bd4aed/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:22.115676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cd6bb-b997-43bc-a0bb-0ab78c5a2c46 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:22.126454 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cd6bb-b997-43bc-a0bb-0ab78c5a2c46 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:22.202695 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a41735-949c-4025-be4e-6fb937755cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:22.202695 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a41735-949c-4025-be4e-6fb937755cda admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:22.203255 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a41735-949c-4025-be4e-6fb937755cda admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:22.203684 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a41735-949c-4025-be4e-6fb937755cda admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:22.205625 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a41735-949c-4025-be4e-6fb937755cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:22.209112 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a41735-949c-4025-be4e-6fb937755cda admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:22.230918 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 991/1971] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:51:22.232706 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c27f8e-bc53-49ec-a0a3-062519f59010 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:22.245302 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c27f8e-bc53-49ec-a0a3-062519f59010 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:22.252052 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20168aa7-a577-48e1-a514-4918997ca356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:22.254950 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20168aa7-a577-48e1-a514-4918997ca356 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:22.255293 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20168aa7-a577-48e1-a514-4918997ca356 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:22.258153 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20168aa7-a577-48e1-a514-4918997ca356 admin admin] PATH_INFO: `/v3/projects/63c87e90cfab4f6f8805df6f39a59a2c/users/b951eb57766544d38847b08fb8bd4aed/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:22.258153 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20168aa7-a577-48e1-a514-4918997ca356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63c87e90cfab4f6f8805df6f39a59a2c, user_id=b951eb57766544d38847b08fb8bd4aed, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:22.260513 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20168aa7-a577-48e1-a514-4918997ca356 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:22.272070 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 981/1972] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:51:22 2022] PUT /identity/v3/projects/63c87e90cfab4f6f8805df6f39a59a2c/users/b951eb57766544d38847b08fb8bd4aed/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:22.282885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f834ab-23d9-4fba-a8f0-b9fe35473ac3 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:22.283138 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f834ab-23d9-4fba-a8f0-b9fe35473ac3 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:22.286457 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f834ab-23d9-4fba-a8f0-b9fe35473ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:22.316292 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-b8f834ab-23d9-4fba-a8f0-b9fe35473ac3 None None] MFA Rules not processed for user `b951eb57766544d38847b08fb8bd4aed`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:22.321171 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-b8f834ab-23d9-4fba-a8f0-b9fe35473ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:22.348968 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:22.397520 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 992/1973] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:22 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:51:22.409743 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20168aa7-a577-48e1-a514-4918997ca356 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:22.411482 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-20168aa7-a577-48e1-a514-4918997ca356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:22.482082 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:22.546272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20168aa7-a577-48e1-a514-4918997ca356 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:22.554335 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa83ae-689f-42b0-bce9-fd3b2112c1d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:22.555007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa83ae-689f-42b0-bce9-fd3b2112c1d2 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:22.555294 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa83ae-689f-42b0-bce9-fd3b2112c1d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:22.555570 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa83ae-689f-42b0-bce9-fd3b2112c1d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:22.584401 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa83ae-689f-42b0-bce9-fd3b2112c1d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:22.584401 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa83ae-689f-42b0-bce9-fd3b2112c1d2 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:22.617587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 982/1974] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:22 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:51:23.340738 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f834ab-23d9-4fba-a8f0-b9fe35473ac3 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:23.340738 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-b8f834ab-23d9-4fba-a8f0-b9fe35473ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:23.434867 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f834ab-23d9-4fba-a8f0-b9fe35473ac3 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:23.442577 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4482e07-5210-428f-8f5e-72f5df09f6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:23.443571 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4482e07-5210-428f-8f5e-72f5df09f6dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:23.444236 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4482e07-5210-428f-8f5e-72f5df09f6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:23.444927 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4482e07-5210-428f-8f5e-72f5df09f6dd admin admin] PATH_INFO: `/v3/users/0376c2c849e0490b8dfd77bcf14ec63f` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:23.446565 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4482e07-5210-428f-8f5e-72f5df09f6dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0376c2c849e0490b8dfd77bcf14ec63f)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:23.449711 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4482e07-5210-428f-8f5e-72f5df09f6dd admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:23.791169 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-a4482e07-5210-428f-8f5e-72f5df09f6dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0376c2c849e0490b8dfd77bcf14ec63f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:23.791169 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-a4482e07-5210-428f-8f5e-72f5df09f6dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0376c2c849e0490b8dfd77bcf14ec63f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:23.791169 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-a4482e07-5210-428f-8f5e-72f5df09f6dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0376c2c849e0490b8dfd77bcf14ec63f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:23.795681 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-a4482e07-5210-428f-8f5e-72f5df09f6dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0376c2c849e0490b8dfd77bcf14ec63f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:23.965095 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-a4482e07-5210-428f-8f5e-72f5df09f6dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0376c2c849e0490b8dfd77bcf14ec63f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:23.985473 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 993/1975] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:51:23 2022] DELETE /identity/v3/users/0376c2c849e0490b8dfd77bcf14ec63f => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:23.991321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efeb63-50f8-47c0-898f-ddebcb5c2740 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:23.991868 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efeb63-50f8-47c0-898f-ddebcb5c2740 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:23.991963 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efeb63-50f8-47c0-898f-ddebcb5c2740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:24.012291 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-f2efeb63-50f8-47c0-898f-ddebcb5c2740 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:24.013761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f2efeb63-50f8-47c0-898f-ddebcb5c2740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:24.079658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 983/1976] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:24.089366 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4482e07-5210-428f-8f5e-72f5df09f6dd admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:24.090787 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-a4482e07-5210-428f-8f5e-72f5df09f6dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:24.153327 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:24.178274 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4482e07-5210-428f-8f5e-72f5df09f6dd admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:24.182645 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6fa28c-9e33-498a-938a-d4f357dd9c75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:24.183526 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fa28c-9e33-498a-938a-d4f357dd9c75 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:24.183731 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fa28c-9e33-498a-938a-d4f357dd9c75 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:24.184784 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fa28c-9e33-498a-938a-d4f357dd9c75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:24.212938 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6fa28c-9e33-498a-938a-d4f357dd9c75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:24.214984 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6fa28c-9e33-498a-938a-d4f357dd9c75 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:24.231499 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 994/1977] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:51:24.885334 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efeb63-50f8-47c0-898f-ddebcb5c2740 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:24.886941 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f2efeb63-50f8-47c0-898f-ddebcb5c2740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:24.902333 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efeb63-50f8-47c0-898f-ddebcb5c2740 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:24.913231 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb310ad-a3f6-4bea-8f50-154735083ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:24.914319 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb310ad-a3f6-4bea-8f50-154735083ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:24.915042 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb310ad-a3f6-4bea-8f50-154735083ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:24.915323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb310ad-a3f6-4bea-8f50-154735083ddb admin admin] PATH_INFO: `/v3/projects/febb4d9ec414429aad6ac7ba139a1f57` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:24.916787 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb310ad-a3f6-4bea-8f50-154735083ddb admin admin] RBAC: Authorizing `identity:delete_project(project_id=febb4d9ec414429aad6ac7ba139a1f57)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:24.918773 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb310ad-a3f6-4bea-8f50-154735083ddb admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:25.096077 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-efb310ad-a3f6-4bea-8f50-154735083ddb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'febb4d9ec414429aad6ac7ba139a1f57', 'request_id': 'req-efb310ad-a3f6-4bea-8f50-154735083ddb'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:25.103421 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-efb310ad-a3f6-4bea-8f50-154735083ddb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'febb4d9ec414429aad6ac7ba139a1f57', 'request_id': 'req-efb310ad-a3f6-4bea-8f50-154735083ddb'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:25.109771 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-efb310ad-a3f6-4bea-8f50-154735083ddb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'febb4d9ec414429aad6ac7ba139a1f57', 'request_id': 'req-efb310ad-a3f6-4bea-8f50-154735083ddb'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:25.188707 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-efb310ad-a3f6-4bea-8f50-154735083ddb admin admin] The token cache is being invalidate because project febb4d9ec414429aad6ac7ba139a1f57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:51:25.188937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-efb310ad-a3f6-4bea-8f50-154735083ddb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:25.189573 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-efb310ad-a3f6-4bea-8f50-154735083ddb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:25.195970 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6fa28c-9e33-498a-938a-d4f357dd9c75 service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:25.196491 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 984/1978] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:51:24 2022] DELETE /identity/v3/projects/febb4d9ec414429aad6ac7ba139a1f57 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:25.212061 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6fa28c-9e33-498a-938a-d4f357dd9c75 service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:25.279724 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392371c-39f6-43a7-97f0-cc1f31ed7aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:25.280596 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392371c-39f6-43a7-97f0-cc1f31ed7aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:25.281145 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392371c-39f6-43a7-97f0-cc1f31ed7aed admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:25.281419 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392371c-39f6-43a7-97f0-cc1f31ed7aed admin admin] PATH_INFO: `/v3/users/9c4494db2ff54d33988973fe1cb76fe9` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:25.282604 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392371c-39f6-43a7-97f0-cc1f31ed7aed admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c4494db2ff54d33988973fe1cb76fe9)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:25.285159 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392371c-39f6-43a7-97f0-cc1f31ed7aed admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:25.478048 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-0392371c-39f6-43a7-97f0-cc1f31ed7aed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c4494db2ff54d33988973fe1cb76fe9'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:25.478752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-0392371c-39f6-43a7-97f0-cc1f31ed7aed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c4494db2ff54d33988973fe1cb76fe9'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:25.479364 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-0392371c-39f6-43a7-97f0-cc1f31ed7aed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c4494db2ff54d33988973fe1cb76fe9'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:25.486768 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-0392371c-39f6-43a7-97f0-cc1f31ed7aed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c4494db2ff54d33988973fe1cb76fe9'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:25.565591 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-0392371c-39f6-43a7-97f0-cc1f31ed7aed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c4494db2ff54d33988973fe1cb76fe9'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:25.585524 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 995/1979] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:51:25 2022] DELETE /identity/v3/users/9c4494db2ff54d33988973fe1cb76fe9 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:26.179724 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb310ad-a3f6-4bea-8f50-154735083ddb admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:26.181189 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-efb310ad-a3f6-4bea-8f50-154735083ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:26.204521 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb310ad-a3f6-4bea-8f50-154735083ddb admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:26.283233 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61bac1-db39-48da-99af-15c844202256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:26.284148 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61bac1-db39-48da-99af-15c844202256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:26.284430 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61bac1-db39-48da-99af-15c844202256 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:26.285028 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61bac1-db39-48da-99af-15c844202256 admin admin] PATH_INFO: `/v3/projects/d8624bd9bfec47b4bdb635d41476d17a` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:26.286653 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61bac1-db39-48da-99af-15c844202256 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8624bd9bfec47b4bdb635d41476d17a)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:26.288992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61bac1-db39-48da-99af-15c844202256 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:26.303384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:26.412143 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4e61bac1-db39-48da-99af-15c844202256 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8624bd9bfec47b4bdb635d41476d17a', 'request_id': 'req-4e61bac1-db39-48da-99af-15c844202256'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:26.418303 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4e61bac1-db39-48da-99af-15c844202256 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8624bd9bfec47b4bdb635d41476d17a', 'request_id': 'req-4e61bac1-db39-48da-99af-15c844202256'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:26.423897 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4e61bac1-db39-48da-99af-15c844202256 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8624bd9bfec47b4bdb635d41476d17a', 'request_id': 'req-4e61bac1-db39-48da-99af-15c844202256'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:26.519559 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4e61bac1-db39-48da-99af-15c844202256 admin admin] The token cache is being invalidate because project d8624bd9bfec47b4bdb635d41476d17a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:51:26.519559 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4e61bac1-db39-48da-99af-15c844202256 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:26.519559 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4e61bac1-db39-48da-99af-15c844202256 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:26.519559 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 985/1980] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:51:26 2022] DELETE /identity/v3/projects/d8624bd9bfec47b4bdb635d41476d17a => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:26.524545 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f764e57-0cb7-4f2e-b72b-38c447e54849 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:26.525024 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f764e57-0cb7-4f2e-b72b-38c447e54849 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:26.525125 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f764e57-0cb7-4f2e-b72b-38c447e54849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:26.549601 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-3f764e57-0cb7-4f2e-b72b-38c447e54849 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:26.549601 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-3f764e57-0cb7-4f2e-b72b-38c447e54849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:26.675135 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 996/1981] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:26.687395 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80c28d-1785-4754-bc08-83d8a56d7282 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:26.687395 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80c28d-1785-4754-bc08-83d8a56d7282 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:26.687395 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80c28d-1785-4754-bc08-83d8a56d7282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:26.729560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-4a80c28d-1785-4754-bc08-83d8a56d7282 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:26.730887 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4a80c28d-1785-4754-bc08-83d8a56d7282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:26.756977 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 986/1982] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:51:26.765253 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f764e57-0cb7-4f2e-b72b-38c447e54849 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:26.779223 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f764e57-0cb7-4f2e-b72b-38c447e54849 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:26.796010 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d759e82-8b33-4b1b-9e2c-d38160b548f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:26.796754 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d759e82-8b33-4b1b-9e2c-d38160b548f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:26.797043 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d759e82-8b33-4b1b-9e2c-d38160b548f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:26.797948 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d759e82-8b33-4b1b-9e2c-d38160b548f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:26.808111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d759e82-8b33-4b1b-9e2c-d38160b548f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:51:26.808111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d759e82-8b33-4b1b-9e2c-d38160b548f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:26.808111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d759e82-8b33-4b1b-9e2c-d38160b548f7 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:26.812227 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:26.842697 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80c28d-1785-4754-bc08-83d8a56d7282 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:26.850276 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 997/1983] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:51:26.858643 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80c28d-1785-4754-bc08-83d8a56d7282 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:26.872963 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02666d6-9f95-452a-911a-a08d4b6a7c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:26.873841 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02666d6-9f95-452a-911a-a08d4b6a7c8a admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:26.874300 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02666d6-9f95-452a-911a-a08d4b6a7c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:26.874797 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02666d6-9f95-452a-911a-a08d4b6a7c8a admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:26.876607 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02666d6-9f95-452a-911a-a08d4b6a7c8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:26.880297 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02666d6-9f95-452a-911a-a08d4b6a7c8a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:27.024430 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 987/1984] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:51:26 2022] POST /identity/v3/projects => generated 399 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:27.025228 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d759e82-8b33-4b1b-9e2c-d38160b548f7 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:27.036797 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d759e82-8b33-4b1b-9e2c-d38160b548f7 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:27.117046 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ae981-9c8b-4ff8-8283-c25a059c58ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:27.117894 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ae981-9c8b-4ff8-8283-c25a059c58ba admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:27.118791 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ae981-9c8b-4ff8-8283-c25a059c58ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:27.119085 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ae981-9c8b-4ff8-8283-c25a059c58ba admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:27.120133 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ae981-9c8b-4ff8-8283-c25a059c58ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:27.125096 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ae981-9c8b-4ff8-8283-c25a059c58ba admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:27.212740 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 998/1985] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:51:27 2022] POST /identity/v3/users => generated 300 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:27.216906 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02666d6-9f95-452a-911a-a08d4b6a7c8a admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:27.229845 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02666d6-9f95-452a-911a-a08d4b6a7c8a admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:27.235302 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e9d6d-066c-4572-a9e4-dfb30f0a2466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:27.236014 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e9d6d-066c-4572-a9e4-dfb30f0a2466 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:27.236299 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e9d6d-066c-4572-a9e4-dfb30f0a2466 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:27.236574 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e9d6d-066c-4572-a9e4-dfb30f0a2466 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:27.237388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e9d6d-066c-4572-a9e4-dfb30f0a2466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:27.239908 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e9d6d-066c-4572-a9e4-dfb30f0a2466 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:27.250903 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 988/1986] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:51:27.260760 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ae981-9c8b-4ff8-8283-c25a059c58ba admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:27.273034 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ae981-9c8b-4ff8-8283-c25a059c58ba admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:27.281739 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f6a4f-c198-42c9-a9d0-147a33cfa9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:27.281739 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f6a4f-c198-42c9-a9d0-147a33cfa9fa admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:27.281739 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f6a4f-c198-42c9-a9d0-147a33cfa9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:27.281739 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f6a4f-c198-42c9-a9d0-147a33cfa9fa admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:27.282330 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f6a4f-c198-42c9-a9d0-147a33cfa9fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:27.283709 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f6a4f-c198-42c9-a9d0-147a33cfa9fa admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:27.305454 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e9d6d-066c-4572-a9e4-dfb30f0a2466 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:27.314468 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 999/1987] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:51:27.321273 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e9d6d-066c-4572-a9e4-dfb30f0a2466 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:27.327854 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e50b6e-7e57-42d1-92e3-c95d89086458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:27.329001 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e50b6e-7e57-42d1-92e3-c95d89086458 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:27.329438 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e50b6e-7e57-42d1-92e3-c95d89086458 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:27.329863 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e50b6e-7e57-42d1-92e3-c95d89086458 admin admin] PATH_INFO: `/v3/projects/49127f0d5bfe4ef1bf5600f6bf68d79a/users/81bcb959154e4a46b6cd407d8497d206/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:27.356186 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e50b6e-7e57-42d1-92e3-c95d89086458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49127f0d5bfe4ef1bf5600f6bf68d79a, user_id=81bcb959154e4a46b6cd407d8497d206, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:27.360650 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e50b6e-7e57-42d1-92e3-c95d89086458 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:27.466213 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 989/1988] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:51:27 2022] PUT /identity/v3/projects/49127f0d5bfe4ef1bf5600f6bf68d79a/users/81bcb959154e4a46b6cd407d8497d206/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:27.479483 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f826967-f608-40c0-b6a5-c1464ba2aead None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:27.479803 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f826967-f608-40c0-b6a5-c1464ba2aead None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:27.484716 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f826967-f608-40c0-b6a5-c1464ba2aead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:27.529415 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-5f826967-f608-40c0-b6a5-c1464ba2aead None None] MFA Rules not processed for user `81bcb959154e4a46b6cd407d8497d206`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:27.530671 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-5f826967-f608-40c0-b6a5-c1464ba2aead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:27.604044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1000/1989] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:51:27.608755 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e50b6e-7e57-42d1-92e3-c95d89086458 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:27.650757 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f826967-f608-40c0-b6a5-c1464ba2aead None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:27.652720 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-5f826967-f608-40c0-b6a5-c1464ba2aead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:27.723970 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e50b6e-7e57-42d1-92e3-c95d89086458 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:27.731417 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987cda1-b2ef-4d4f-b6f0-ff0be2434e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:27.732305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987cda1-b2ef-4d4f-b6f0-ff0be2434e7a admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:27.732564 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987cda1-b2ef-4d4f-b6f0-ff0be2434e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:27.733183 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987cda1-b2ef-4d4f-b6f0-ff0be2434e7a admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:27.734203 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987cda1-b2ef-4d4f-b6f0-ff0be2434e7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:27.736373 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987cda1-b2ef-4d4f-b6f0-ff0be2434e7a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:27.747095 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f826967-f608-40c0-b6a5-c1464ba2aead None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:27.751890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba18e9-e199-4569-a5c9-7702048d22a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:27.752860 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba18e9-e199-4569-a5c9-7702048d22a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:27.753075 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba18e9-e199-4569-a5c9-7702048d22a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:27.753430 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba18e9-e199-4569-a5c9-7702048d22a1 admin admin] PATH_INFO: `/v3/users/f52d0221315b4dc0a293ac651dad05df` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:27.754662 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba18e9-e199-4569-a5c9-7702048d22a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f52d0221315b4dc0a293ac651dad05df)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:27.756659 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba18e9-e199-4569-a5c9-7702048d22a1 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:27.759171 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:27.802481 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 990/1990] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:51:27 2022] POST /identity/v3/projects => generated 399 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:27.806512 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987cda1-b2ef-4d4f-b6f0-ff0be2434e7a admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:27.825739 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:27.899319 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987cda1-b2ef-4d4f-b6f0-ff0be2434e7a admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:27.905126 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20f439-f34f-4b2a-a15b-be4f60745696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:27.906341 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20f439-f34f-4b2a-a15b-be4f60745696 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:27.906665 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20f439-f34f-4b2a-a15b-be4f60745696 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:27.907186 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20f439-f34f-4b2a-a15b-be4f60745696 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:27.907941 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20f439-f34f-4b2a-a15b-be4f60745696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:27.920358 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20f439-f34f-4b2a-a15b-be4f60745696 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:27.967378 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-61ba18e9-e199-4569-a5c9-7702048d22a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f52d0221315b4dc0a293ac651dad05df'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:27.968089 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-61ba18e9-e199-4569-a5c9-7702048d22a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f52d0221315b4dc0a293ac651dad05df'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:27.977961 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-61ba18e9-e199-4569-a5c9-7702048d22a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f52d0221315b4dc0a293ac651dad05df'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:27.977961 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-61ba18e9-e199-4569-a5c9-7702048d22a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f52d0221315b4dc0a293ac651dad05df'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:28.029302 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 991/1991] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:51:27 2022] POST /identity/v3/users => generated 306 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:28.034199 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20f439-f34f-4b2a-a15b-be4f60745696 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:28.036114 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-7a20f439-f34f-4b2a-a15b-be4f60745696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:28.052607 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20f439-f34f-4b2a-a15b-be4f60745696 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:28.057006 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-61ba18e9-e199-4569-a5c9-7702048d22a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f52d0221315b4dc0a293ac651dad05df'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:28.061908 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307e4f8-e547-43ea-8b17-578797f3646f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:28.061908 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307e4f8-e547-43ea-8b17-578797f3646f admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:28.061908 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307e4f8-e547-43ea-8b17-578797f3646f admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:28.062492 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307e4f8-e547-43ea-8b17-578797f3646f admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:28.063106 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8307e4f8-e547-43ea-8b17-578797f3646f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:28.065774 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8307e4f8-e547-43ea-8b17-578797f3646f admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:28.095140 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1001/1992] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:51:27 2022] DELETE /identity/v3/users/f52d0221315b4dc0a293ac651dad05df => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:51:28.095805 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 992/1993] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:51:28.098672 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307e4f8-e547-43ea-8b17-578797f3646f admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:28.099254 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da7350-7d93-4e63-9898-7076f4ca8f41 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:28.099641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da7350-7d93-4e63-9898-7076f4ca8f41 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:28.099921 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da7350-7d93-4e63-9898-7076f4ca8f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:28.124215 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307e4f8-e547-43ea-8b17-578797f3646f admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:28.146473 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-b0da7350-7d93-4e63-9898-7076f4ca8f41 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:28.148133 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-b0da7350-7d93-4e63-9898-7076f4ca8f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:28.234291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1002/1994] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:28.245081 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128d6fd-f4fe-47a3-bbe6-2db072949a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:28.245688 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da7350-7d93-4e63-9898-7076f4ca8f41 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:28.246068 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128d6fd-f4fe-47a3-bbe6-2db072949a0f admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:28.246476 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128d6fd-f4fe-47a3-bbe6-2db072949a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:28.246852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128d6fd-f4fe-47a3-bbe6-2db072949a0f admin admin] PATH_INFO: `/v3/projects/142b01e2f121418da780500aba30d642/users/3401e5ec480742f28648e26f61cd54c1/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:28.247423 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-b0da7350-7d93-4e63-9898-7076f4ca8f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:28.276846 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128d6fd-f4fe-47a3-bbe6-2db072949a0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=142b01e2f121418da780500aba30d642, user_id=3401e5ec480742f28648e26f61cd54c1, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:28.281110 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128d6fd-f4fe-47a3-bbe6-2db072949a0f admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:28.315093 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da7350-7d93-4e63-9898-7076f4ca8f41 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:28.319448 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3571af-cd37-4bad-b035-bffd4b854e1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:28.320216 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3571af-cd37-4bad-b035-bffd4b854e1f service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:28.320597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3571af-cd37-4bad-b035-bffd4b854e1f service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:28.320940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3571af-cd37-4bad-b035-bffd4b854e1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:28.332265 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3571af-cd37-4bad-b035-bffd4b854e1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:28.333915 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3571af-cd37-4bad-b035-bffd4b854e1f service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:28.351824 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1003/1995] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:51:28.367640 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 993/1996] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:51:28 2022] PUT /identity/v3/projects/142b01e2f121418da780500aba30d642/users/3401e5ec480742f28648e26f61cd54c1/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:28.372189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3571af-cd37-4bad-b035-bffd4b854e1f service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:28.389107 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3571af-cd37-4bad-b035-bffd4b854e1f service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:28.463656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:28.512098 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa2b23-dc39-4e48-a7e5-bcd2cb051bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:28.512900 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa2b23-dc39-4e48-a7e5-bcd2cb051bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:28.513284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa2b23-dc39-4e48-a7e5-bcd2cb051bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:28.513660 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa2b23-dc39-4e48-a7e5-bcd2cb051bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:28.514532 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa2b23-dc39-4e48-a7e5-bcd2cb051bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:28.516312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa2b23-dc39-4e48-a7e5-bcd2cb051bc8 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:28.533520 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1004/1997] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:51:28.538476 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128d6fd-f4fe-47a3-bbe6-2db072949a0f admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:28.554533 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128d6fd-f4fe-47a3-bbe6-2db072949a0f admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:28.560471 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2ce6f-97a2-4a16-8d35-be932f5849f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:28.561431 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2ce6f-97a2-4a16-8d35-be932f5849f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:28.564392 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2ce6f-97a2-4a16-8d35-be932f5849f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:28.564392 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2ce6f-97a2-4a16-8d35-be932f5849f7 admin admin] PATH_INFO: `/v3/projects/142b01e2f121418da780500aba30d642/users/3401e5ec480742f28648e26f61cd54c1/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:28.571054 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2ce6f-97a2-4a16-8d35-be932f5849f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=142b01e2f121418da780500aba30d642, user_id=3401e5ec480742f28648e26f61cd54c1, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:28.571054 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2ce6f-97a2-4a16-8d35-be932f5849f7 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:28.591482 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 994/1998] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:51:28 2022] PUT /identity/v3/projects/142b01e2f121418da780500aba30d642/users/3401e5ec480742f28648e26f61cd54c1/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:28.602057 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d09600-f0f4-44fa-9d63-48246b10ae73 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:28.602337 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d09600-f0f4-44fa-9d63-48246b10ae73 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:28.602612 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d09600-f0f4-44fa-9d63-48246b10ae73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:28.666178 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-95d09600-f0f4-44fa-9d63-48246b10ae73 None None] MFA Rules not processed for user `3401e5ec480742f28648e26f61cd54c1`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:28.685072 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-95d09600-f0f4-44fa-9d63-48246b10ae73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:28.810412 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1005/1999] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:28 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:28.821747 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2ce6f-97a2-4a16-8d35-be932f5849f7 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:28.823571 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-75e2ce6f-97a2-4a16-8d35-be932f5849f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:28.876514 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d09600-f0f4-44fa-9d63-48246b10ae73 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:28.878999 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-95d09600-f0f4-44fa-9d63-48246b10ae73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:28.917820 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2ce6f-97a2-4a16-8d35-be932f5849f7 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:28.921850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d089b-9cd1-4872-b610-7d885a169914 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:28.922529 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d089b-9cd1-4872-b610-7d885a169914 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:28.922807 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d089b-9cd1-4872-b610-7d885a169914 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:28.923091 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d089b-9cd1-4872-b610-7d885a169914 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:28.934728 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d089b-9cd1-4872-b610-7d885a169914 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:28.936350 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d089b-9cd1-4872-b610-7d885a169914 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:28.953011 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 995/2000] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:28 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:51:29.022920 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d09600-f0f4-44fa-9d63-48246b10ae73 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:29.028171 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ccb7e-d3c0-427e-bcff-aa2e30082a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:29.030622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ccb7e-d3c0-427e-bcff-aa2e30082a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:29.030622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ccb7e-d3c0-427e-bcff-aa2e30082a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:29.030622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ccb7e-d3c0-427e-bcff-aa2e30082a40 admin admin] PATH_INFO: `/v3/projects/f14646fd5bab4cd5af1d9af5e17ab8b8` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:29.031167 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ccb7e-d3c0-427e-bcff-aa2e30082a40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f14646fd5bab4cd5af1d9af5e17ab8b8)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:29.033555 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ccb7e-d3c0-427e-bcff-aa2e30082a40 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:29.162994 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:29.167166 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-066ccb7e-d3c0-427e-bcff-aa2e30082a40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f14646fd5bab4cd5af1d9af5e17ab8b8', 'request_id': 'req-066ccb7e-d3c0-427e-bcff-aa2e30082a40'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:29.182156 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-066ccb7e-d3c0-427e-bcff-aa2e30082a40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f14646fd5bab4cd5af1d9af5e17ab8b8', 'request_id': 'req-066ccb7e-d3c0-427e-bcff-aa2e30082a40'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:29.189290 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-066ccb7e-d3c0-427e-bcff-aa2e30082a40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f14646fd5bab4cd5af1d9af5e17ab8b8', 'request_id': 'req-066ccb7e-d3c0-427e-bcff-aa2e30082a40'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:29.196844 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d089b-9cd1-4872-b610-7d885a169914 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:29.202888 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:29.207592 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d089b-9cd1-4872-b610-7d885a169914 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:29.263780 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd9a08-71ae-4794-b458-8fd4fe31ae74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:29.264473 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd9a08-71ae-4794-b458-8fd4fe31ae74 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:29.264760 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd9a08-71ae-4794-b458-8fd4fe31ae74 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:29.265060 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd9a08-71ae-4794-b458-8fd4fe31ae74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:29.266888 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-38bd9a08-71ae-4794-b458-8fd4fe31ae74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:29.289236 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-066ccb7e-d3c0-427e-bcff-aa2e30082a40 admin admin] The token cache is being invalidate because project f14646fd5bab4cd5af1d9af5e17ab8b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:51:29.289648 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-066ccb7e-d3c0-427e-bcff-aa2e30082a40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:29.290214 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-066ccb7e-d3c0-427e-bcff-aa2e30082a40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:29.292256 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1006/2001] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:51:28 2022] DELETE /identity/v3/projects/f14646fd5bab4cd5af1d9af5e17ab8b8 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:29.296507 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ccb7e-d3c0-427e-bcff-aa2e30082a40 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:29.297937 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-066ccb7e-d3c0-427e-bcff-aa2e30082a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:29.368486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd9a08-71ae-4794-b458-8fd4fe31ae74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:29.371560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd9a08-71ae-4794-b458-8fd4fe31ae74 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:29.380151 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ccb7e-d3c0-427e-bcff-aa2e30082a40 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:29.386624 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beccf22d-9eb0-4353-8a0a-51c853b44038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:29.387729 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccf22d-9eb0-4353-8a0a-51c853b44038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:29.388869 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccf22d-9eb0-4353-8a0a-51c853b44038 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:29.389349 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccf22d-9eb0-4353-8a0a-51c853b44038 admin admin] PATH_INFO: `/v3/users/b951eb57766544d38847b08fb8bd4aed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:29.391880 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beccf22d-9eb0-4353-8a0a-51c853b44038 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b951eb57766544d38847b08fb8bd4aed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:29.392868 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 996/2002] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:29 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:51:29.393842 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beccf22d-9eb0-4353-8a0a-51c853b44038 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:29.786573 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-beccf22d-9eb0-4353-8a0a-51c853b44038 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b951eb57766544d38847b08fb8bd4aed'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:29.787269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-beccf22d-9eb0-4353-8a0a-51c853b44038 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b951eb57766544d38847b08fb8bd4aed'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:29.787894 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-beccf22d-9eb0-4353-8a0a-51c853b44038 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b951eb57766544d38847b08fb8bd4aed'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:29.795106 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-beccf22d-9eb0-4353-8a0a-51c853b44038 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b951eb57766544d38847b08fb8bd4aed'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:29.860101 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-beccf22d-9eb0-4353-8a0a-51c853b44038 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b951eb57766544d38847b08fb8bd4aed'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:29.883533 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1007/2003] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:51:29 2022] DELETE /identity/v3/users/b951eb57766544d38847b08fb8bd4aed => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:51:30.384753 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd9a08-71ae-4794-b458-8fd4fe31ae74 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:30.396490 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd9a08-71ae-4794-b458-8fd4fe31ae74 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:30.458180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b107f7f-a0b6-4c23-8bb6-20b3706e3d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:30.459049 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b107f7f-a0b6-4c23-8bb6-20b3706e3d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:30.459332 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b107f7f-a0b6-4c23-8bb6-20b3706e3d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:30.459632 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b107f7f-a0b6-4c23-8bb6-20b3706e3d03 admin admin] PATH_INFO: `/v3/projects/63c87e90cfab4f6f8805df6f39a59a2c` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:30.460831 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b107f7f-a0b6-4c23-8bb6-20b3706e3d03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63c87e90cfab4f6f8805df6f39a59a2c)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:30.462788 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b107f7f-a0b6-4c23-8bb6-20b3706e3d03 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:30.566908 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4b107f7f-a0b6-4c23-8bb6-20b3706e3d03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63c87e90cfab4f6f8805df6f39a59a2c', 'request_id': 'req-4b107f7f-a0b6-4c23-8bb6-20b3706e3d03'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:30.573203 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4b107f7f-a0b6-4c23-8bb6-20b3706e3d03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63c87e90cfab4f6f8805df6f39a59a2c', 'request_id': 'req-4b107f7f-a0b6-4c23-8bb6-20b3706e3d03'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:30.577957 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:30.579316 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4b107f7f-a0b6-4c23-8bb6-20b3706e3d03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63c87e90cfab4f6f8805df6f39a59a2c', 'request_id': 'req-4b107f7f-a0b6-4c23-8bb6-20b3706e3d03'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:30.652757 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4b107f7f-a0b6-4c23-8bb6-20b3706e3d03 admin admin] The token cache is being invalidate because project 63c87e90cfab4f6f8805df6f39a59a2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:51:30.653138 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4b107f7f-a0b6-4c23-8bb6-20b3706e3d03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:30.653880 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4b107f7f-a0b6-4c23-8bb6-20b3706e3d03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:30.658671 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 997/2004] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:51:30 2022] DELETE /identity/v3/projects/63c87e90cfab4f6f8805df6f39a59a2c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:30.666142 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1c617-10f7-4729-8720-043c2bdd7772 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:30.666433 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1c617-10f7-4729-8720-043c2bdd7772 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:30.667632 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1c617-10f7-4729-8720-043c2bdd7772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:30.696286 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-b9e1c617-10f7-4729-8720-043c2bdd7772 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:30.697698 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-b9e1c617-10f7-4729-8720-043c2bdd7772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:30.784954 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:30.808232 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1008/2005] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:30.810992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bafc60-4a6a-48da-b80a-e1cd9bbfe6e3 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:30.810992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bafc60-4a6a-48da-b80a-e1cd9bbfe6e3 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:30.814271 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bafc60-4a6a-48da-b80a-e1cd9bbfe6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:30.846414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-52bafc60-4a6a-48da-b80a-e1cd9bbfe6e3 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:30.849299 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-52bafc60-4a6a-48da-b80a-e1cd9bbfe6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:30.862285 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 998/2006] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:30.870645 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1c617-10f7-4729-8720-043c2bdd7772 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:30.881183 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1c617-10f7-4729-8720-043c2bdd7772 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:30.886701 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12348d5b-9ce3-4584-9c42-56f8c5036f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:30.887387 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12348d5b-9ce3-4584-9c42-56f8c5036f06 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:30.887841 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12348d5b-9ce3-4584-9c42-56f8c5036f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:30.888120 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12348d5b-9ce3-4584-9c42-56f8c5036f06 admin admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:30.888867 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12348d5b-9ce3-4584-9c42-56f8c5036f06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:51:30.889181 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12348d5b-9ce3-4584-9c42-56f8c5036f06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:30.891798 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12348d5b-9ce3-4584-9c42-56f8c5036f06 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:30.913126 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bafc60-4a6a-48da-b80a-e1cd9bbfe6e3 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:30.920779 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1009/2007] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:51:30.932767 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bafc60-4a6a-48da-b80a-e1cd9bbfe6e3 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:30.932999 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b1962-bbb5-4585-911f-cfb55d8f8c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:30.933822 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b1962-bbb5-4585-911f-cfb55d8f8c05 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:30.934120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b1962-bbb5-4585-911f-cfb55d8f8c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:30.934398 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b1962-bbb5-4585-911f-cfb55d8f8c05 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:30.935106 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b1962-bbb5-4585-911f-cfb55d8f8c05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:30.937056 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b1962-bbb5-4585-911f-cfb55d8f8c05 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:31.010756 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 999/2008] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:51:30 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:31.012082 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12348d5b-9ce3-4584-9c42-56f8c5036f06 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:31.022903 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12348d5b-9ce3-4584-9c42-56f8c5036f06 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:31.119329 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ed48f-f33c-46f4-a1b9-6ba6a23497fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:31.120229 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ed48f-f33c-46f4-a1b9-6ba6a23497fd admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:31.120610 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ed48f-f33c-46f4-a1b9-6ba6a23497fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:31.121077 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ed48f-f33c-46f4-a1b9-6ba6a23497fd admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:31.121959 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ed48f-f33c-46f4-a1b9-6ba6a23497fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:31.124656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ed48f-f33c-46f4-a1b9-6ba6a23497fd admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:31.214744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1010/2009] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:51:31 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:31.218970 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b1962-bbb5-4585-911f-cfb55d8f8c05 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:31.233263 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b1962-bbb5-4585-911f-cfb55d8f8c05 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:31.237233 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba9dd7-fe4f-44c2-9b3f-75cccdff2008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:31.238764 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba9dd7-fe4f-44c2-9b3f-75cccdff2008 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:31.239169 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba9dd7-fe4f-44c2-9b3f-75cccdff2008 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:31.239527 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba9dd7-fe4f-44c2-9b3f-75cccdff2008 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:31.240311 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba9dd7-fe4f-44c2-9b3f-75cccdff2008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:31.242025 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba9dd7-fe4f-44c2-9b3f-75cccdff2008 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:31.260319 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1000/2010] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:51:31.261819 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ed48f-f33c-46f4-a1b9-6ba6a23497fd admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:31.274163 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ed48f-f33c-46f4-a1b9-6ba6a23497fd admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:31.280419 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484235a7-3ac5-4ea4-938c-54f1992f59d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:31.282386 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484235a7-3ac5-4ea4-938c-54f1992f59d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:31.282386 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484235a7-3ac5-4ea4-938c-54f1992f59d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:31.282386 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484235a7-3ac5-4ea4-938c-54f1992f59d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:31.282933 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484235a7-3ac5-4ea4-938c-54f1992f59d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:31.284292 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484235a7-3ac5-4ea4-938c-54f1992f59d6 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:31.296989 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1011/2011] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:51:31.303143 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba9dd7-fe4f-44c2-9b3f-75cccdff2008 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:31.314527 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba9dd7-fe4f-44c2-9b3f-75cccdff2008 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:31.319337 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fcdb8-c96d-4637-b422-e9b22292cd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:31.322782 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fcdb8-c96d-4637-b422-e9b22292cd60 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:31.323081 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fcdb8-c96d-4637-b422-e9b22292cd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:31.323367 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fcdb8-c96d-4637-b422-e9b22292cd60 admin admin] PATH_INFO: `/v3/projects/67883426f2bd4e4386ff067fb809f76d/users/6f1335db2a374b31b377cd6933627618/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:31.342542 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5fcdb8-c96d-4637-b422-e9b22292cd60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67883426f2bd4e4386ff067fb809f76d, user_id=6f1335db2a374b31b377cd6933627618, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:31.348726 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5fcdb8-c96d-4637-b422-e9b22292cd60 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:31.422779 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1001/2012] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:51:31 2022] PUT /identity/v3/projects/67883426f2bd4e4386ff067fb809f76d/users/6f1335db2a374b31b377cd6933627618/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:51:31.434087 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95db5e4-47fe-40a7-9772-5e852c39c98e None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:31.434444 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95db5e4-47fe-40a7-9772-5e852c39c98e None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:31.434827 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95db5e4-47fe-40a7-9772-5e852c39c98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:31.474003 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-c95db5e4-47fe-40a7-9772-5e852c39c98e None None] MFA Rules not processed for user `6f1335db2a374b31b377cd6933627618`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:31.475240 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-c95db5e4-47fe-40a7-9772-5e852c39c98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:31.546245 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1012/2013] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:31.551514 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fcdb8-c96d-4637-b422-e9b22292cd60 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:31.636424 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fcdb8-c96d-4637-b422-e9b22292cd60 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:31.641505 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f7987-28de-4f50-ab40-29ae1b491538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:31.642258 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f7987-28de-4f50-ab40-29ae1b491538 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:31.642547 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f7987-28de-4f50-ab40-29ae1b491538 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:31.642829 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f7987-28de-4f50-ab40-29ae1b491538 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:31.643644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f7987-28de-4f50-ab40-29ae1b491538 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:31.645887 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f7987-28de-4f50-ab40-29ae1b491538 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:31.818148 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1002/2014] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:51:31 2022] POST /identity/v3/projects => generated 377 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:31.818365 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95db5e4-47fe-40a7-9772-5e852c39c98e None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:31.849854 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95db5e4-47fe-40a7-9772-5e852c39c98e None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:31.935742 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:31.959322 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ec605-8bc6-44af-a25a-f44de814523a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:31.959322 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ec605-8bc6-44af-a25a-f44de814523a admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:31.959322 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ec605-8bc6-44af-a25a-f44de814523a admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:31.959322 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ec605-8bc6-44af-a25a-f44de814523a admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:31.959692 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ec605-8bc6-44af-a25a-f44de814523a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:31.962920 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ec605-8bc6-44af-a25a-f44de814523a admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:32.098964 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1013/2015] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:51:31 2022] POST /identity/v3/users => generated 295 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:32.103296 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f7987-28de-4f50-ab40-29ae1b491538 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:32.117656 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f7987-28de-4f50-ab40-29ae1b491538 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:32.123735 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2da6e-801b-43e8-a009-76285d3e882e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:32.130136 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2da6e-801b-43e8-a009-76285d3e882e admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:32.130136 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2da6e-801b-43e8-a009-76285d3e882e admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:32.130136 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2da6e-801b-43e8-a009-76285d3e882e admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:32.130136 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2da6e-801b-43e8-a009-76285d3e882e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:32.130136 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2da6e-801b-43e8-a009-76285d3e882e admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:32.157271 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1003/2016] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:51:32.162777 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ec605-8bc6-44af-a25a-f44de814523a admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:32.180733 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ec605-8bc6-44af-a25a-f44de814523a admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:32.193125 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e35da-b84a-41fc-9479-2c7dea23be07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:32.207223 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e35da-b84a-41fc-9479-2c7dea23be07 admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:32.207223 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e35da-b84a-41fc-9479-2c7dea23be07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:32.207223 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e35da-b84a-41fc-9479-2c7dea23be07 admin admin] PATH_INFO: `/v3/projects/d614e7cc5c584d60bc07bda236a92844/users/b37a1135512f42ab8d55a1f276eccc5d/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:32.215241 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e35da-b84a-41fc-9479-2c7dea23be07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d614e7cc5c584d60bc07bda236a92844, user_id=b37a1135512f42ab8d55a1f276eccc5d, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:32.218199 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e35da-b84a-41fc-9479-2c7dea23be07 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:32.318472 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1014/2017] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:51:32 2022] PUT /identity/v3/projects/d614e7cc5c584d60bc07bda236a92844/users/b37a1135512f42ab8d55a1f276eccc5d/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:51:32.322525 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2da6e-801b-43e8-a009-76285d3e882e admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:32.347931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2da6e-801b-43e8-a009-76285d3e882e admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:32.443275 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cdab9d-f5c9-44c2-97ac-d9fcbd6d2879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:32.444258 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdab9d-f5c9-44c2-97ac-d9fcbd6d2879 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:32.444469 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdab9d-f5c9-44c2-97ac-d9fcbd6d2879 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:32.451545 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdab9d-f5c9-44c2-97ac-d9fcbd6d2879 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:32.451545 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cdab9d-f5c9-44c2-97ac-d9fcbd6d2879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:32.451545 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cdab9d-f5c9-44c2-97ac-d9fcbd6d2879 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:32.451545 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:32.462972 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1004/2018] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:51:32.467649 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e35da-b84a-41fc-9479-2c7dea23be07 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:32.483916 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e35da-b84a-41fc-9479-2c7dea23be07 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:32.491111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71191100-47a4-458b-b81a-e5abfeec6ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:32.493324 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71191100-47a4-458b-b81a-e5abfeec6ce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:32.493651 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71191100-47a4-458b-b81a-e5abfeec6ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:32.494052 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71191100-47a4-458b-b81a-e5abfeec6ce6 admin admin] PATH_INFO: `/v3/projects/d614e7cc5c584d60bc07bda236a92844/users/b37a1135512f42ab8d55a1f276eccc5d/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:32.497205 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71191100-47a4-458b-b81a-e5abfeec6ce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d614e7cc5c584d60bc07bda236a92844, user_id=b37a1135512f42ab8d55a1f276eccc5d, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:32.500075 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71191100-47a4-458b-b81a-e5abfeec6ce6 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:32.514077 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1015/2019] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:51:32 2022] PUT /identity/v3/projects/d614e7cc5c584d60bc07bda236a92844/users/b37a1135512f42ab8d55a1f276eccc5d/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:51:32.525593 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd778e36-6a84-465f-83be-5ff616c7b772 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:32.526150 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd778e36-6a84-465f-83be-5ff616c7b772 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:32.526507 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd778e36-6a84-465f-83be-5ff616c7b772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:32.560643 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-cd778e36-6a84-465f-83be-5ff616c7b772 None None] MFA Rules not processed for user `b37a1135512f42ab8d55a1f276eccc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:32.562236 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-cd778e36-6a84-465f-83be-5ff616c7b772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:32.657006 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1005/2020] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:32.869197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71191100-47a4-458b-b81a-e5abfeec6ce6 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:32.871103 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-71191100-47a4-458b-b81a-e5abfeec6ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:32.954223 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71191100-47a4-458b-b81a-e5abfeec6ce6 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:32.961686 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ddaf4-8781-43b8-a4a8-5596579f43ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:32.963026 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ddaf4-8781-43b8-a4a8-5596579f43ce service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:32.963481 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ddaf4-8781-43b8-a4a8-5596579f43ce service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:32.963831 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ddaf4-8781-43b8-a4a8-5596579f43ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:33.060055 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ddaf4-8781-43b8-a4a8-5596579f43ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:33.060055 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ddaf4-8781-43b8-a4a8-5596579f43ce service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:33.074130 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1016/2021] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:51:36.918030 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd778e36-6a84-465f-83be-5ff616c7b772 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:36.921868 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-cd778e36-6a84-465f-83be-5ff616c7b772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:36.994972 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd778e36-6a84-465f-83be-5ff616c7b772 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:36.999498 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77701cf6-5674-465c-a3ca-c207a02becc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:37.000416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77701cf6-5674-465c-a3ca-c207a02becc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:37.000707 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77701cf6-5674-465c-a3ca-c207a02becc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:37.000986 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77701cf6-5674-465c-a3ca-c207a02becc7 admin admin] PATH_INFO: `/v3/users/81bcb959154e4a46b6cd407d8497d206` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:37.002192 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77701cf6-5674-465c-a3ca-c207a02becc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81bcb959154e4a46b6cd407d8497d206)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:37.005037 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77701cf6-5674-465c-a3ca-c207a02becc7 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:37.202085 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-77701cf6-5674-465c-a3ca-c207a02becc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81bcb959154e4a46b6cd407d8497d206'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:37.202684 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-77701cf6-5674-465c-a3ca-c207a02becc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81bcb959154e4a46b6cd407d8497d206'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:37.209719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-77701cf6-5674-465c-a3ca-c207a02becc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81bcb959154e4a46b6cd407d8497d206'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:37.210381 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-77701cf6-5674-465c-a3ca-c207a02becc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81bcb959154e4a46b6cd407d8497d206'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:37.279586 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-77701cf6-5674-465c-a3ca-c207a02becc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81bcb959154e4a46b6cd407d8497d206'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:37.295519 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:37.300102 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1006/2022] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:51:36 2022] DELETE /identity/v3/users/81bcb959154e4a46b6cd407d8497d206 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:37.305399 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046195e0-450a-4c40-89e7-6119ffddd34f None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:37.305895 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046195e0-450a-4c40-89e7-6119ffddd34f None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:37.306211 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046195e0-450a-4c40-89e7-6119ffddd34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:37.326108 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-046195e0-450a-4c40-89e7-6119ffddd34f None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:37.327447 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-046195e0-450a-4c40-89e7-6119ffddd34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:37.382094 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:37.396213 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1017/2023] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:37.407250 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77701cf6-5674-465c-a3ca-c207a02becc7 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:37.409333 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-77701cf6-5674-465c-a3ca-c207a02becc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:37.468722 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77701cf6-5674-465c-a3ca-c207a02becc7 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:37.473069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7a56c-a181-4787-890a-1bec04b2a65d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:37.473720 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7a56c-a181-4787-890a-1bec04b2a65d service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:37.474004 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7a56c-a181-4787-890a-1bec04b2a65d service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:37.474281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7a56c-a181-4787-890a-1bec04b2a65d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:37.484887 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7a56c-a181-4787-890a-1bec04b2a65d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:37.486002 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7a56c-a181-4787-890a-1bec04b2a65d service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:37.497344 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1007/2024] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:51:37.744188 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046195e0-450a-4c40-89e7-6119ffddd34f None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:37.748229 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-046195e0-450a-4c40-89e7-6119ffddd34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:37.759501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046195e0-450a-4c40-89e7-6119ffddd34f None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:37.764705 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64eaa22-5e25-474d-8729-b541f4a7f47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:37.765729 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eaa22-5e25-474d-8729-b541f4a7f47d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:37.766020 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eaa22-5e25-474d-8729-b541f4a7f47d admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:37.766298 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eaa22-5e25-474d-8729-b541f4a7f47d admin admin] PATH_INFO: `/v3/users/ea9bcfce0a964cdb82ea12247c3aee1f` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:37.767508 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64eaa22-5e25-474d-8729-b541f4a7f47d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea9bcfce0a964cdb82ea12247c3aee1f)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:37.769866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64eaa22-5e25-474d-8729-b541f4a7f47d admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:37.974604 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-d64eaa22-5e25-474d-8729-b541f4a7f47d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea9bcfce0a964cdb82ea12247c3aee1f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:37.975183 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-d64eaa22-5e25-474d-8729-b541f4a7f47d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea9bcfce0a964cdb82ea12247c3aee1f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:37.975891 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-d64eaa22-5e25-474d-8729-b541f4a7f47d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea9bcfce0a964cdb82ea12247c3aee1f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:37.991569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-d64eaa22-5e25-474d-8729-b541f4a7f47d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea9bcfce0a964cdb82ea12247c3aee1f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:37.992067 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7a56c-a181-4787-890a-1bec04b2a65d service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:37.993488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-1cd7a56c-a181-4787-890a-1bec04b2a65d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:38.008985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7a56c-a181-4787-890a-1bec04b2a65d service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:38.013408 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd3b9d-165d-451e-8f65-a528ca93b2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:38.014351 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd3b9d-165d-451e-8f65-a528ca93b2dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:38.014737 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd3b9d-165d-451e-8f65-a528ca93b2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:38.015048 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd3b9d-165d-451e-8f65-a528ca93b2dc admin admin] PATH_INFO: `/v3/projects/49127f0d5bfe4ef1bf5600f6bf68d79a` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:38.016373 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd3b9d-165d-451e-8f65-a528ca93b2dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=49127f0d5bfe4ef1bf5600f6bf68d79a)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:38.018371 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd3b9d-165d-451e-8f65-a528ca93b2dc admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:38.079111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-d64eaa22-5e25-474d-8729-b541f4a7f47d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea9bcfce0a964cdb82ea12247c3aee1f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:38.098280 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1018/2025] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:51:37 2022] DELETE /identity/v3/users/ea9bcfce0a964cdb82ea12247c3aee1f => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:38.102691 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1e669-3ebb-413d-9d37-d2863445bcb3 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:38.106192 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1e669-3ebb-413d-9d37-d2863445bcb3 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:38.106192 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1e669-3ebb-413d-9d37-d2863445bcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:38.123248 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-0bf1e669-3ebb-413d-9d37-d2863445bcb3 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:38.124489 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-0bf1e669-3ebb-413d-9d37-d2863445bcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:38.181315 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-bfbd3b9d-165d-451e-8f65-a528ca93b2dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49127f0d5bfe4ef1bf5600f6bf68d79a', 'request_id': 'req-bfbd3b9d-165d-451e-8f65-a528ca93b2dc'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:38.190375 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1019/2026] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:51:38.190629 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-bfbd3b9d-165d-451e-8f65-a528ca93b2dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49127f0d5bfe4ef1bf5600f6bf68d79a', 'request_id': 'req-bfbd3b9d-165d-451e-8f65-a528ca93b2dc'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:38.194966 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-bfbd3b9d-165d-451e-8f65-a528ca93b2dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49127f0d5bfe4ef1bf5600f6bf68d79a', 'request_id': 'req-bfbd3b9d-165d-451e-8f65-a528ca93b2dc'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:38.197429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1e669-3ebb-413d-9d37-d2863445bcb3 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:38.199340 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-0bf1e669-3ebb-413d-9d37-d2863445bcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:38.258071 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1e669-3ebb-413d-9d37-d2863445bcb3 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:38.280301 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-bfbd3b9d-165d-451e-8f65-a528ca93b2dc admin admin] The token cache is being invalidate because project 49127f0d5bfe4ef1bf5600f6bf68d79a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:51:38.280596 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-bfbd3b9d-165d-451e-8f65-a528ca93b2dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:38.281494 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-bfbd3b9d-165d-451e-8f65-a528ca93b2dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:38.282759 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:38.283062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1008/2027] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:51:37 2022] DELETE /identity/v3/projects/49127f0d5bfe4ef1bf5600f6bf68d79a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:51:38.287919 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd3b9d-165d-451e-8f65-a528ca93b2dc admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:38.289459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-bfbd3b9d-165d-451e-8f65-a528ca93b2dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:38.310107 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ac816-0a91-437c-b55e-0c44b806a849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:38.310757 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ac816-0a91-437c-b55e-0c44b806a849 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:38.311068 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ac816-0a91-437c-b55e-0c44b806a849 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:38.311343 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ac816-0a91-437c-b55e-0c44b806a849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:38.313258 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-c11ac816-0a91-437c-b55e-0c44b806a849 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:38.363652 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd3b9d-165d-451e-8f65-a528ca93b2dc admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:38.368616 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca38f70-11ab-44d4-9e43-8d28b166f1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:38.369502 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca38f70-11ab-44d4-9e43-8d28b166f1d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:38.369782 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca38f70-11ab-44d4-9e43-8d28b166f1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:38.370056 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca38f70-11ab-44d4-9e43-8d28b166f1d1 admin admin] PATH_INFO: `/v3/users/3401e5ec480742f28648e26f61cd54c1` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:38.371250 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca38f70-11ab-44d4-9e43-8d28b166f1d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3401e5ec480742f28648e26f61cd54c1)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:38.373209 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca38f70-11ab-44d4-9e43-8d28b166f1d1 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:38.380665 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ac816-0a91-437c-b55e-0c44b806a849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:38.382119 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ac816-0a91-437c-b55e-0c44b806a849 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:38.392291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1020/2028] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:51:38.453223 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:38.539975 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-eca38f70-11ab-44d4-9e43-8d28b166f1d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3401e5ec480742f28648e26f61cd54c1'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:38.540670 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-eca38f70-11ab-44d4-9e43-8d28b166f1d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3401e5ec480742f28648e26f61cd54c1'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:38.547789 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-eca38f70-11ab-44d4-9e43-8d28b166f1d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3401e5ec480742f28648e26f61cd54c1'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:38.548446 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-eca38f70-11ab-44d4-9e43-8d28b166f1d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3401e5ec480742f28648e26f61cd54c1'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:38.628044 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-eca38f70-11ab-44d4-9e43-8d28b166f1d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3401e5ec480742f28648e26f61cd54c1'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:38.658201 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1009/2029] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:51:38 2022] DELETE /identity/v3/users/3401e5ec480742f28648e26f61cd54c1 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:51:38.865941 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ac816-0a91-437c-b55e-0c44b806a849 service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:38.868181 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-c11ac816-0a91-437c-b55e-0c44b806a849 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:38.883082 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ac816-0a91-437c-b55e-0c44b806a849 service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:38.996993 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbeae80-1f97-436e-a029-34378d88c05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:39.001747 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbeae80-1f97-436e-a029-34378d88c05e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:39.001747 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbeae80-1f97-436e-a029-34378d88c05e admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:39.001747 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbeae80-1f97-436e-a029-34378d88c05e admin admin] PATH_INFO: `/v3/projects/b5e44de5314545e49497f8289df28243` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:39.001747 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbeae80-1f97-436e-a029-34378d88c05e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5e44de5314545e49497f8289df28243)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:39.002247 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbeae80-1f97-436e-a029-34378d88c05e admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:39.137953 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5cbeae80-1f97-436e-a029-34378d88c05e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5e44de5314545e49497f8289df28243', 'request_id': 'req-5cbeae80-1f97-436e-a029-34378d88c05e'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:39.144952 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5cbeae80-1f97-436e-a029-34378d88c05e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5e44de5314545e49497f8289df28243', 'request_id': 'req-5cbeae80-1f97-436e-a029-34378d88c05e'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:39.153510 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5cbeae80-1f97-436e-a029-34378d88c05e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5e44de5314545e49497f8289df28243', 'request_id': 'req-5cbeae80-1f97-436e-a029-34378d88c05e'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:39.251663 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5cbeae80-1f97-436e-a029-34378d88c05e admin admin] The token cache is being invalidate because project b5e44de5314545e49497f8289df28243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:51:39.252208 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5cbeae80-1f97-436e-a029-34378d88c05e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:39.255254 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5cbeae80-1f97-436e-a029-34378d88c05e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:39.256442 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca38f70-11ab-44d4-9e43-8d28b166f1d1 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:39.257249 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1021/2030] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:51:38 2022] DELETE /identity/v3/projects/b5e44de5314545e49497f8289df28243 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:39.258532 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-eca38f70-11ab-44d4-9e43-8d28b166f1d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:39.260723 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbeae80-1f97-436e-a029-34378d88c05e admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:39.262511 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-5cbeae80-1f97-436e-a029-34378d88c05e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:39.273360 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:39.286655 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca38f70-11ab-44d4-9e43-8d28b166f1d1 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:39.357709 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbeae80-1f97-436e-a029-34378d88c05e admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:39.363307 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff0f83-d9e1-4a97-947b-2989e93f1487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:39.364565 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff0f83-d9e1-4a97-947b-2989e93f1487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:39.364848 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff0f83-d9e1-4a97-947b-2989e93f1487 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:39.365127 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff0f83-d9e1-4a97-947b-2989e93f1487 admin admin] PATH_INFO: `/v3/users/89569720a2f7486ab48d6f5e357d0f21` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:39.367151 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff0f83-d9e1-4a97-947b-2989e93f1487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89569720a2f7486ab48d6f5e357d0f21)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:39.369799 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff0f83-d9e1-4a97-947b-2989e93f1487 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:39.375298 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20838dd9-5d08-421c-b88e-c2bb229ce219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:39.376210 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20838dd9-5d08-421c-b88e-c2bb229ce219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:39.376550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20838dd9-5d08-421c-b88e-c2bb229ce219 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:39.376833 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20838dd9-5d08-421c-b88e-c2bb229ce219 admin admin] PATH_INFO: `/v3/projects/142b01e2f121418da780500aba30d642` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:39.378080 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20838dd9-5d08-421c-b88e-c2bb229ce219 admin admin] RBAC: Authorizing `identity:delete_project(project_id=142b01e2f121418da780500aba30d642)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:39.380877 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20838dd9-5d08-421c-b88e-c2bb229ce219 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:39.582818 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-20838dd9-5d08-421c-b88e-c2bb229ce219 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '142b01e2f121418da780500aba30d642', 'request_id': 'req-20838dd9-5d08-421c-b88e-c2bb229ce219'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:39.585094 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-0dff0f83-d9e1-4a97-947b-2989e93f1487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89569720a2f7486ab48d6f5e357d0f21'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:39.585757 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-0dff0f83-d9e1-4a97-947b-2989e93f1487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89569720a2f7486ab48d6f5e357d0f21'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:39.586373 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-0dff0f83-d9e1-4a97-947b-2989e93f1487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89569720a2f7486ab48d6f5e357d0f21'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:39.589614 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-20838dd9-5d08-421c-b88e-c2bb229ce219 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '142b01e2f121418da780500aba30d642', 'request_id': 'req-20838dd9-5d08-421c-b88e-c2bb229ce219'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:39.594139 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-0dff0f83-d9e1-4a97-947b-2989e93f1487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89569720a2f7486ab48d6f5e357d0f21'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:39.595472 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-20838dd9-5d08-421c-b88e-c2bb229ce219 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '142b01e2f121418da780500aba30d642', 'request_id': 'req-20838dd9-5d08-421c-b88e-c2bb229ce219'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:39.696634 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-0dff0f83-d9e1-4a97-947b-2989e93f1487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89569720a2f7486ab48d6f5e357d0f21'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:39.717052 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1022/2031] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:51:39 2022] DELETE /identity/v3/users/89569720a2f7486ab48d6f5e357d0f21 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:51:39.805620 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-20838dd9-5d08-421c-b88e-c2bb229ce219 admin admin] The token cache is being invalidate because project 142b01e2f121418da780500aba30d642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:51:39.806243 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-20838dd9-5d08-421c-b88e-c2bb229ce219 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:39.807008 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-20838dd9-5d08-421c-b88e-c2bb229ce219 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:39.808861 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1010/2032] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:51:39 2022] DELETE /identity/v3/projects/142b01e2f121418da780500aba30d642 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:39.814030 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77879956-0c99-4ea1-8f5f-5ccaf8180fda None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:39.814415 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77879956-0c99-4ea1-8f5f-5ccaf8180fda None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:39.814770 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77879956-0c99-4ea1-8f5f-5ccaf8180fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:39.835887 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-77879956-0c99-4ea1-8f5f-5ccaf8180fda None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:39.837016 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-77879956-0c99-4ea1-8f5f-5ccaf8180fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:39.907869 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1023/2033] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:39.916736 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cae4b-fb51-44a5-a9aa-42d624597458 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:39.917317 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cae4b-fb51-44a5-a9aa-42d624597458 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:39.917682 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cae4b-fb51-44a5-a9aa-42d624597458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:39.942232 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-625cae4b-fb51-44a5-a9aa-42d624597458 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:39.945140 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-625cae4b-fb51-44a5-a9aa-42d624597458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:39.958585 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1011/2034] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:39.959942 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77879956-0c99-4ea1-8f5f-5ccaf8180fda None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:39.970354 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77879956-0c99-4ea1-8f5f-5ccaf8180fda None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:39.979531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c430fa8-c663-4593-ae77-edadd8b4a912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:39.985032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c430fa8-c663-4593-ae77-edadd8b4a912 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:39.985032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c430fa8-c663-4593-ae77-edadd8b4a912 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:39.985032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c430fa8-c663-4593-ae77-edadd8b4a912 admin admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:39.985032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c430fa8-c663-4593-ae77-edadd8b4a912 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:51:39.985032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c430fa8-c663-4593-ae77-edadd8b4a912 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:39.985032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c430fa8-c663-4593-ae77-edadd8b4a912 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:40.007437 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1024/2035] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:51:40.009005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cae4b-fb51-44a5-a9aa-42d624597458 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:40.020816 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cae4b-fb51-44a5-a9aa-42d624597458 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:40.025985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b895409-fc5b-4883-9fe3-5819084b4a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:40.026658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b895409-fc5b-4883-9fe3-5819084b4a87 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:40.026943 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b895409-fc5b-4883-9fe3-5819084b4a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:40.027217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b895409-fc5b-4883-9fe3-5819084b4a87 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:40.028084 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b895409-fc5b-4883-9fe3-5819084b4a87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:40.030134 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b895409-fc5b-4883-9fe3-5819084b4a87 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:40.122424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c430fa8-c663-4593-ae77-edadd8b4a912 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:40.132144 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1012/2036] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:51:40 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:40.136615 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c430fa8-c663-4593-ae77-edadd8b4a912 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:40.152096 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:40.218875 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d8291-7dd8-4134-b6a9-05f7e3b4ae4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:40.219557 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d8291-7dd8-4134-b6a9-05f7e3b4ae4e admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:40.219879 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d8291-7dd8-4134-b6a9-05f7e3b4ae4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:40.220155 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d8291-7dd8-4134-b6a9-05f7e3b4ae4e admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:40.220870 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d8291-7dd8-4134-b6a9-05f7e3b4ae4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:40.223941 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d8291-7dd8-4134-b6a9-05f7e3b4ae4e admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:40.265875 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b895409-fc5b-4883-9fe3-5819084b4a87 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:40.268842 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-1b895409-fc5b-4883-9fe3-5819084b4a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:40.294039 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b895409-fc5b-4883-9fe3-5819084b4a87 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:40.299573 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11286261-9dd9-481e-9b8b-b66bac8feda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:40.301857 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11286261-9dd9-481e-9b8b-b66bac8feda3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:40.301857 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11286261-9dd9-481e-9b8b-b66bac8feda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:40.302096 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11286261-9dd9-481e-9b8b-b66bac8feda3 admin admin] PATH_INFO: `/v3/projects/09fefaa2dfa44944928c0e4d6c5ceee3` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:40.303920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11286261-9dd9-481e-9b8b-b66bac8feda3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09fefaa2dfa44944928c0e4d6c5ceee3)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:40.306861 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11286261-9dd9-481e-9b8b-b66bac8feda3 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:40.308613 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:40.355097 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1025/2037] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:51:40 2022] POST /identity/v3/users => generated 286 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:40.358944 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d8291-7dd8-4134-b6a9-05f7e3b4ae4e admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:40.369885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d8291-7dd8-4134-b6a9-05f7e3b4ae4e admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:40.374669 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2eb85d-d3c7-4e46-b927-ddd218116aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:40.375355 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2eb85d-d3c7-4e46-b927-ddd218116aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:40.375648 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2eb85d-d3c7-4e46-b927-ddd218116aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:40.375927 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2eb85d-d3c7-4e46-b927-ddd218116aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:40.376664 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2eb85d-d3c7-4e46-b927-ddd218116aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:40.378333 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2eb85d-d3c7-4e46-b927-ddd218116aa2 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:40.390366 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1026/2038] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:51:40.396062 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2eb85d-d3c7-4e46-b927-ddd218116aa2 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:40.406678 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2eb85d-d3c7-4e46-b927-ddd218116aa2 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:40.412417 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23e117-29b5-43c1-a498-a38b85dc5358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:40.413228 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23e117-29b5-43c1-a498-a38b85dc5358 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:40.413521 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23e117-29b5-43c1-a498-a38b85dc5358 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:40.413802 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23e117-29b5-43c1-a498-a38b85dc5358 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:40.414546 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23e117-29b5-43c1-a498-a38b85dc5358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:40.416299 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23e117-29b5-43c1-a498-a38b85dc5358 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:40.427777 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1027/2039] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:51:40.432968 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23e117-29b5-43c1-a498-a38b85dc5358 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:40.436733 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-11286261-9dd9-481e-9b8b-b66bac8feda3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09fefaa2dfa44944928c0e4d6c5ceee3', 'request_id': 'req-11286261-9dd9-481e-9b8b-b66bac8feda3'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:40.444259 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-11286261-9dd9-481e-9b8b-b66bac8feda3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09fefaa2dfa44944928c0e4d6c5ceee3', 'request_id': 'req-11286261-9dd9-481e-9b8b-b66bac8feda3'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:40.445860 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23e117-29b5-43c1-a498-a38b85dc5358 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:40.452091 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-11286261-9dd9-481e-9b8b-b66bac8feda3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09fefaa2dfa44944928c0e4d6c5ceee3', 'request_id': 'req-11286261-9dd9-481e-9b8b-b66bac8feda3'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:40.514236 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e029932-1fd8-48a1-9d65-3d18b30c9f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:40.515147 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e029932-1fd8-48a1-9d65-3d18b30c9f9f admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:40.515432 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e029932-1fd8-48a1-9d65-3d18b30c9f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:40.515739 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e029932-1fd8-48a1-9d65-3d18b30c9f9f admin admin] PATH_INFO: `/v3/projects/78cc9a5023834c0893a1bdb2250cae8a/users/f077aa13553943a09bd1f95a678a11c8/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:40.525638 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-11286261-9dd9-481e-9b8b-b66bac8feda3 admin admin] The token cache is being invalidate because project 09fefaa2dfa44944928c0e4d6c5ceee3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:51:40.526631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-11286261-9dd9-481e-9b8b-b66bac8feda3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:40.526631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-11286261-9dd9-481e-9b8b-b66bac8feda3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:40.528312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1013/2040] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:51:40 2022] DELETE /identity/v3/projects/09fefaa2dfa44944928c0e4d6c5ceee3 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:51:40.533968 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd21fe-b002-49b9-b541-fd74723757af None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:40.534270 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd21fe-b002-49b9-b541-fd74723757af None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:40.535175 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd21fe-b002-49b9-b541-fd74723757af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:40.537836 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e029932-1fd8-48a1-9d65-3d18b30c9f9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=78cc9a5023834c0893a1bdb2250cae8a, user_id=f077aa13553943a09bd1f95a678a11c8, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:40.540690 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e029932-1fd8-48a1-9d65-3d18b30c9f9f admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:40.558118 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-f2cd21fe-b002-49b9-b541-fd74723757af None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:40.559331 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f2cd21fe-b002-49b9-b541-fd74723757af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:40.572439 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1014/2041] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:51:40.577527 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885d4f2-f65a-4e8d-bb6c-fe04d8f3a5ec None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:40.577826 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885d4f2-f65a-4e8d-bb6c-fe04d8f3a5ec None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:40.578117 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885d4f2-f65a-4e8d-bb6c-fe04d8f3a5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:40.599094 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-e885d4f2-f65a-4e8d-bb6c-fe04d8f3a5ec None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:40.602059 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-e885d4f2-f65a-4e8d-bb6c-fe04d8f3a5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:40.610541 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1015/2042] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:40.616019 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885d4f2-f65a-4e8d-bb6c-fe04d8f3a5ec None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:40.625524 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885d4f2-f65a-4e8d-bb6c-fe04d8f3a5ec None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:40.631238 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de038d-58a6-48fa-9d66-8d97655fc6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:40.631955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de038d-58a6-48fa-9d66-8d97655fc6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:40.632248 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de038d-58a6-48fa-9d66-8d97655fc6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:40.632527 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de038d-58a6-48fa-9d66-8d97655fc6e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:40.633289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de038d-58a6-48fa-9d66-8d97655fc6e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:51:40.633594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de038d-58a6-48fa-9d66-8d97655fc6e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:40.635200 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de038d-58a6-48fa-9d66-8d97655fc6e8 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:40.646249 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1028/2043] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:51:40 2022] PUT /identity/v3/projects/78cc9a5023834c0893a1bdb2250cae8a/users/f077aa13553943a09bd1f95a678a11c8/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:51:40.648099 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1016/2044] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:51:40.652803 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e029932-1fd8-48a1-9d65-3d18b30c9f9f admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:40.658272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a06bfc-04ea-4acc-b89d-6b628736ceb8 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:40.658569 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a06bfc-04ea-4acc-b89d-6b628736ceb8 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:40.658858 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a06bfc-04ea-4acc-b89d-6b628736ceb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:40.689713 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-89a06bfc-04ea-4acc-b89d-6b628736ceb8 None None] MFA Rules not processed for user `f077aa13553943a09bd1f95a678a11c8`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:40.691562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-89a06bfc-04ea-4acc-b89d-6b628736ceb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:40.722171 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e029932-1fd8-48a1-9d65-3d18b30c9f9f admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:40.727598 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e07f15-5ec1-4230-a3c8-d4d50b074be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:40.728381 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e07f15-5ec1-4230-a3c8-d4d50b074be9 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:40.728812 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e07f15-5ec1-4230-a3c8-d4d50b074be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:40.729176 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e07f15-5ec1-4230-a3c8-d4d50b074be9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:40.729907 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e07f15-5ec1-4230-a3c8-d4d50b074be9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:40.731899 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e07f15-5ec1-4230-a3c8-d4d50b074be9 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:40.743111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:40.774677 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1017/2045] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:51:40.788573 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a06bfc-04ea-4acc-b89d-6b628736ceb8 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:40.790134 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-89a06bfc-04ea-4acc-b89d-6b628736ceb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:40.854005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:40.881631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a06bfc-04ea-4acc-b89d-6b628736ceb8 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:40.881631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd98e0c-3fd7-487a-b7c9-5903ba45e972 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd75a24363c14e86b0fbbb782b372646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:40.882317 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd98e0c-3fd7-487a-b7c9-5903ba45e972 service glance] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:40.882610 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd98e0c-3fd7-487a-b7c9-5903ba45e972 service glance] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:40.882894 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd98e0c-3fd7-487a-b7c9-5903ba45e972 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:40.891980 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd98e0c-3fd7-487a-b7c9-5903ba45e972 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:40.893431 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd98e0c-3fd7-487a-b7c9-5903ba45e972 service glance] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:40.907519 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1018/2046] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:51:40.925043 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1029/2047] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:51:40 2022] POST /identity/v3/projects => generated 373 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:40.926834 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd98e0c-3fd7-487a-b7c9-5903ba45e972 service glance] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:40.938970 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd98e0c-3fd7-487a-b7c9-5903ba45e972 service glance] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:41.019984 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e121a-4a18-4b05-8f8a-f5b664dab91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:41.019984 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e121a-4a18-4b05-8f8a-f5b664dab91c admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:41.019984 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e121a-4a18-4b05-8f8a-f5b664dab91c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:41.019984 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e121a-4a18-4b05-8f8a-f5b664dab91c admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:41.020493 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e121a-4a18-4b05-8f8a-f5b664dab91c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:41.021799 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e121a-4a18-4b05-8f8a-f5b664dab91c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:41.075544 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e07f15-5ec1-4230-a3c8-d4d50b074be9 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:41.075544 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-67e07f15-5ec1-4230-a3c8-d4d50b074be9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:41.137541 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e07f15-5ec1-4230-a3c8-d4d50b074be9 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:41.142576 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc580b5-6b5a-4516-9aff-5c2c3e77c922 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:41.143190 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc580b5-6b5a-4516-9aff-5c2c3e77c922 service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:41.143473 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc580b5-6b5a-4516-9aff-5c2c3e77c922 service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:41.143870 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc580b5-6b5a-4516-9aff-5c2c3e77c922 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:41.145947 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-cbc580b5-6b5a-4516-9aff-5c2c3e77c922 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:41.176262 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1019/2048] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:51:40 2022] POST /identity/v3/users => generated 287 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:41.180748 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e121a-4a18-4b05-8f8a-f5b664dab91c admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:41.194936 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e121a-4a18-4b05-8f8a-f5b664dab91c admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:41.205621 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1e4f4-c44d-4ed6-b5bf-cfc3db40a894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:41.207782 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1e4f4-c44d-4ed6-b5bf-cfc3db40a894 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:41.207782 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1e4f4-c44d-4ed6-b5bf-cfc3db40a894 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:41.207981 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1e4f4-c44d-4ed6-b5bf-cfc3db40a894 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:41.208948 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1e4f4-c44d-4ed6-b5bf-cfc3db40a894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:41.211670 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1e4f4-c44d-4ed6-b5bf-cfc3db40a894 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:41.227821 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1020/2049] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:51:41.234469 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1e4f4-c44d-4ed6-b5bf-cfc3db40a894 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:41.252655 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1e4f4-c44d-4ed6-b5bf-cfc3db40a894 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:41.261657 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a8e48-3e49-41fb-8913-138b94af5922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:41.262271 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc580b5-6b5a-4516-9aff-5c2c3e77c922 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:41.263106 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a8e48-3e49-41fb-8913-138b94af5922 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:41.263713 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a8e48-3e49-41fb-8913-138b94af5922 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:41.264028 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc580b5-6b5a-4516-9aff-5c2c3e77c922 service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:41.264935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a8e48-3e49-41fb-8913-138b94af5922 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:41.266216 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a8e48-3e49-41fb-8913-138b94af5922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:41.268734 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a8e48-3e49-41fb-8913-138b94af5922 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:41.279278 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1030/2050] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:41 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:51:41.286729 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1021/2051] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:51:41.288607 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc580b5-6b5a-4516-9aff-5c2c3e77c922 service cinder] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:41.304888 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc580b5-6b5a-4516-9aff-5c2c3e77c922 service cinder] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:41.310295 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa87310-760e-4c89-ae1f-562292a5495e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:41.311277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa87310-760e-4c89-ae1f-562292a5495e admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:41.311562 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa87310-760e-4c89-ae1f-562292a5495e admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:41.311866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa87310-760e-4c89-ae1f-562292a5495e admin admin] PATH_INFO: `/v3/projects/085eccc2e65d4ee492b90d48b5724df2/users/948ce205a3304b8fba5d57c556ce730f/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:41.331978 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa87310-760e-4c89-ae1f-562292a5495e admin admin] RBAC: Authorizing `identity:create_grant(project_id=085eccc2e65d4ee492b90d48b5724df2, user_id=948ce205a3304b8fba5d57c556ce730f, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:41.335846 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa87310-760e-4c89-ae1f-562292a5495e admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:41.471645 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1031/2052] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:51:41 2022] PUT /identity/v3/projects/085eccc2e65d4ee492b90d48b5724df2/users/948ce205a3304b8fba5d57c556ce730f/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:41.484862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c78798-3b06-440a-8a6c-d4f3c370191a None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:41.484982 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c78798-3b06-440a-8a6c-d4f3c370191a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:41.485261 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c78798-3b06-440a-8a6c-d4f3c370191a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:41.521462 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-a2c78798-3b06-440a-8a6c-d4f3c370191a None None] MFA Rules not processed for user `948ce205a3304b8fba5d57c556ce730f`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:41.522957 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a2c78798-3b06-440a-8a6c-d4f3c370191a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:41.619512 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1022/2053] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:41.622819 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa87310-760e-4c89-ae1f-562292a5495e admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:41.712357 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa87310-760e-4c89-ae1f-562292a5495e admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:41.717169 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700b2ae-509e-4f60-bb44-ac5f6caa8da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:41.717832 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700b2ae-509e-4f60-bb44-ac5f6caa8da5 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:41.718116 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700b2ae-509e-4f60-bb44-ac5f6caa8da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:41.718389 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700b2ae-509e-4f60-bb44-ac5f6caa8da5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:41.719140 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700b2ae-509e-4f60-bb44-ac5f6caa8da5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:41.721064 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700b2ae-509e-4f60-bb44-ac5f6caa8da5 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:41.806723 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:41.813559 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1032/2054] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:51:41 2022] POST /identity/v3/projects => generated 371 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:41.820289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c78798-3b06-440a-8a6c-d4f3c370191a None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:41.832881 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c78798-3b06-440a-8a6c-d4f3c370191a None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:41.863013 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:41.895133 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c36fcb-c66b-4897-bc6e-f4adfa99952c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:41.895987 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c36fcb-c66b-4897-bc6e-f4adfa99952c admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:41.896233 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c36fcb-c66b-4897-bc6e-f4adfa99952c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:41.896495 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c36fcb-c66b-4897-bc6e-f4adfa99952c admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:41.897230 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c36fcb-c66b-4897-bc6e-f4adfa99952c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:41.899234 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c36fcb-c66b-4897-bc6e-f4adfa99952c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:42.019795 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700b2ae-509e-4f60-bb44-ac5f6caa8da5 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:42.028075 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1023/2055] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:51:41 2022] POST /identity/v3/users => generated 292 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:42.032729 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700b2ae-509e-4f60-bb44-ac5f6caa8da5 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:42.041923 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71449066-d6ff-45b6-8c5a-79ac2be5329e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:42.042615 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71449066-d6ff-45b6-8c5a-79ac2be5329e admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:42.042901 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71449066-d6ff-45b6-8c5a-79ac2be5329e admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:42.043181 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71449066-d6ff-45b6-8c5a-79ac2be5329e admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:42.044005 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71449066-d6ff-45b6-8c5a-79ac2be5329e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:42.045779 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71449066-d6ff-45b6-8c5a-79ac2be5329e admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:42.061197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1033/2056] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:51:42.065322 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c36fcb-c66b-4897-bc6e-f4adfa99952c admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:42.078655 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c36fcb-c66b-4897-bc6e-f4adfa99952c admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:42.084569 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646d196-665f-4c79-9ecb-60c3c3cf3b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:42.085710 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646d196-665f-4c79-9ecb-60c3c3cf3b87 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:42.086060 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646d196-665f-4c79-9ecb-60c3c3cf3b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:42.086578 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646d196-665f-4c79-9ecb-60c3c3cf3b87 admin admin] PATH_INFO: `/v3/projects/772bdafa30734bed80edbdd85f6d9850/users/6a3f9295e76d456d9969ee821e33f8f4/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:42.110412 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646d196-665f-4c79-9ecb-60c3c3cf3b87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=772bdafa30734bed80edbdd85f6d9850, user_id=6a3f9295e76d456d9969ee821e33f8f4, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:42.115120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646d196-665f-4c79-9ecb-60c3c3cf3b87 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:42.277852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1024/2057] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:51:42 2022] PUT /identity/v3/projects/772bdafa30734bed80edbdd85f6d9850/users/6a3f9295e76d456d9969ee821e33f8f4/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:42.288925 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71449066-d6ff-45b6-8c5a-79ac2be5329e admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:42.300396 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71449066-d6ff-45b6-8c5a-79ac2be5329e admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:42.366601 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99fad0-d399-4230-9a16-4e47c5bd05ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:42.367281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99fad0-d399-4230-9a16-4e47c5bd05ad admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:42.367565 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99fad0-d399-4230-9a16-4e47c5bd05ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:42.367878 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99fad0-d399-4230-9a16-4e47c5bd05ad admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:42.368611 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99fad0-d399-4230-9a16-4e47c5bd05ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:42.370215 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99fad0-d399-4230-9a16-4e47c5bd05ad admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:42.381464 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1034/2058] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:51:42.385811 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646d196-665f-4c79-9ecb-60c3c3cf3b87 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:42.398232 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646d196-665f-4c79-9ecb-60c3c3cf3b87 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:42.403026 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4dbf6-4be5-485b-8e6c-1202a145fabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:42.403959 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4dbf6-4be5-485b-8e6c-1202a145fabb admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:42.404240 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4dbf6-4be5-485b-8e6c-1202a145fabb admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:42.404518 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4dbf6-4be5-485b-8e6c-1202a145fabb admin admin] PATH_INFO: `/v3/projects/772bdafa30734bed80edbdd85f6d9850/users/6a3f9295e76d456d9969ee821e33f8f4/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:42.406861 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4dbf6-4be5-485b-8e6c-1202a145fabb admin admin] RBAC: Authorizing `identity:create_grant(project_id=772bdafa30734bed80edbdd85f6d9850, user_id=6a3f9295e76d456d9969ee821e33f8f4, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:42.409574 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4dbf6-4be5-485b-8e6c-1202a145fabb admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:42.421092 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1025/2059] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:51:42 2022] PUT /identity/v3/projects/772bdafa30734bed80edbdd85f6d9850/users/6a3f9295e76d456d9969ee821e33f8f4/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:42.439144 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82371db-7acd-4cc1-9f78-30b4423bc654 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:42.439144 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82371db-7acd-4cc1-9f78-30b4423bc654 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:42.439144 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82371db-7acd-4cc1-9f78-30b4423bc654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:42.481821 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-c82371db-7acd-4cc1-9f78-30b4423bc654 None None] MFA Rules not processed for user `6a3f9295e76d456d9969ee821e33f8f4`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:42.483400 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-c82371db-7acd-4cc1-9f78-30b4423bc654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:42.568681 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1035/2060] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:42 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:42.607493 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4dbf6-4be5-485b-8e6c-1202a145fabb admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:42.718454 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4dbf6-4be5-485b-8e6c-1202a145fabb admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:42.722251 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba438444-89e7-48a9-a084-e8e871dce57e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:42.723197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba438444-89e7-48a9-a084-e8e871dce57e service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:42.723407 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba438444-89e7-48a9-a084-e8e871dce57e service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:42.723721 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba438444-89e7-48a9-a084-e8e871dce57e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:42.733998 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba438444-89e7-48a9-a084-e8e871dce57e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:42.735458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba438444-89e7-48a9-a084-e8e871dce57e service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:42.750459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1026/2061] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:42 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:51:44.020333 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82371db-7acd-4cc1-9f78-30b4423bc654 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:44.088090 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82371db-7acd-4cc1-9f78-30b4423bc654 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:44.093376 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde648a-8ed1-4098-97a6-e489098c18f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:44.094328 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde648a-8ed1-4098-97a6-e489098c18f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:44.094615 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde648a-8ed1-4098-97a6-e489098c18f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:44.094896 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde648a-8ed1-4098-97a6-e489098c18f6 admin admin] PATH_INFO: `/v3/users/948ce205a3304b8fba5d57c556ce730f` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:44.096262 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde648a-8ed1-4098-97a6-e489098c18f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=948ce205a3304b8fba5d57c556ce730f)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:44.098305 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde648a-8ed1-4098-97a6-e489098c18f6 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:44.111665 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:44.374116 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-cbde648a-8ed1-4098-97a6-e489098c18f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '948ce205a3304b8fba5d57c556ce730f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:44.375645 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-cbde648a-8ed1-4098-97a6-e489098c18f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '948ce205a3304b8fba5d57c556ce730f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:44.375645 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-cbde648a-8ed1-4098-97a6-e489098c18f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '948ce205a3304b8fba5d57c556ce730f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:44.383588 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-cbde648a-8ed1-4098-97a6-e489098c18f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '948ce205a3304b8fba5d57c556ce730f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:44.456608 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-cbde648a-8ed1-4098-97a6-e489098c18f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '948ce205a3304b8fba5d57c556ce730f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:44.476854 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1036/2062] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:51:44 2022] DELETE /identity/v3/users/948ce205a3304b8fba5d57c556ce730f => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:44.481658 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beeb409-3e69-4318-8dab-8d53047394a6 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:44.482193 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beeb409-3e69-4318-8dab-8d53047394a6 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:44.482193 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beeb409-3e69-4318-8dab-8d53047394a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:44.501943 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-6beeb409-3e69-4318-8dab-8d53047394a6 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:44.505537 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6beeb409-3e69-4318-8dab-8d53047394a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:44.569830 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1027/2063] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:44.579344 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde648a-8ed1-4098-97a6-e489098c18f6 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:44.580741 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-cbde648a-8ed1-4098-97a6-e489098c18f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:44.638888 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde648a-8ed1-4098-97a6-e489098c18f6 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:44.642527 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8778818-2a6c-4e42-b112-937c1cfef36d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:44.643181 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8778818-2a6c-4e42-b112-937c1cfef36d service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:44.643560 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8778818-2a6c-4e42-b112-937c1cfef36d service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:44.644022 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8778818-2a6c-4e42-b112-937c1cfef36d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:44.653491 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8778818-2a6c-4e42-b112-937c1cfef36d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:44.654935 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8778818-2a6c-4e42-b112-937c1cfef36d service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:44.665927 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1037/2064] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:51:45.133384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beeb409-3e69-4318-8dab-8d53047394a6 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:45.134940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6beeb409-3e69-4318-8dab-8d53047394a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:45.148440 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beeb409-3e69-4318-8dab-8d53047394a6 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:45.154638 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dff078-94cb-4677-a4db-c88923337e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:45.156104 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dff078-94cb-4677-a4db-c88923337e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:45.156520 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dff078-94cb-4677-a4db-c88923337e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:45.156907 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dff078-94cb-4677-a4db-c88923337e22 admin admin] PATH_INFO: `/v3/projects/085eccc2e65d4ee492b90d48b5724df2` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:45.160114 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dff078-94cb-4677-a4db-c88923337e22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=085eccc2e65d4ee492b90d48b5724df2)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:45.163127 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dff078-94cb-4677-a4db-c88923337e22 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:45.195067 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:45.325680 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b1dff078-94cb-4677-a4db-c88923337e22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '085eccc2e65d4ee492b90d48b5724df2', 'request_id': 'req-b1dff078-94cb-4677-a4db-c88923337e22'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:45.332662 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b1dff078-94cb-4677-a4db-c88923337e22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '085eccc2e65d4ee492b90d48b5724df2', 'request_id': 'req-b1dff078-94cb-4677-a4db-c88923337e22'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:45.338209 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b1dff078-94cb-4677-a4db-c88923337e22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '085eccc2e65d4ee492b90d48b5724df2', 'request_id': 'req-b1dff078-94cb-4677-a4db-c88923337e22'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:45.439279 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b1dff078-94cb-4677-a4db-c88923337e22 admin admin] The token cache is being invalidate because project 085eccc2e65d4ee492b90d48b5724df2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:51:45.439846 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b1dff078-94cb-4677-a4db-c88923337e22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:45.441053 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b1dff078-94cb-4677-a4db-c88923337e22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:45.443070 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1028/2065] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:51:45 2022] DELETE /identity/v3/projects/085eccc2e65d4ee492b90d48b5724df2 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:45.446812 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8778818-2a6c-4e42-b112-937c1cfef36d service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:45.458271 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8778818-2a6c-4e42-b112-937c1cfef36d service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:45.523043 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effdb50-528b-449d-b4a7-c0698149cfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:45.523953 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effdb50-528b-449d-b4a7-c0698149cfe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:45.524231 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effdb50-528b-449d-b4a7-c0698149cfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:45.524503 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effdb50-528b-449d-b4a7-c0698149cfe5 admin admin] PATH_INFO: `/v3/users/6a3f9295e76d456d9969ee821e33f8f4` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:45.525929 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8effdb50-528b-449d-b4a7-c0698149cfe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a3f9295e76d456d9969ee821e33f8f4)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:45.531050 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8effdb50-528b-449d-b4a7-c0698149cfe5 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:45.775677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:45.785284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-8effdb50-528b-449d-b4a7-c0698149cfe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a3f9295e76d456d9969ee821e33f8f4'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:45.786296 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-8effdb50-528b-449d-b4a7-c0698149cfe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a3f9295e76d456d9969ee821e33f8f4'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:45.786926 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-8effdb50-528b-449d-b4a7-c0698149cfe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a3f9295e76d456d9969ee821e33f8f4'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:45.794712 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-8effdb50-528b-449d-b4a7-c0698149cfe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a3f9295e76d456d9969ee821e33f8f4'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:45.926477 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-8effdb50-528b-449d-b4a7-c0698149cfe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a3f9295e76d456d9969ee821e33f8f4'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:45.945502 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1038/2066] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:51:45 2022] DELETE /identity/v3/users/6a3f9295e76d456d9969ee821e33f8f4 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:46.440648 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dff078-94cb-4677-a4db-c88923337e22 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:46.442446 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b1dff078-94cb-4677-a4db-c88923337e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:46.466242 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dff078-94cb-4677-a4db-c88923337e22 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:46.529030 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf61e30-f5b0-4304-9b58-1d2cbbb11e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:46.529948 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf61e30-f5b0-4304-9b58-1d2cbbb11e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:46.530270 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf61e30-f5b0-4304-9b58-1d2cbbb11e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:46.530554 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf61e30-f5b0-4304-9b58-1d2cbbb11e87 admin admin] PATH_INFO: `/v3/projects/772bdafa30734bed80edbdd85f6d9850` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:46.532150 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf61e30-f5b0-4304-9b58-1d2cbbb11e87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=772bdafa30734bed80edbdd85f6d9850)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:46.534549 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf61e30-f5b0-4304-9b58-1d2cbbb11e87 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:46.655290 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-9cf61e30-f5b0-4304-9b58-1d2cbbb11e87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '772bdafa30734bed80edbdd85f6d9850', 'request_id': 'req-9cf61e30-f5b0-4304-9b58-1d2cbbb11e87'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:46.665800 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-9cf61e30-f5b0-4304-9b58-1d2cbbb11e87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '772bdafa30734bed80edbdd85f6d9850', 'request_id': 'req-9cf61e30-f5b0-4304-9b58-1d2cbbb11e87'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:46.674236 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-9cf61e30-f5b0-4304-9b58-1d2cbbb11e87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '772bdafa30734bed80edbdd85f6d9850', 'request_id': 'req-9cf61e30-f5b0-4304-9b58-1d2cbbb11e87'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:46.816996 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-9cf61e30-f5b0-4304-9b58-1d2cbbb11e87 admin admin] The token cache is being invalidate because project 772bdafa30734bed80edbdd85f6d9850 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:51:46.817357 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-9cf61e30-f5b0-4304-9b58-1d2cbbb11e87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:46.817971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-9cf61e30-f5b0-4304-9b58-1d2cbbb11e87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:46.819599 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1029/2067] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:51:46 2022] DELETE /identity/v3/projects/772bdafa30734bed80edbdd85f6d9850 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:46.825440 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470d745-6ff2-427b-817e-4876c9e592b4 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:46.826000 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470d745-6ff2-427b-817e-4876c9e592b4 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:46.826000 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470d745-6ff2-427b-817e-4876c9e592b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:46.849801 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-2470d745-6ff2-427b-817e-4876c9e592b4 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:46.851114 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-2470d745-6ff2-427b-817e-4876c9e592b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:46.913220 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1039/2068] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:51:46.921184 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2b5f6-049f-497f-ab39-a474a265ddf4 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:46.921474 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2b5f6-049f-497f-ab39-a474a265ddf4 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:46.921755 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2b5f6-049f-497f-ab39-a474a265ddf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:46.942620 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-04b2b5f6-049f-497f-ab39-a474a265ddf4 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:46.943853 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-04b2b5f6-049f-497f-ab39-a474a265ddf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:46.952203 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1030/2069] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:46.955993 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470d745-6ff2-427b-817e-4876c9e592b4 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:46.965986 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470d745-6ff2-427b-817e-4876c9e592b4 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:46.970745 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c172d-4b2d-4271-badd-4515e7a5197e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:46.971399 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c172d-4b2d-4271-badd-4515e7a5197e admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:46.972298 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c172d-4b2d-4271-badd-4515e7a5197e admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:46.972842 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c172d-4b2d-4271-badd-4515e7a5197e admin admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:46.973676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c172d-4b2d-4271-badd-4515e7a5197e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:51:46.973987 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c172d-4b2d-4271-badd-4515e7a5197e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:46.975579 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c172d-4b2d-4271-badd-4515e7a5197e admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:46.988949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1040/2070] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:51:46.993262 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2b5f6-049f-497f-ab39-a474a265ddf4 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:47.002894 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2b5f6-049f-497f-ab39-a474a265ddf4 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:47.007647 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c81bbf-b65b-4954-9b5d-f46d1d10988a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:47.008520 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c81bbf-b65b-4954-9b5d-f46d1d10988a admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:47.008850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c81bbf-b65b-4954-9b5d-f46d1d10988a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:47.009200 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c81bbf-b65b-4954-9b5d-f46d1d10988a admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:47.010008 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c81bbf-b65b-4954-9b5d-f46d1d10988a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:47.012322 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c81bbf-b65b-4954-9b5d-f46d1d10988a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:47.133786 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1031/2071] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:51:46 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:51:47.137507 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c172d-4b2d-4271-badd-4515e7a5197e admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:47.152675 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c172d-4b2d-4271-badd-4515e7a5197e admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:47.210881 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95d068-c8b0-4ab2-80fa-9fc952209bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:47.211590 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95d068-c8b0-4ab2-80fa-9fc952209bfc admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:47.211915 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95d068-c8b0-4ab2-80fa-9fc952209bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:47.212270 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95d068-c8b0-4ab2-80fa-9fc952209bfc admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:47.213131 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95d068-c8b0-4ab2-80fa-9fc952209bfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:47.215138 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95d068-c8b0-4ab2-80fa-9fc952209bfc admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:47.338296 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1041/2072] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:51:47 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:47.342277 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c81bbf-b65b-4954-9b5d-f46d1d10988a admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:47.353573 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c81bbf-b65b-4954-9b5d-f46d1d10988a admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:47.358736 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe30b28-0625-433f-9d9d-2682edd4d84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:47.367704 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe30b28-0625-433f-9d9d-2682edd4d84a admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:47.367704 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe30b28-0625-433f-9d9d-2682edd4d84a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:47.367704 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe30b28-0625-433f-9d9d-2682edd4d84a admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:47.367704 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe30b28-0625-433f-9d9d-2682edd4d84a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:47.367704 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe30b28-0625-433f-9d9d-2682edd4d84a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:47.375401 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1032/2073] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:51:47.380281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95d068-c8b0-4ab2-80fa-9fc952209bfc admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:47.390582 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95d068-c8b0-4ab2-80fa-9fc952209bfc admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:47.398984 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a330318-9356-4415-9f8d-099f18b8cf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:47.399671 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a330318-9356-4415-9f8d-099f18b8cf30 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:47.399961 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a330318-9356-4415-9f8d-099f18b8cf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:47.400266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a330318-9356-4415-9f8d-099f18b8cf30 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:47.401010 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a330318-9356-4415-9f8d-099f18b8cf30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:47.402625 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a330318-9356-4415-9f8d-099f18b8cf30 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:47.415310 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1042/2074] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:51:47.419606 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe30b28-0625-433f-9d9d-2682edd4d84a admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:47.424992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:47.431383 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe30b28-0625-433f-9d9d-2682edd4d84a admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:47.439328 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4cbeb2-36e9-426c-a625-089e3090ca7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:47.440965 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cbeb2-36e9-426c-a625-089e3090ca7a admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:47.441538 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cbeb2-36e9-426c-a625-089e3090ca7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:47.441999 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cbeb2-36e9-426c-a625-089e3090ca7a admin admin] PATH_INFO: `/v3/projects/3bff1b962dca4776b1f1113ae25bbde5/users/128418e9abda45999ad5c245ba90ab41/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:47.461547 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4cbeb2-36e9-426c-a625-089e3090ca7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bff1b962dca4776b1f1113ae25bbde5, user_id=128418e9abda45999ad5c245ba90ab41, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:47.464196 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4cbeb2-36e9-426c-a625-089e3090ca7a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:47.589619 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1033/2075] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:51:47 2022] PUT /identity/v3/projects/3bff1b962dca4776b1f1113ae25bbde5/users/128418e9abda45999ad5c245ba90ab41/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:47.601112 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11128b-4f2a-4324-84a0-f114d788a6b6 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:47.601404 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11128b-4f2a-4324-84a0-f114d788a6b6 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:47.601709 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11128b-4f2a-4324-84a0-f114d788a6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:47.636878 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-3c11128b-4f2a-4324-84a0-f114d788a6b6 None None] MFA Rules not processed for user `128418e9abda45999ad5c245ba90ab41`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:47.638123 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-3c11128b-4f2a-4324-84a0-f114d788a6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:47.643114 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:47.716774 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1043/2076] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:47.722985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4cbeb2-36e9-426c-a625-089e3090ca7a admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:47.790940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4cbeb2-36e9-426c-a625-089e3090ca7a admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:47.797068 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf1697-1063-429e-bbb4-120861f8e661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:47.797853 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf1697-1063-429e-bbb4-120861f8e661 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:47.798142 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf1697-1063-429e-bbb4-120861f8e661 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:47.798445 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf1697-1063-429e-bbb4-120861f8e661 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:47.799216 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf1697-1063-429e-bbb4-120861f8e661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:47.802192 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf1697-1063-429e-bbb4-120861f8e661 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:47.927848 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1034/2077] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:51:47 2022] POST /identity/v3/projects => generated 387 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:47.931888 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11128b-4f2a-4324-84a0-f114d788a6b6 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:47.944189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11128b-4f2a-4324-84a0-f114d788a6b6 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:48.003947 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c9407-1736-42a0-9057-4a872bbfd1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:48.004631 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c9407-1736-42a0-9057-4a872bbfd1a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:48.004920 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c9407-1736-42a0-9057-4a872bbfd1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:48.005197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c9407-1736-42a0-9057-4a872bbfd1a5 admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:48.005892 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c9407-1736-42a0-9057-4a872bbfd1a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:48.007845 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c9407-1736-42a0-9057-4a872bbfd1a5 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:48.103591 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1044/2078] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:51:47 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:48.107837 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf1697-1063-429e-bbb4-120861f8e661 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:48.119532 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf1697-1063-429e-bbb4-120861f8e661 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:48.124773 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffafcc5-dfc1-40c1-b878-2d32a2294b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:48.125433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffafcc5-dfc1-40c1-b878-2d32a2294b3a admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:48.125719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffafcc5-dfc1-40c1-b878-2d32a2294b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:48.125997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffafcc5-dfc1-40c1-b878-2d32a2294b3a admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:48.126730 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffafcc5-dfc1-40c1-b878-2d32a2294b3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:48.128520 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffafcc5-dfc1-40c1-b878-2d32a2294b3a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:48.140484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1035/2079] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:51:48.145444 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c9407-1736-42a0-9057-4a872bbfd1a5 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:48.156005 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c9407-1736-42a0-9057-4a872bbfd1a5 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:48.161403 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f73726-4e77-47a8-8f03-65c963ba1725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:48.162282 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f73726-4e77-47a8-8f03-65c963ba1725 admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:48.162565 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f73726-4e77-47a8-8f03-65c963ba1725 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:48.162842 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f73726-4e77-47a8-8f03-65c963ba1725 admin admin] PATH_INFO: `/v3/projects/af2c69314a9643d298c6ff3540144efd/users/ef6093aae4004a87ad15d4c26e47b409/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:48.177615 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f73726-4e77-47a8-8f03-65c963ba1725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af2c69314a9643d298c6ff3540144efd, user_id=ef6093aae4004a87ad15d4c26e47b409, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:48.180371 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f73726-4e77-47a8-8f03-65c963ba1725 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:48.320188 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1045/2080] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:51:48 2022] PUT /identity/v3/projects/af2c69314a9643d298c6ff3540144efd/users/ef6093aae4004a87ad15d4c26e47b409/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:48.324193 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffafcc5-dfc1-40c1-b878-2d32a2294b3a admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:48.335251 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffafcc5-dfc1-40c1-b878-2d32a2294b3a admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:48.392295 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd78044-509a-4879-84f9-b907934e22ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:48.392998 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd78044-509a-4879-84f9-b907934e22ca admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:48.393292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd78044-509a-4879-84f9-b907934e22ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:48.393573 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd78044-509a-4879-84f9-b907934e22ca admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:48.395062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd78044-509a-4879-84f9-b907934e22ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:48.396770 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd78044-509a-4879-84f9-b907934e22ca admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:48.410472 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1036/2081] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:51:48.411804 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f73726-4e77-47a8-8f03-65c963ba1725 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:48.422677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f73726-4e77-47a8-8f03-65c963ba1725 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:48.427680 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8f881-37c1-439c-b46f-0232a3c24d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:48.428568 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8f881-37c1-439c-b46f-0232a3c24d38 admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:48.428852 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8f881-37c1-439c-b46f-0232a3c24d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:48.433693 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8f881-37c1-439c-b46f-0232a3c24d38 admin admin] PATH_INFO: `/v3/projects/af2c69314a9643d298c6ff3540144efd/users/ef6093aae4004a87ad15d4c26e47b409/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:48.433693 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8f881-37c1-439c-b46f-0232a3c24d38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af2c69314a9643d298c6ff3540144efd, user_id=ef6093aae4004a87ad15d4c26e47b409, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:48.434044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8f881-37c1-439c-b46f-0232a3c24d38 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:48.455736 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1046/2082] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:51:48 2022] PUT /identity/v3/projects/af2c69314a9643d298c6ff3540144efd/users/ef6093aae4004a87ad15d4c26e47b409/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:48.468554 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbde1a2-1808-48a1-9582-ef66e1670bc4 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:48.473812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbde1a2-1808-48a1-9582-ef66e1670bc4 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:48.473812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbde1a2-1808-48a1-9582-ef66e1670bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:48.498204 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-7fbde1a2-1808-48a1-9582-ef66e1670bc4 None None] MFA Rules not processed for user `ef6093aae4004a87ad15d4c26e47b409`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:48.499537 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-7fbde1a2-1808-48a1-9582-ef66e1670bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:48.541130 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:48.571992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1037/2083] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:48.585161 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8f881-37c1-439c-b46f-0232a3c24d38 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:48.587107 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-dfd8f881-37c1-439c-b46f-0232a3c24d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:48.651136 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8f881-37c1-439c-b46f-0232a3c24d38 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:48.655215 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1788565-7252-4d5b-ae1c-f353b4cb94ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:48.656163 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1788565-7252-4d5b-ae1c-f353b4cb94ed service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:48.656455 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1788565-7252-4d5b-ae1c-f353b4cb94ed service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:48.656732 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1788565-7252-4d5b-ae1c-f353b4cb94ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:48.668135 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1788565-7252-4d5b-ae1c-f353b4cb94ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:48.669622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1788565-7252-4d5b-ae1c-f353b4cb94ed service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:48.680252 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1047/2084] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:51:48.769694 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbde1a2-1808-48a1-9582-ef66e1670bc4 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:48.771022 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1788565-7252-4d5b-ae1c-f353b4cb94ed service cinder] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:48.771145 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-7fbde1a2-1808-48a1-9582-ef66e1670bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:48.775979 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:48.851671 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1788565-7252-4d5b-ae1c-f353b4cb94ed service cinder] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:48.856745 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774ea5f-adfc-42ee-8206-bad579a5f1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:48.857690 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774ea5f-adfc-42ee-8206-bad579a5f1df admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:48.857983 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774ea5f-adfc-42ee-8206-bad579a5f1df admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:48.858258 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774ea5f-adfc-42ee-8206-bad579a5f1df admin admin] PATH_INFO: `/v3/users/128418e9abda45999ad5c245ba90ab41` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:48.860020 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774ea5f-adfc-42ee-8206-bad579a5f1df admin admin] RBAC: Authorizing `identity:delete_user(user_id=128418e9abda45999ad5c245ba90ab41)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:48.863665 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbde1a2-1808-48a1-9582-ef66e1670bc4 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:48.865405 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774ea5f-adfc-42ee-8206-bad579a5f1df admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:48.869924 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8dbd3-8649-4826-a503-e5bfe43f595e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:48.870938 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8dbd3-8649-4826-a503-e5bfe43f595e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:48.871330 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8dbd3-8649-4826-a503-e5bfe43f595e admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:48.871657 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8dbd3-8649-4826-a503-e5bfe43f595e admin admin] PATH_INFO: `/v3/users/bd7f5bd2d0b24b85b7617d95a1cd3d29` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:48.873327 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8dbd3-8649-4826-a503-e5bfe43f595e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd7f5bd2d0b24b85b7617d95a1cd3d29)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:48.875664 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8dbd3-8649-4826-a503-e5bfe43f595e admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:49.090110 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-7774ea5f-adfc-42ee-8206-bad579a5f1df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '128418e9abda45999ad5c245ba90ab41'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:49.091158 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-7774ea5f-adfc-42ee-8206-bad579a5f1df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '128418e9abda45999ad5c245ba90ab41'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:49.092575 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-7774ea5f-adfc-42ee-8206-bad579a5f1df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '128418e9abda45999ad5c245ba90ab41'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:49.093411 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b2d8dbd3-8649-4826-a503-e5bfe43f595e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd7f5bd2d0b24b85b7617d95a1cd3d29'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:49.101824 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-7774ea5f-adfc-42ee-8206-bad579a5f1df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '128418e9abda45999ad5c245ba90ab41'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:49.106833 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b2d8dbd3-8649-4826-a503-e5bfe43f595e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd7f5bd2d0b24b85b7617d95a1cd3d29'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:49.115143 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b2d8dbd3-8649-4826-a503-e5bfe43f595e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd7f5bd2d0b24b85b7617d95a1cd3d29'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:49.120212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b2d8dbd3-8649-4826-a503-e5bfe43f595e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd7f5bd2d0b24b85b7617d95a1cd3d29'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:49.227765 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-7774ea5f-adfc-42ee-8206-bad579a5f1df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '128418e9abda45999ad5c245ba90ab41'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:49.248642 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1048/2085] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:51:48 2022] DELETE /identity/v3/users/128418e9abda45999ad5c245ba90ab41 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:49.252832 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9b416-37b1-4518-abe9-8ed076bc6b7e None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:49.253131 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9b416-37b1-4518-abe9-8ed076bc6b7e None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:49.253769 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9b416-37b1-4518-abe9-8ed076bc6b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:49.274830 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-22a9b416-37b1-4518-abe9-8ed076bc6b7e None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:49.276221 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-22a9b416-37b1-4518-abe9-8ed076bc6b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:49.336341 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1049/2086] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:49.341894 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b2d8dbd3-8649-4826-a503-e5bfe43f595e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd7f5bd2d0b24b85b7617d95a1cd3d29'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:49.346201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9b416-37b1-4518-abe9-8ed076bc6b7e None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:49.348637 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-22a9b416-37b1-4518-abe9-8ed076bc6b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:49.367952 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1038/2087] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:51:48 2022] DELETE /identity/v3/users/bd7f5bd2d0b24b85b7617d95a1cd3d29 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:49.372463 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20981700-dc19-46c9-9708-636451764ad9 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:49.372765 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20981700-dc19-46c9-9708-636451764ad9 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:49.373055 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20981700-dc19-46c9-9708-636451764ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:49.378595 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:49.395850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-20981700-dc19-46c9-9708-636451764ad9 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:49.397160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-20981700-dc19-46c9-9708-636451764ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:49.417175 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9b416-37b1-4518-abe9-8ed076bc6b7e None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:49.450820 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:49.477443 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1039/2088] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:51:49.478210 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9aa3fc-abdf-4129-b949-2cb0088d4816 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:49.478461 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9aa3fc-abdf-4129-b949-2cb0088d4816 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:49.478807 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9aa3fc-abdf-4129-b949-2cb0088d4816 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:49.479150 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9aa3fc-abdf-4129-b949-2cb0088d4816 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:49.489418 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20981700-dc19-46c9-9708-636451764ad9 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:49.491569 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-20981700-dc19-46c9-9708-636451764ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:49.494271 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9aa3fc-abdf-4129-b949-2cb0088d4816 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:49.496054 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9aa3fc-abdf-4129-b949-2cb0088d4816 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:49.508634 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20981700-dc19-46c9-9708-636451764ad9 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:49.510541 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1050/2089] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:51:49.514929 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259faa4-97fc-4f18-a154-870acaf79389 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:49.515595 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259faa4-97fc-4f18-a154-870acaf79389 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:49.515911 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259faa4-97fc-4f18-a154-870acaf79389 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:49.516204 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259faa4-97fc-4f18-a154-870acaf79389 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:49.531155 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7259faa4-97fc-4f18-a154-870acaf79389 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:49.531155 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7259faa4-97fc-4f18-a154-870acaf79389 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:49.541009 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1040/2090] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:51:50.043387 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9aa3fc-abdf-4129-b949-2cb0088d4816 service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:50.044914 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-8a9aa3fc-abdf-4129-b949-2cb0088d4816 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:50.059433 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9aa3fc-abdf-4129-b949-2cb0088d4816 service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:50.065181 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8d8aa-e1bf-42e5-9148-090b7700010b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:50.066087 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8d8aa-e1bf-42e5-9148-090b7700010b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:50.066397 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8d8aa-e1bf-42e5-9148-090b7700010b admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:50.066856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8d8aa-e1bf-42e5-9148-090b7700010b admin admin] PATH_INFO: `/v3/projects/3bff1b962dca4776b1f1113ae25bbde5` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:50.068156 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8d8aa-e1bf-42e5-9148-090b7700010b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bff1b962dca4776b1f1113ae25bbde5)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:50.070137 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8d8aa-e1bf-42e5-9148-090b7700010b admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:50.185793 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259faa4-97fc-4f18-a154-870acaf79389 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:50.189266 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-7259faa4-97fc-4f18-a154-870acaf79389 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:50.205903 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259faa4-97fc-4f18-a154-870acaf79389 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:50.223593 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-f4e8d8aa-e1bf-42e5-9148-090b7700010b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bff1b962dca4776b1f1113ae25bbde5', 'request_id': 'req-f4e8d8aa-e1bf-42e5-9148-090b7700010b'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:50.232315 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-f4e8d8aa-e1bf-42e5-9148-090b7700010b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bff1b962dca4776b1f1113ae25bbde5', 'request_id': 'req-f4e8d8aa-e1bf-42e5-9148-090b7700010b'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:50.245976 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-f4e8d8aa-e1bf-42e5-9148-090b7700010b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bff1b962dca4776b1f1113ae25bbde5', 'request_id': 'req-f4e8d8aa-e1bf-42e5-9148-090b7700010b'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:50.285831 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b66e08-36bc-4c9b-bfaa-72a64ef9eb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:50.286714 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b66e08-36bc-4c9b-bfaa-72a64ef9eb80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:50.286996 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b66e08-36bc-4c9b-bfaa-72a64ef9eb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:50.287270 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b66e08-36bc-4c9b-bfaa-72a64ef9eb80 admin admin] PATH_INFO: `/v3/projects/c014bbe61f164cd39ed33e63b4e36b04` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:50.288556 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b66e08-36bc-4c9b-bfaa-72a64ef9eb80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c014bbe61f164cd39ed33e63b4e36b04)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:50.291049 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b66e08-36bc-4c9b-bfaa-72a64ef9eb80 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:50.399236 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-f4e8d8aa-e1bf-42e5-9148-090b7700010b admin admin] The token cache is being invalidate because project 3bff1b962dca4776b1f1113ae25bbde5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:51:50.399450 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-f4e8d8aa-e1bf-42e5-9148-090b7700010b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:50.400112 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-f4e8d8aa-e1bf-42e5-9148-090b7700010b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:50.401812 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1051/2091] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:51:50 2022] DELETE /identity/v3/projects/3bff1b962dca4776b1f1113ae25bbde5 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:50.406171 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8d8aa-e1bf-42e5-9148-090b7700010b admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:50.407468 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-f4e8d8aa-e1bf-42e5-9148-090b7700010b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:50.420709 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8d8aa-e1bf-42e5-9148-090b7700010b admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:50.426854 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9031d385-5432-4e95-b8fb-233d37b13225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:50.428373 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031d385-5432-4e95-b8fb-233d37b13225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:50.428801 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031d385-5432-4e95-b8fb-233d37b13225 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:50.429253 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031d385-5432-4e95-b8fb-233d37b13225 admin admin] PATH_INFO: `/v3/users/ef6093aae4004a87ad15d4c26e47b409` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:50.431435 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9031d385-5432-4e95-b8fb-233d37b13225 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef6093aae4004a87ad15d4c26e47b409)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:50.435008 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9031d385-5432-4e95-b8fb-233d37b13225 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:50.489750 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-96b66e08-36bc-4c9b-bfaa-72a64ef9eb80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c014bbe61f164cd39ed33e63b4e36b04', 'request_id': 'req-96b66e08-36bc-4c9b-bfaa-72a64ef9eb80'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:50.497527 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-96b66e08-36bc-4c9b-bfaa-72a64ef9eb80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c014bbe61f164cd39ed33e63b4e36b04', 'request_id': 'req-96b66e08-36bc-4c9b-bfaa-72a64ef9eb80'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:50.505497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-96b66e08-36bc-4c9b-bfaa-72a64ef9eb80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c014bbe61f164cd39ed33e63b4e36b04', 'request_id': 'req-96b66e08-36bc-4c9b-bfaa-72a64ef9eb80'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:50.645639 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-96b66e08-36bc-4c9b-bfaa-72a64ef9eb80 admin admin] The token cache is being invalidate because project c014bbe61f164cd39ed33e63b4e36b04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:51:50.645995 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-96b66e08-36bc-4c9b-bfaa-72a64ef9eb80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:50.646712 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-96b66e08-36bc-4c9b-bfaa-72a64ef9eb80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:50.648352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1041/2092] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:51:50 2022] DELETE /identity/v3/projects/c014bbe61f164cd39ed33e63b4e36b04 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:51:50.654141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd75dd4-cbe4-4b58-8446-416f4c5f88e5 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:50.654456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd75dd4-cbe4-4b58-8446-416f4c5f88e5 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:50.654908 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd75dd4-cbe4-4b58-8446-416f4c5f88e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:50.679302 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-5dd75dd4-cbe4-4b58-8446-416f4c5f88e5 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:50.680553 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-5dd75dd4-cbe4-4b58-8446-416f4c5f88e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:50.739052 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-9031d385-5432-4e95-b8fb-233d37b13225 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef6093aae4004a87ad15d4c26e47b409'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:50.739795 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-9031d385-5432-4e95-b8fb-233d37b13225 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef6093aae4004a87ad15d4c26e47b409'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:50.740567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-9031d385-5432-4e95-b8fb-233d37b13225 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef6093aae4004a87ad15d4c26e47b409'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:50.760833 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-9031d385-5432-4e95-b8fb-233d37b13225 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef6093aae4004a87ad15d4c26e47b409'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:50.772451 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1042/2093] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:51:50.776130 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:50.791141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1cdba-e97e-43c5-bdd4-a5e3ea2ab7b7 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:50.791141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1cdba-e97e-43c5-bdd4-a5e3ea2ab7b7 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:50.791141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1cdba-e97e-43c5-bdd4-a5e3ea2ab7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:50.804541 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-31f1cdba-e97e-43c5-bdd4-a5e3ea2ab7b7 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:50.805761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-31f1cdba-e97e-43c5-bdd4-a5e3ea2ab7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:50.814260 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1043/2094] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:51:50.818605 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1cdba-e97e-43c5-bdd4-a5e3ea2ab7b7 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:50.825186 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:50.829692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1cdba-e97e-43c5-bdd4-a5e3ea2ab7b7 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:50.835421 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0028fb0-ec3a-4762-9e43-531c5082a76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:50.836137 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0028fb0-ec3a-4762-9e43-531c5082a76c admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:50.836424 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0028fb0-ec3a-4762-9e43-531c5082a76c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:50.836702 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0028fb0-ec3a-4762-9e43-531c5082a76c admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:50.837528 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0028fb0-ec3a-4762-9e43-531c5082a76c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:51:50.837839 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0028fb0-ec3a-4762-9e43-531c5082a76c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:50.839463 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0028fb0-ec3a-4762-9e43-531c5082a76c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:50.852372 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1044/2095] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:51:50.860628 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0028fb0-ec3a-4762-9e43-531c5082a76c admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:50.877525 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0028fb0-ec3a-4762-9e43-531c5082a76c admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:50.881896 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-9031d385-5432-4e95-b8fb-233d37b13225 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef6093aae4004a87ad15d4c26e47b409'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:50.884220 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2f5ad-02de-4140-9671-3b1195c4c825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:50.884882 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2f5ad-02de-4140-9671-3b1195c4c825 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:50.885171 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2f5ad-02de-4140-9671-3b1195c4c825 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:50.885803 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2f5ad-02de-4140-9671-3b1195c4c825 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:50.886159 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2f5ad-02de-4140-9671-3b1195c4c825 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:50.888127 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2f5ad-02de-4140-9671-3b1195c4c825 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:50.912302 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1052/2096] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:51:50 2022] DELETE /identity/v3/users/ef6093aae4004a87ad15d4c26e47b409 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:51:51.018876 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1045/2097] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:51:50 2022] POST /identity/v3/projects => generated 391 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:51.025035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9031d385-5432-4e95-b8fb-233d37b13225 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:51.095901 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9031d385-5432-4e95-b8fb-233d37b13225 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:51.198508 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5c7e5-f8ff-4640-ac86-307746c1853f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:51.199925 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5c7e5-f8ff-4640-ac86-307746c1853f admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:51.200400 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5c7e5-f8ff-4640-ac86-307746c1853f admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:51.201021 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5c7e5-f8ff-4640-ac86-307746c1853f admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:51.201808 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da5c7e5-f8ff-4640-ac86-307746c1853f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:51.204430 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da5c7e5-f8ff-4640-ac86-307746c1853f admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:51.358844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1053/2098] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:51:51 2022] POST /identity/v3/users => generated 296 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:51.361237 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2f5ad-02de-4140-9671-3b1195c4c825 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:51.380754 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2f5ad-02de-4140-9671-3b1195c4c825 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:51.420434 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3c213-16cd-4ff9-a10c-8b4d6b61e347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:51.420434 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3c213-16cd-4ff9-a10c-8b4d6b61e347 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:51.420434 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3c213-16cd-4ff9-a10c-8b4d6b61e347 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:51.420434 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3c213-16cd-4ff9-a10c-8b4d6b61e347 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:51.420905 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3c213-16cd-4ff9-a10c-8b4d6b61e347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:51.420905 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3c213-16cd-4ff9-a10c-8b4d6b61e347 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:51.431563 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1046/2099] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:51:51.435504 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5c7e5-f8ff-4640-ac86-307746c1853f admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:51.450236 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5c7e5-f8ff-4640-ac86-307746c1853f admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:51.455111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21182f-1e14-4c05-812d-d4291065c01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:51.455863 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21182f-1e14-4c05-812d-d4291065c01a admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:51.456782 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21182f-1e14-4c05-812d-d4291065c01a admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:51.457071 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21182f-1e14-4c05-812d-d4291065c01a admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:51.457922 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21182f-1e14-4c05-812d-d4291065c01a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:51.459543 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21182f-1e14-4c05-812d-d4291065c01a admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:51.476598 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1054/2100] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:51:51.480952 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3c213-16cd-4ff9-a10c-8b4d6b61e347 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:51.492133 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3c213-16cd-4ff9-a10c-8b4d6b61e347 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:51.496993 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eff3ef-1e5e-4c41-b1a0-ceddc668c49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:51.500611 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eff3ef-1e5e-4c41-b1a0-ceddc668c49a admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:51.500611 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eff3ef-1e5e-4c41-b1a0-ceddc668c49a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:51.500611 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eff3ef-1e5e-4c41-b1a0-ceddc668c49a admin admin] PATH_INFO: `/v3/projects/46b20c969aa64af9bb32b01372073afd/users/93a315d24cc74f9391ce934ba53ccbc3/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:51.514390 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eff3ef-1e5e-4c41-b1a0-ceddc668c49a admin admin] RBAC: Authorizing `identity:create_grant(project_id=46b20c969aa64af9bb32b01372073afd, user_id=93a315d24cc74f9391ce934ba53ccbc3, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:51.517096 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eff3ef-1e5e-4c41-b1a0-ceddc668c49a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:51.527710 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21182f-1e14-4c05-812d-d4291065c01a admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:51.530032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-0b21182f-1e14-4c05-812d-d4291065c01a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:51.545260 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21182f-1e14-4c05-812d-d4291065c01a admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:51.551189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360cb48-478d-4bd3-a0bf-1dccf6caf3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:51.552212 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360cb48-478d-4bd3-a0bf-1dccf6caf3e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:51.552597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360cb48-478d-4bd3-a0bf-1dccf6caf3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:51.552963 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360cb48-478d-4bd3-a0bf-1dccf6caf3e4 admin admin] PATH_INFO: `/v3/projects/af2c69314a9643d298c6ff3540144efd` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:51.554423 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5360cb48-478d-4bd3-a0bf-1dccf6caf3e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af2c69314a9643d298c6ff3540144efd)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:51.556709 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5360cb48-478d-4bd3-a0bf-1dccf6caf3e4 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:51.602179 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1047/2101] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:51:51 2022] PUT /identity/v3/projects/46b20c969aa64af9bb32b01372073afd/users/93a315d24cc74f9391ce934ba53ccbc3/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:51.613457 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66490d-8d05-426a-bf8e-d539d3b9218f None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:51.613829 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66490d-8d05-426a-bf8e-d539d3b9218f None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:51.614185 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66490d-8d05-426a-bf8e-d539d3b9218f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:51.644228 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-9e66490d-8d05-426a-bf8e-d539d3b9218f None None] MFA Rules not processed for user `93a315d24cc74f9391ce934ba53ccbc3`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:51.645692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9e66490d-8d05-426a-bf8e-d539d3b9218f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:51.717058 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5360cb48-478d-4bd3-a0bf-1dccf6caf3e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af2c69314a9643d298c6ff3540144efd', 'request_id': 'req-5360cb48-478d-4bd3-a0bf-1dccf6caf3e4'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:51.718717 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1048/2102] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:51:51.729176 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5360cb48-478d-4bd3-a0bf-1dccf6caf3e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af2c69314a9643d298c6ff3540144efd', 'request_id': 'req-5360cb48-478d-4bd3-a0bf-1dccf6caf3e4'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:51.732320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5360cb48-478d-4bd3-a0bf-1dccf6caf3e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af2c69314a9643d298c6ff3540144efd', 'request_id': 'req-5360cb48-478d-4bd3-a0bf-1dccf6caf3e4'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:51.732862 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66490d-8d05-426a-bf8e-d539d3b9218f None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:51.734288 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9e66490d-8d05-426a-bf8e-d539d3b9218f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:51.793462 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66490d-8d05-426a-bf8e-d539d3b9218f None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:51.828472 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5360cb48-478d-4bd3-a0bf-1dccf6caf3e4 admin admin] The token cache is being invalidate because project af2c69314a9643d298c6ff3540144efd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:51:51.829047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5360cb48-478d-4bd3-a0bf-1dccf6caf3e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:51.829944 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5360cb48-478d-4bd3-a0bf-1dccf6caf3e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:51:51.832235 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1055/2103] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:51:51 2022] DELETE /identity/v3/projects/af2c69314a9643d298c6ff3540144efd => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:51:51.837133 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434eb5d-2773-46ae-9013-a6c2c2dc1802 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:51.837421 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434eb5d-2773-46ae-9013-a6c2c2dc1802 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:51.837699 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434eb5d-2773-46ae-9013-a6c2c2dc1802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:51.850238 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017f94f-f0c6-42d2-abdd-15672cdbfbae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:51.855422 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017f94f-f0c6-42d2-abdd-15672cdbfbae service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:51.855422 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017f94f-f0c6-42d2-abdd-15672cdbfbae service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:51.855422 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017f94f-f0c6-42d2-abdd-15672cdbfbae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:51.855422 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-8017f94f-f0c6-42d2-abdd-15672cdbfbae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:51.859889 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-e434eb5d-2773-46ae-9013-a6c2c2dc1802 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:51.861129 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-e434eb5d-2773-46ae-9013-a6c2c2dc1802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:51.916294 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017f94f-f0c6-42d2-abdd-15672cdbfbae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:51.917780 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017f94f-f0c6-42d2-abdd-15672cdbfbae service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:51.923132 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1056/2104] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:51:51.928592 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1049/2105] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:51:51.931515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be1df4-2aed-48ae-bbdb-3e7a18d108f0 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:51.931839 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be1df4-2aed-48ae-bbdb-3e7a18d108f0 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:51.932167 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be1df4-2aed-48ae-bbdb-3e7a18d108f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:51.954575 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-f8be1df4-2aed-48ae-bbdb-3e7a18d108f0 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:51.957593 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-f8be1df4-2aed-48ae-bbdb-3e7a18d108f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:51.966788 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1057/2106] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:51.970867 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017f94f-f0c6-42d2-abdd-15672cdbfbae service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:51.983277 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017f94f-f0c6-42d2-abdd-15672cdbfbae service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:51.988645 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275e2a4-29fd-4519-aa2e-aa26cb7454de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:51.989372 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275e2a4-29fd-4519-aa2e-aa26cb7454de admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:51.989657 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275e2a4-29fd-4519-aa2e-aa26cb7454de admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:51.989931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275e2a4-29fd-4519-aa2e-aa26cb7454de admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:51.990660 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275e2a4-29fd-4519-aa2e-aa26cb7454de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:51:51.990967 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275e2a4-29fd-4519-aa2e-aa26cb7454de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:51.992620 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275e2a4-29fd-4519-aa2e-aa26cb7454de admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:52.005612 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1050/2107] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:51:52.009960 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be1df4-2aed-48ae-bbdb-3e7a18d108f0 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:52.020902 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be1df4-2aed-48ae-bbdb-3e7a18d108f0 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:52.025956 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114aef1-e1f0-4032-ac61-b0c303dc3c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:52.027417 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114aef1-e1f0-4032-ac61-b0c303dc3c43 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:52.027417 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114aef1-e1f0-4032-ac61-b0c303dc3c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:52.027600 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114aef1-e1f0-4032-ac61-b0c303dc3c43 admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:52.028395 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e114aef1-e1f0-4032-ac61-b0c303dc3c43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:52.030447 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e114aef1-e1f0-4032-ac61-b0c303dc3c43 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:52.132454 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1058/2108] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:51:52 2022] POST /identity/v3/projects => generated 367 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:52.136681 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275e2a4-29fd-4519-aa2e-aa26cb7454de admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:52.152777 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275e2a4-29fd-4519-aa2e-aa26cb7454de admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:52.220974 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95a88d-f112-4769-b3e8-f700e123788c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:52.221579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95a88d-f112-4769-b3e8-f700e123788c admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:52.222820 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95a88d-f112-4769-b3e8-f700e123788c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:52.223135 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95a88d-f112-4769-b3e8-f700e123788c admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:52.223928 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95a88d-f112-4769-b3e8-f700e123788c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:52.225865 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95a88d-f112-4769-b3e8-f700e123788c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:52.262332 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:52.302947 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1051/2109] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:51:52 2022] POST /identity/v3/users => generated 284 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:52.307360 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114aef1-e1f0-4032-ac61-b0c303dc3c43 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:52.313751 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:52.318352 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114aef1-e1f0-4032-ac61-b0c303dc3c43 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:52.323421 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f67123-fa14-4007-a8a3-a91127a67200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:52.324187 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f67123-fa14-4007-a8a3-a91127a67200 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:52.324461 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f67123-fa14-4007-a8a3-a91127a67200 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:52.324733 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f67123-fa14-4007-a8a3-a91127a67200 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:52.331304 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f67123-fa14-4007-a8a3-a91127a67200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:52.331304 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f67123-fa14-4007-a8a3-a91127a67200 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:52.341856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1059/2110] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:51:52.343505 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95a88d-f112-4769-b3e8-f700e123788c admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:52.354655 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95a88d-f112-4769-b3e8-f700e123788c admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:52.359326 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d81907-d2a0-42fe-a6a4-8b0f9b51cfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:52.360020 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d81907-d2a0-42fe-a6a4-8b0f9b51cfad admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:52.360360 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d81907-d2a0-42fe-a6a4-8b0f9b51cfad admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:52.360766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d81907-d2a0-42fe-a6a4-8b0f9b51cfad admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:52.361806 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d81907-d2a0-42fe-a6a4-8b0f9b51cfad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:52.365062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d81907-d2a0-42fe-a6a4-8b0f9b51cfad admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:52.376790 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1052/2111] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:51:52.382094 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f67123-fa14-4007-a8a3-a91127a67200 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:52.395015 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f67123-fa14-4007-a8a3-a91127a67200 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:52.400603 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b205b-b177-4383-b022-3a3a8b0951cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:52.401337 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b205b-b177-4383-b022-3a3a8b0951cb admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:52.401622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b205b-b177-4383-b022-3a3a8b0951cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:52.401926 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b205b-b177-4383-b022-3a3a8b0951cb admin admin] PATH_INFO: `/v3/projects/e6bc5507323847d4920c420b0d67a1c0/users/82acc5964ffb4679a79b96c523ba5b80/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:52.422129 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b205b-b177-4383-b022-3a3a8b0951cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6bc5507323847d4920c420b0d67a1c0, user_id=82acc5964ffb4679a79b96c523ba5b80, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:52.425531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b205b-b177-4383-b022-3a3a8b0951cb admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:52.525230 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1060/2112] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:51:52 2022] PUT /identity/v3/projects/e6bc5507323847d4920c420b0d67a1c0/users/82acc5964ffb4679a79b96c523ba5b80/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:51:52.541830 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a249f3-53ea-4166-81e2-e072bfd9487a None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:52.542372 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a249f3-53ea-4166-81e2-e072bfd9487a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:52.542372 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a249f3-53ea-4166-81e2-e072bfd9487a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:52.604238 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-47a249f3-53ea-4166-81e2-e072bfd9487a None None] MFA Rules not processed for user `82acc5964ffb4679a79b96c523ba5b80`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:52.604238 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-47a249f3-53ea-4166-81e2-e072bfd9487a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:52.675398 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1053/2113] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:52 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:52.680224 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b205b-b177-4383-b022-3a3a8b0951cb admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:52.708451 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:52.745449 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b205b-b177-4383-b022-3a3a8b0951cb admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:52.749950 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c465d7-1a5c-4af2-80b3-7a156dd3db34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:52.750651 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c465d7-1a5c-4af2-80b3-7a156dd3db34 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:52.750936 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c465d7-1a5c-4af2-80b3-7a156dd3db34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:52.751215 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c465d7-1a5c-4af2-80b3-7a156dd3db34 admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:52.751987 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c465d7-1a5c-4af2-80b3-7a156dd3db34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:52.754640 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c465d7-1a5c-4af2-80b3-7a156dd3db34 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:52.852641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1061/2114] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:51:52 2022] POST /identity/v3/projects => generated 365 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:52.856764 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a249f3-53ea-4166-81e2-e072bfd9487a None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:52.868893 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a249f3-53ea-4166-81e2-e072bfd9487a None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:52.928803 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323ec12-fbdb-4d6f-a833-21dd065bda69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:52.929499 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323ec12-fbdb-4d6f-a833-21dd065bda69 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:52.929787 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323ec12-fbdb-4d6f-a833-21dd065bda69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:52.930069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323ec12-fbdb-4d6f-a833-21dd065bda69 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:52.930779 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9323ec12-fbdb-4d6f-a833-21dd065bda69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:52.932748 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9323ec12-fbdb-4d6f-a833-21dd065bda69 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:53.034388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1054/2115] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:51:52 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:51:53.038154 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c465d7-1a5c-4af2-80b3-7a156dd3db34 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:53.048322 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c465d7-1a5c-4af2-80b3-7a156dd3db34 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:53.053362 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f4805-c8f6-4c3d-b2bb-09ea8ceb5528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:53.054021 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f4805-c8f6-4c3d-b2bb-09ea8ceb5528 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:53.054305 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f4805-c8f6-4c3d-b2bb-09ea8ceb5528 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:53.054578 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f4805-c8f6-4c3d-b2bb-09ea8ceb5528 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:53.055304 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f4805-c8f6-4c3d-b2bb-09ea8ceb5528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:53.056953 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f4805-c8f6-4c3d-b2bb-09ea8ceb5528 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:53.058428 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:51:53.069192 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1062/2116] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:51:53.073714 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323ec12-fbdb-4d6f-a833-21dd065bda69 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:53.084716 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323ec12-fbdb-4d6f-a833-21dd065bda69 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:53.089343 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecdedd5-7e95-4b2b-9ad1-6c0c424142f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:53.090218 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecdedd5-7e95-4b2b-9ad1-6c0c424142f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:53.090506 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecdedd5-7e95-4b2b-9ad1-6c0c424142f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:53.090785 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecdedd5-7e95-4b2b-9ad1-6c0c424142f5 admin admin] PATH_INFO: `/v3/projects/40ff9d613013445cab7d2be0faf812cf/users/a6bfe875b6d5406facd3aff65b5d13e1/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:53.106534 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecdedd5-7e95-4b2b-9ad1-6c0c424142f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40ff9d613013445cab7d2be0faf812cf, user_id=a6bfe875b6d5406facd3aff65b5d13e1, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:53.109344 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecdedd5-7e95-4b2b-9ad1-6c0c424142f5 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:53.240383 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1055/2117] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:51:53 2022] PUT /identity/v3/projects/40ff9d613013445cab7d2be0faf812cf/users/a6bfe875b6d5406facd3aff65b5d13e1/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:53.244726 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f4805-c8f6-4c3d-b2bb-09ea8ceb5528 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:53.256024 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f4805-c8f6-4c3d-b2bb-09ea8ceb5528 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:53.312791 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075315bf-4074-426d-bbb7-06b28d6cd0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:53.313402 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075315bf-4074-426d-bbb7-06b28d6cd0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:53.313941 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075315bf-4074-426d-bbb7-06b28d6cd0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:53.314078 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075315bf-4074-426d-bbb7-06b28d6cd0a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:53.314716 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075315bf-4074-426d-bbb7-06b28d6cd0a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:53.317070 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075315bf-4074-426d-bbb7-06b28d6cd0a5 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:53.326892 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1063/2118] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:51:53.331256 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecdedd5-7e95-4b2b-9ad1-6c0c424142f5 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:53.341593 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecdedd5-7e95-4b2b-9ad1-6c0c424142f5 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:53.346381 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892b4c1-b4b6-4506-80bf-7895475aa15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:53.347282 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892b4c1-b4b6-4506-80bf-7895475aa15b admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:53.347562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892b4c1-b4b6-4506-80bf-7895475aa15b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:53.347865 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892b4c1-b4b6-4506-80bf-7895475aa15b admin admin] PATH_INFO: `/v3/projects/40ff9d613013445cab7d2be0faf812cf/users/a6bfe875b6d5406facd3aff65b5d13e1/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:53.349853 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892b4c1-b4b6-4506-80bf-7895475aa15b admin admin] RBAC: Authorizing `identity:create_grant(project_id=40ff9d613013445cab7d2be0faf812cf, user_id=a6bfe875b6d5406facd3aff65b5d13e1, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:53.352512 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892b4c1-b4b6-4506-80bf-7895475aa15b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:53.363401 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1056/2119] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:51:53 2022] PUT /identity/v3/projects/40ff9d613013445cab7d2be0faf812cf/users/a6bfe875b6d5406facd3aff65b5d13e1/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:51:53.373922 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387daebc-0222-499c-8732-637b5962a074 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:53.374209 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387daebc-0222-499c-8732-637b5962a074 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:53.374488 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387daebc-0222-499c-8732-637b5962a074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:53.403641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-387daebc-0222-499c-8732-637b5962a074 None None] MFA Rules not processed for user `a6bfe875b6d5406facd3aff65b5d13e1`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:51:53.405033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-387daebc-0222-499c-8732-637b5962a074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:53.482885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1064/2120] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:51:53 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:51:53.491870 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892b4c1-b4b6-4506-80bf-7895475aa15b admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:53.493606 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6892b4c1-b4b6-4506-80bf-7895475aa15b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:51:53.554520 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892b4c1-b4b6-4506-80bf-7895475aa15b admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:53.558326 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb807a-58e5-4fa1-b3cd-6a50435db143 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:53.558971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb807a-58e5-4fa1-b3cd-6a50435db143 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:53.559253 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb807a-58e5-4fa1-b3cd-6a50435db143 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:53.559531 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb807a-58e5-4fa1-b3cd-6a50435db143 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:53.570388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb807a-58e5-4fa1-b3cd-6a50435db143 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:53.571782 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb807a-58e5-4fa1-b3cd-6a50435db143 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:53.583219 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1057/2121] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:53 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:51:53.927262 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387daebc-0222-499c-8732-637b5962a074 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:51:53.937054 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387daebc-0222-499c-8732-637b5962a074 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:51:53.941384 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693f31f-d5d8-46f6-ae31-3a57183b0f28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:51:53.942175 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693f31f-d5d8-46f6-ae31-3a57183b0f28 service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:51:53.942455 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693f31f-d5d8-46f6-ae31-3a57183b0f28 service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:51:53.942731 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693f31f-d5d8-46f6-ae31-3a57183b0f28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:51:54.001719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693f31f-d5d8-46f6-ae31-3a57183b0f28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:51:54.003947 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693f31f-d5d8-46f6-ae31-3a57183b0f28 service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:51:54.013450 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1065/2122] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:51:53 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:52:03.577048 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=75,keystone:INSERT=5 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:04.009073 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=93 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:20.348816 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb807a-58e5-4fa1-b3cd-6a50435db143 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:20.422602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb807a-58e5-4fa1-b3cd-6a50435db143 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:20.427673 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97811ca1-3fcd-43bf-8a86-1297852fedbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:20.428567 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97811ca1-3fcd-43bf-8a86-1297852fedbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:20.428852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97811ca1-3fcd-43bf-8a86-1297852fedbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:20.429171 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97811ca1-3fcd-43bf-8a86-1297852fedbd admin admin] PATH_INFO: `/v3/users/82acc5964ffb4679a79b96c523ba5b80` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:20.430502 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97811ca1-3fcd-43bf-8a86-1297852fedbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=82acc5964ffb4679a79b96c523ba5b80)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:20.433400 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97811ca1-3fcd-43bf-8a86-1297852fedbd admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:20.643606 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-97811ca1-3fcd-43bf-8a86-1297852fedbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82acc5964ffb4679a79b96c523ba5b80'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:20.644319 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-97811ca1-3fcd-43bf-8a86-1297852fedbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82acc5964ffb4679a79b96c523ba5b80'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:20.657031 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-97811ca1-3fcd-43bf-8a86-1297852fedbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82acc5964ffb4679a79b96c523ba5b80'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:20.657031 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-97811ca1-3fcd-43bf-8a86-1297852fedbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82acc5964ffb4679a79b96c523ba5b80'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:20.798434 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-97811ca1-3fcd-43bf-8a86-1297852fedbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82acc5964ffb4679a79b96c523ba5b80'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:20.819734 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1058/2123] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:52:20 2022] DELETE /identity/v3/users/82acc5964ffb4679a79b96c523ba5b80 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:20.825193 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905d394-32ea-4b81-b18e-26cd991887fc None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:20.825788 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905d394-32ea-4b81-b18e-26cd991887fc None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:20.825788 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905d394-32ea-4b81-b18e-26cd991887fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:20.845693 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-9905d394-32ea-4b81-b18e-26cd991887fc None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:20.849587 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-9905d394-32ea-4b81-b18e-26cd991887fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:20.921217 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1066/2124] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:20.932460 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97811ca1-3fcd-43bf-8a86-1297852fedbd admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:20.934041 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-97811ca1-3fcd-43bf-8a86-1297852fedbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:20.996966 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97811ca1-3fcd-43bf-8a86-1297852fedbd admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:21.001207 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc35f3-ed69-4aed-91d8-51d4d2e228bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:21.001891 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc35f3-ed69-4aed-91d8-51d4d2e228bf service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:21.002214 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc35f3-ed69-4aed-91d8-51d4d2e228bf service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:21.002499 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc35f3-ed69-4aed-91d8-51d4d2e228bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:21.013079 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc35f3-ed69-4aed-91d8-51d4d2e228bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:21.014600 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc35f3-ed69-4aed-91d8-51d4d2e228bf service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:21.025557 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1059/2125] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:52:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:52:21.579271 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905d394-32ea-4b81-b18e-26cd991887fc None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:21.581074 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-9905d394-32ea-4b81-b18e-26cd991887fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:21.594769 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905d394-32ea-4b81-b18e-26cd991887fc None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:21.601240 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab33ff-8af6-4550-b4bb-88603e65de6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:21.602212 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab33ff-8af6-4550-b4bb-88603e65de6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:21.602938 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab33ff-8af6-4550-b4bb-88603e65de6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:21.602938 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab33ff-8af6-4550-b4bb-88603e65de6f admin admin] PATH_INFO: `/v3/projects/e6bc5507323847d4920c420b0d67a1c0` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:21.604993 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab33ff-8af6-4550-b4bb-88603e65de6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6bc5507323847d4920c420b0d67a1c0)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:21.607023 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab33ff-8af6-4550-b4bb-88603e65de6f admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:21.770282 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-b5ab33ff-8af6-4550-b4bb-88603e65de6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6bc5507323847d4920c420b0d67a1c0', 'request_id': 'req-b5ab33ff-8af6-4550-b4bb-88603e65de6f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:21.777107 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-b5ab33ff-8af6-4550-b4bb-88603e65de6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6bc5507323847d4920c420b0d67a1c0', 'request_id': 'req-b5ab33ff-8af6-4550-b4bb-88603e65de6f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:21.784047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-b5ab33ff-8af6-4550-b4bb-88603e65de6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6bc5507323847d4920c420b0d67a1c0', 'request_id': 'req-b5ab33ff-8af6-4550-b4bb-88603e65de6f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:21.866850 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-b5ab33ff-8af6-4550-b4bb-88603e65de6f admin admin] The token cache is being invalidate because project e6bc5507323847d4920c420b0d67a1c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:52:21.867495 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-b5ab33ff-8af6-4550-b4bb-88603e65de6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:21.867924 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-b5ab33ff-8af6-4550-b4bb-88603e65de6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:21.870310 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1067/2126] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:52:21 2022] DELETE /identity/v3/projects/e6bc5507323847d4920c420b0d67a1c0 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:21.874437 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc35f3-ed69-4aed-91d8-51d4d2e228bf service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:21.886017 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc35f3-ed69-4aed-91d8-51d4d2e228bf service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:21.906942 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:21.952436 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52130b09-211b-4d43-be3b-0fe2c85ddef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:21.953245 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52130b09-211b-4d43-be3b-0fe2c85ddef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:21.953528 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52130b09-211b-4d43-be3b-0fe2c85ddef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:21.953986 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52130b09-211b-4d43-be3b-0fe2c85ddef1 admin admin] PATH_INFO: `/v3/users/a6bfe875b6d5406facd3aff65b5d13e1` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:21.955536 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52130b09-211b-4d43-be3b-0fe2c85ddef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6bfe875b6d5406facd3aff65b5d13e1)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:21.957624 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52130b09-211b-4d43-be3b-0fe2c85ddef1 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:22.146381 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-52130b09-211b-4d43-be3b-0fe2c85ddef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6bfe875b6d5406facd3aff65b5d13e1'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:22.147214 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-52130b09-211b-4d43-be3b-0fe2c85ddef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6bfe875b6d5406facd3aff65b5d13e1'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:22.158091 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-52130b09-211b-4d43-be3b-0fe2c85ddef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6bfe875b6d5406facd3aff65b5d13e1'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:22.158894 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-52130b09-211b-4d43-be3b-0fe2c85ddef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6bfe875b6d5406facd3aff65b5d13e1'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:22.250299 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-52130b09-211b-4d43-be3b-0fe2c85ddef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6bfe875b6d5406facd3aff65b5d13e1'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:22.283997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1060/2127] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:52:21 2022] DELETE /identity/v3/users/a6bfe875b6d5406facd3aff65b5d13e1 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:22.859569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab33ff-8af6-4550-b4bb-88603e65de6f admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:22.862211 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-b5ab33ff-8af6-4550-b4bb-88603e65de6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:22.893493 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab33ff-8af6-4550-b4bb-88603e65de6f admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:22.955262 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4778a-d742-41ac-9876-f64f9755b752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:22.956174 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4778a-d742-41ac-9876-f64f9755b752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:22.956503 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4778a-d742-41ac-9876-f64f9755b752 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:22.956721 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4778a-d742-41ac-9876-f64f9755b752 admin admin] PATH_INFO: `/v3/projects/40ff9d613013445cab7d2be0faf812cf` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:22.958029 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4778a-d742-41ac-9876-f64f9755b752 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40ff9d613013445cab7d2be0faf812cf)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:22.960123 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4778a-d742-41ac-9876-f64f9755b752 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:23.075343 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:23.097799 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-b1f4778a-d742-41ac-9876-f64f9755b752 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40ff9d613013445cab7d2be0faf812cf', 'request_id': 'req-b1f4778a-d742-41ac-9876-f64f9755b752'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:23.105060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-b1f4778a-d742-41ac-9876-f64f9755b752 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40ff9d613013445cab7d2be0faf812cf', 'request_id': 'req-b1f4778a-d742-41ac-9876-f64f9755b752'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:23.111784 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-b1f4778a-d742-41ac-9876-f64f9755b752 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40ff9d613013445cab7d2be0faf812cf', 'request_id': 'req-b1f4778a-d742-41ac-9876-f64f9755b752'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:23.193441 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-b1f4778a-d742-41ac-9876-f64f9755b752 admin admin] The token cache is being invalidate because project 40ff9d613013445cab7d2be0faf812cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:52:23.194058 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-b1f4778a-d742-41ac-9876-f64f9755b752 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:23.194876 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-b1f4778a-d742-41ac-9876-f64f9755b752 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:23.197038 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1068/2128] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:52:22 2022] DELETE /identity/v3/projects/40ff9d613013445cab7d2be0faf812cf => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:23.207013 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1c61e-8570-469f-9216-a11e1787828f None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:23.207521 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1c61e-8570-469f-9216-a11e1787828f None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:23.207726 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1c61e-8570-469f-9216-a11e1787828f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:23.235210 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-2df1c61e-8570-469f-9216-a11e1787828f None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:23.236745 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-2df1c61e-8570-469f-9216-a11e1787828f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:23.319238 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1061/2129] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:52:23.327990 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83f6c3-42ac-41a9-a07b-4097bd9d5b9c None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:23.328545 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83f6c3-42ac-41a9-a07b-4097bd9d5b9c None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:23.329060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83f6c3-42ac-41a9-a07b-4097bd9d5b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:23.370014 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-fb83f6c3-42ac-41a9-a07b-4097bd9d5b9c None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:23.371697 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-fb83f6c3-42ac-41a9-a07b-4097bd9d5b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:23.386950 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1069/2130] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:23.391141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1c61e-8570-469f-9216-a11e1787828f None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:23.409305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1c61e-8570-469f-9216-a11e1787828f None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:23.416889 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce2e5e-4aff-4c7a-aa03-d93c5956a4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:23.421476 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce2e5e-4aff-4c7a-aa03-d93c5956a4fb admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:23.421476 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce2e5e-4aff-4c7a-aa03-d93c5956a4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:23.421476 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce2e5e-4aff-4c7a-aa03-d93c5956a4fb admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:23.421476 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce2e5e-4aff-4c7a-aa03-d93c5956a4fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:52:23.421476 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce2e5e-4aff-4c7a-aa03-d93c5956a4fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:23.421972 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce2e5e-4aff-4c7a-aa03-d93c5956a4fb admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:23.436755 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1062/2131] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:52:23.449077 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83f6c3-42ac-41a9-a07b-4097bd9d5b9c None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:23.460638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83f6c3-42ac-41a9-a07b-4097bd9d5b9c None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:23.466365 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a2fc9-512d-4ed5-a58c-947345197c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:23.467416 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a2fc9-512d-4ed5-a58c-947345197c1d admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:23.467416 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a2fc9-512d-4ed5-a58c-947345197c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:23.467699 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a2fc9-512d-4ed5-a58c-947345197c1d admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:23.468418 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a2fc9-512d-4ed5-a58c-947345197c1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:23.470357 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a2fc9-512d-4ed5-a58c-947345197c1d admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:23.551963 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1070/2132] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:52:23 2022] POST /identity/v3/projects => generated 363 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:52:23.557796 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce2e5e-4aff-4c7a-aa03-d93c5956a4fb admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:23.570407 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce2e5e-4aff-4c7a-aa03-d93c5956a4fb admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:23.610131 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:23.667791 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89e769-974d-4b8d-bbc4-328456cc2a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:23.669097 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89e769-974d-4b8d-bbc4-328456cc2a2b admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:23.671370 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89e769-974d-4b8d-bbc4-328456cc2a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:23.671925 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89e769-974d-4b8d-bbc4-328456cc2a2b admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:23.673203 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89e769-974d-4b8d-bbc4-328456cc2a2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:23.677014 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89e769-974d-4b8d-bbc4-328456cc2a2b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:23.789246 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1063/2133] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:52:23 2022] POST /identity/v3/users => generated 282 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:52:23.796253 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a2fc9-512d-4ed5-a58c-947345197c1d admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:23.809718 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a2fc9-512d-4ed5-a58c-947345197c1d admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:23.816586 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c8752-0fd1-4240-a600-848071f4e7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:23.817555 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c8752-0fd1-4240-a600-848071f4e7e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:23.818059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c8752-0fd1-4240-a600-848071f4e7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:23.818569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c8752-0fd1-4240-a600-848071f4e7e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:23.819947 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c8752-0fd1-4240-a600-848071f4e7e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:23.823416 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c8752-0fd1-4240-a600-848071f4e7e5 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:23.839719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1071/2134] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:23.844062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89e769-974d-4b8d-bbc4-328456cc2a2b admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:23.855900 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89e769-974d-4b8d-bbc4-328456cc2a2b admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:23.861665 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e57ab-d429-4cd8-bf79-1eedda87fdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:23.862484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e57ab-d429-4cd8-bf79-1eedda87fdbd admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:23.862815 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e57ab-d429-4cd8-bf79-1eedda87fdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:23.863147 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e57ab-d429-4cd8-bf79-1eedda87fdbd admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:23.864087 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e57ab-d429-4cd8-bf79-1eedda87fdbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:23.866083 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e57ab-d429-4cd8-bf79-1eedda87fdbd admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:23.888970 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1064/2135] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:23.894026 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c8752-0fd1-4240-a600-848071f4e7e5 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:23.912670 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c8752-0fd1-4240-a600-848071f4e7e5 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:23.920489 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699fa18-3ae1-4d34-94b2-e7f461f78f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:23.921519 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699fa18-3ae1-4d34-94b2-e7f461f78f5f admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:23.921883 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699fa18-3ae1-4d34-94b2-e7f461f78f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:23.922234 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699fa18-3ae1-4d34-94b2-e7f461f78f5f admin admin] PATH_INFO: `/v3/projects/568f8c3b69bc402cbc31070da7054840/users/9cf78ad2cb124595814b4d0eda60fb32/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:23.949282 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699fa18-3ae1-4d34-94b2-e7f461f78f5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=568f8c3b69bc402cbc31070da7054840, user_id=9cf78ad2cb124595814b4d0eda60fb32, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:23.954835 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699fa18-3ae1-4d34-94b2-e7f461f78f5f admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:24.050705 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1072/2136] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:52:23 2022] PUT /identity/v3/projects/568f8c3b69bc402cbc31070da7054840/users/9cf78ad2cb124595814b4d0eda60fb32/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:24.060717 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae736fc-1745-41d2-a04f-bce3a2c1ec7d None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:24.061589 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae736fc-1745-41d2-a04f-bce3a2c1ec7d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:24.062173 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae736fc-1745-41d2-a04f-bce3a2c1ec7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:24.101310 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-8ae736fc-1745-41d2-a04f-bce3a2c1ec7d None None] MFA Rules not processed for user `9cf78ad2cb124595814b4d0eda60fb32`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:24.102773 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-8ae736fc-1745-41d2-a04f-bce3a2c1ec7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:24.232619 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1065/2137] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:52:24 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:24.239826 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699fa18-3ae1-4d34-94b2-e7f461f78f5f admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:24.241805 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-d699fa18-3ae1-4d34-94b2-e7f461f78f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:24.322281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699fa18-3ae1-4d34-94b2-e7f461f78f5f admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:24.327020 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c27462-9657-4cbb-aaf1-b7ee0cb8557e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:24.327868 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c27462-9657-4cbb-aaf1-b7ee0cb8557e service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:24.328160 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c27462-9657-4cbb-aaf1-b7ee0cb8557e service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:24.328528 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c27462-9657-4cbb-aaf1-b7ee0cb8557e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:24.342218 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c27462-9657-4cbb-aaf1-b7ee0cb8557e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:24.343900 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c27462-9657-4cbb-aaf1-b7ee0cb8557e service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:24.362638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1073/2138] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:52:24 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:52:24.932423 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae736fc-1745-41d2-a04f-bce3a2c1ec7d None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:24.934864 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-8ae736fc-1745-41d2-a04f-bce3a2c1ec7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:25.020374 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae736fc-1745-41d2-a04f-bce3a2c1ec7d None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:25.027785 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043db1c-d45f-45de-8cfe-899c4328a8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:25.030343 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043db1c-d45f-45de-8cfe-899c4328a8fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:25.030343 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043db1c-d45f-45de-8cfe-899c4328a8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:25.030530 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043db1c-d45f-45de-8cfe-899c4328a8fe admin admin] PATH_INFO: `/v3/users/3c510b9d94bc48e6a0bd5cd1fa9d1706` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:25.032845 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043db1c-d45f-45de-8cfe-899c4328a8fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c510b9d94bc48e6a0bd5cd1fa9d1706)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:25.035639 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043db1c-d45f-45de-8cfe-899c4328a8fe admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:25.238656 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:25.246878 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-e043db1c-d45f-45de-8cfe-899c4328a8fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c510b9d94bc48e6a0bd5cd1fa9d1706'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:25.247590 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-e043db1c-d45f-45de-8cfe-899c4328a8fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c510b9d94bc48e6a0bd5cd1fa9d1706'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:25.256944 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-e043db1c-d45f-45de-8cfe-899c4328a8fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c510b9d94bc48e6a0bd5cd1fa9d1706'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:25.261076 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-e043db1c-d45f-45de-8cfe-899c4328a8fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c510b9d94bc48e6a0bd5cd1fa9d1706'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:25.336076 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-e043db1c-d45f-45de-8cfe-899c4328a8fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c510b9d94bc48e6a0bd5cd1fa9d1706'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:25.362630 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1066/2139] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:52:24 2022] DELETE /identity/v3/users/3c510b9d94bc48e6a0bd5cd1fa9d1706 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:25.681371 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c27462-9657-4cbb-aaf1-b7ee0cb8557e service cinder] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:25.695234 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c27462-9657-4cbb-aaf1-b7ee0cb8557e service cinder] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:25.772406 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:25.784550 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84baf93-37d6-4e00-bd10-10748e241b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:25.785586 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84baf93-37d6-4e00-bd10-10748e241b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:25.785913 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84baf93-37d6-4e00-bd10-10748e241b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:25.790144 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84baf93-37d6-4e00-bd10-10748e241b4b admin admin] PATH_INFO: `/v3/projects/bab881ea3c0340f38ab21df3fb187545` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:25.790144 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84baf93-37d6-4e00-bd10-10748e241b4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bab881ea3c0340f38ab21df3fb187545)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:25.790144 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84baf93-37d6-4e00-bd10-10748e241b4b admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:25.931200 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-c84baf93-37d6-4e00-bd10-10748e241b4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bab881ea3c0340f38ab21df3fb187545', 'request_id': 'req-c84baf93-37d6-4e00-bd10-10748e241b4b'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:25.938163 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-c84baf93-37d6-4e00-bd10-10748e241b4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bab881ea3c0340f38ab21df3fb187545', 'request_id': 'req-c84baf93-37d6-4e00-bd10-10748e241b4b'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:25.944354 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-c84baf93-37d6-4e00-bd10-10748e241b4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bab881ea3c0340f38ab21df3fb187545', 'request_id': 'req-c84baf93-37d6-4e00-bd10-10748e241b4b'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:26.045220 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-c84baf93-37d6-4e00-bd10-10748e241b4b admin admin] The token cache is being invalidate because project bab881ea3c0340f38ab21df3fb187545 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:52:26.045519 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-c84baf93-37d6-4e00-bd10-10748e241b4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:26.046304 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-c84baf93-37d6-4e00-bd10-10748e241b4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:26.048559 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1074/2140] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:52:25 2022] DELETE /identity/v3/projects/bab881ea3c0340f38ab21df3fb187545 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:26.054400 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f015a2-88cd-451b-acdc-da14903d89ef None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:26.054770 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f015a2-88cd-451b-acdc-da14903d89ef None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:26.055143 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f015a2-88cd-451b-acdc-da14903d89ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:26.079156 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-67f015a2-88cd-451b-acdc-da14903d89ef None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:26.080517 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-67f015a2-88cd-451b-acdc-da14903d89ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:26.147562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1067/2141] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:26.156851 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033a34c-199f-480f-83c6-a549680c190b None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:26.157145 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033a34c-199f-480f-83c6-a549680c190b None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:26.157422 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033a34c-199f-480f-83c6-a549680c190b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:26.178812 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-d033a34c-199f-480f-83c6-a549680c190b None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:26.180063 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-d033a34c-199f-480f-83c6-a549680c190b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:26.191480 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1075/2142] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:26.196118 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f015a2-88cd-451b-acdc-da14903d89ef None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:26.209866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f015a2-88cd-451b-acdc-da14903d89ef None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:26.216473 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832217ca-e8c1-4671-a8d9-d5bbd5f59b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:26.217290 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832217ca-e8c1-4671-a8d9-d5bbd5f59b6f admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:26.217680 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832217ca-e8c1-4671-a8d9-d5bbd5f59b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:26.218041 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832217ca-e8c1-4671-a8d9-d5bbd5f59b6f admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:26.218851 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832217ca-e8c1-4671-a8d9-d5bbd5f59b6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:52:26.219208 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832217ca-e8c1-4671-a8d9-d5bbd5f59b6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:26.221178 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832217ca-e8c1-4671-a8d9-d5bbd5f59b6f admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:26.237137 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1068/2143] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:52:26.243562 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033a34c-199f-480f-83c6-a549680c190b None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:26.254699 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033a34c-199f-480f-83c6-a549680c190b None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:26.260507 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df9c3a-2f93-4497-92ce-4142ab45b42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:26.261468 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df9c3a-2f93-4497-92ce-4142ab45b42a admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:26.261468 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df9c3a-2f93-4497-92ce-4142ab45b42a admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:26.261468 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df9c3a-2f93-4497-92ce-4142ab45b42a admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:26.261468 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df9c3a-2f93-4497-92ce-4142ab45b42a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:26.264988 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df9c3a-2f93-4497-92ce-4142ab45b42a admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:26.345621 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1076/2144] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:52:26 2022] POST /identity/v3/projects => generated 405 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:52:26.349909 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832217ca-e8c1-4671-a8d9-d5bbd5f59b6f admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:26.362468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832217ca-e8c1-4671-a8d9-d5bbd5f59b6f admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:26.425813 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7538eb-1d2d-4b49-80ae-5fc0ee1400e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:26.426497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7538eb-1d2d-4b49-80ae-5fc0ee1400e2 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:26.426787 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7538eb-1d2d-4b49-80ae-5fc0ee1400e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:26.427066 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7538eb-1d2d-4b49-80ae-5fc0ee1400e2 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:26.427801 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7538eb-1d2d-4b49-80ae-5fc0ee1400e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:26.429767 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7538eb-1d2d-4b49-80ae-5fc0ee1400e2 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:26.524516 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1069/2145] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:52:26 2022] POST /identity/v3/users => generated 303 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:52:26.529333 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df9c3a-2f93-4497-92ce-4142ab45b42a admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:26.543442 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df9c3a-2f93-4497-92ce-4142ab45b42a admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:26.548768 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd02e1-d406-49b1-bb85-a73286d96a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:26.549577 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd02e1-d406-49b1-bb85-a73286d96a37 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:26.549907 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd02e1-d406-49b1-bb85-a73286d96a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:26.550248 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd02e1-d406-49b1-bb85-a73286d96a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:26.551109 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd02e1-d406-49b1-bb85-a73286d96a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:26.553092 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd02e1-d406-49b1-bb85-a73286d96a37 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:26.566198 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1077/2146] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:26.570231 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7538eb-1d2d-4b49-80ae-5fc0ee1400e2 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:26.581266 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7538eb-1d2d-4b49-80ae-5fc0ee1400e2 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:26.588316 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e8bb1-25c2-40c3-bfb0-85d503a16ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:26.589005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e8bb1-25c2-40c3-bfb0-85d503a16ddd admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:26.589349 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e8bb1-25c2-40c3-bfb0-85d503a16ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:26.589646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e8bb1-25c2-40c3-bfb0-85d503a16ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:26.590625 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e8bb1-25c2-40c3-bfb0-85d503a16ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:26.593059 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e8bb1-25c2-40c3-bfb0-85d503a16ddd admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:26.605946 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1070/2147] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:26.610630 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd02e1-d406-49b1-bb85-a73286d96a37 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:26.623304 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd02e1-d406-49b1-bb85-a73286d96a37 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:26.628457 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ee29a-44e9-4892-b1eb-c3991b5a1f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:26.629516 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ee29a-44e9-4892-b1eb-c3991b5a1f80 admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:26.629854 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ee29a-44e9-4892-b1eb-c3991b5a1f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:26.630128 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ee29a-44e9-4892-b1eb-c3991b5a1f80 admin admin] PATH_INFO: `/v3/projects/c0fa4e495e8343a882c64ee895a28280/users/6747cd48737d438ab57948e12fdb1f39/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:26.652647 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ee29a-44e9-4892-b1eb-c3991b5a1f80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0fa4e495e8343a882c64ee895a28280, user_id=6747cd48737d438ab57948e12fdb1f39, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:26.656431 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ee29a-44e9-4892-b1eb-c3991b5a1f80 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:26.741949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1078/2148] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:52:26 2022] PUT /identity/v3/projects/c0fa4e495e8343a882c64ee895a28280/users/6747cd48737d438ab57948e12fdb1f39/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:26.757834 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62824ae-cdf0-4ea5-85a4-ae0fc70b3e26 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:26.758211 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62824ae-cdf0-4ea5-85a4-ae0fc70b3e26 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:26.760898 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62824ae-cdf0-4ea5-85a4-ae0fc70b3e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:26.790085 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-f62824ae-cdf0-4ea5-85a4-ae0fc70b3e26 None None] MFA Rules not processed for user `6747cd48737d438ab57948e12fdb1f39`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:26.791849 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f62824ae-cdf0-4ea5-85a4-ae0fc70b3e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:26.801392 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:26.864286 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1071/2149] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:52:26 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:26.869345 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ee29a-44e9-4892-b1eb-c3991b5a1f80 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:26.945588 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ee29a-44e9-4892-b1eb-c3991b5a1f80 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:26.951186 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3bd45-73c0-4f09-a17e-f387e395e45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:26.952047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3bd45-73c0-4f09-a17e-f387e395e45b admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:26.952335 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3bd45-73c0-4f09-a17e-f387e395e45b admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:26.952683 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3bd45-73c0-4f09-a17e-f387e395e45b admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:26.953498 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3bd45-73c0-4f09-a17e-f387e395e45b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:26.955813 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3bd45-73c0-4f09-a17e-f387e395e45b admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:27.111899 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1079/2150] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:52:26 2022] POST /identity/v3/projects => generated 405 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:52:27.118203 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62824ae-cdf0-4ea5-85a4-ae0fc70b3e26 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:27.131920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62824ae-cdf0-4ea5-85a4-ae0fc70b3e26 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:27.200905 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb50b1b-859b-49b7-bab3-c8b26885c70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:27.201775 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb50b1b-859b-49b7-bab3-c8b26885c70b admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:27.202124 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb50b1b-859b-49b7-bab3-c8b26885c70b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:27.202422 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb50b1b-859b-49b7-bab3-c8b26885c70b admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:27.203360 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb50b1b-859b-49b7-bab3-c8b26885c70b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:27.205741 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb50b1b-859b-49b7-bab3-c8b26885c70b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:27.314611 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1072/2151] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:52:27 2022] POST /identity/v3/users => generated 309 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:52:27.319438 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3bd45-73c0-4f09-a17e-f387e395e45b admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:27.326399 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:27.330357 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3bd45-73c0-4f09-a17e-f387e395e45b admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:27.335198 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436fa5f-5c24-493c-992b-92a101a3e805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:27.335882 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436fa5f-5c24-493c-992b-92a101a3e805 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:27.336254 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436fa5f-5c24-493c-992b-92a101a3e805 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:27.336587 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436fa5f-5c24-493c-992b-92a101a3e805 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:27.337425 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0436fa5f-5c24-493c-992b-92a101a3e805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:27.339935 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0436fa5f-5c24-493c-992b-92a101a3e805 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:27.352415 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1080/2152] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:27.358056 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb50b1b-859b-49b7-bab3-c8b26885c70b admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:27.368979 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb50b1b-859b-49b7-bab3-c8b26885c70b admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:27.375482 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c992bc-9736-4e5e-a8fe-038c45822157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:27.376422 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c992bc-9736-4e5e-a8fe-038c45822157 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:27.376698 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c992bc-9736-4e5e-a8fe-038c45822157 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:27.380937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c992bc-9736-4e5e-a8fe-038c45822157 admin admin] PATH_INFO: `/v3/projects/05d90389865747a7a125e08fcfbc3b73/users/c444577f8f1a4c15b85c9964d57dc6b9/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:27.396104 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c992bc-9736-4e5e-a8fe-038c45822157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05d90389865747a7a125e08fcfbc3b73, user_id=c444577f8f1a4c15b85c9964d57dc6b9, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:27.399232 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c992bc-9736-4e5e-a8fe-038c45822157 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:27.462917 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1073/2153] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:52:27 2022] PUT /identity/v3/projects/05d90389865747a7a125e08fcfbc3b73/users/c444577f8f1a4c15b85c9964d57dc6b9/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:27.467381 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436fa5f-5c24-493c-992b-92a101a3e805 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:27.482982 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436fa5f-5c24-493c-992b-92a101a3e805 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:27.558953 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102f582-6a24-4b3e-bc9e-e117720282b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:27.559802 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102f582-6a24-4b3e-bc9e-e117720282b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:27.560158 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102f582-6a24-4b3e-bc9e-e117720282b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:27.560498 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102f582-6a24-4b3e-bc9e-e117720282b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:27.561444 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102f582-6a24-4b3e-bc9e-e117720282b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:27.563459 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102f582-6a24-4b3e-bc9e-e117720282b2 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:27.576901 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1081/2154] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:27.582771 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c992bc-9736-4e5e-a8fe-038c45822157 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:27.596596 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c992bc-9736-4e5e-a8fe-038c45822157 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:27.602203 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916967c-80b8-4d58-9789-1f849a6e9bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:27.603283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916967c-80b8-4d58-9789-1f849a6e9bb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:27.604620 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916967c-80b8-4d58-9789-1f849a6e9bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:27.605012 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916967c-80b8-4d58-9789-1f849a6e9bb1 admin admin] PATH_INFO: `/v3/projects/05d90389865747a7a125e08fcfbc3b73/users/c444577f8f1a4c15b85c9964d57dc6b9/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:27.607445 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5916967c-80b8-4d58-9789-1f849a6e9bb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05d90389865747a7a125e08fcfbc3b73, user_id=c444577f8f1a4c15b85c9964d57dc6b9, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:27.610767 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5916967c-80b8-4d58-9789-1f849a6e9bb1 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:27.626475 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1074/2155] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:52:27 2022] PUT /identity/v3/projects/05d90389865747a7a125e08fcfbc3b73/users/c444577f8f1a4c15b85c9964d57dc6b9/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:27.646821 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488ecdc-41b7-4960-8099-9447b70513a5 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:27.647137 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488ecdc-41b7-4960-8099-9447b70513a5 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:27.647378 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488ecdc-41b7-4960-8099-9447b70513a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:27.678792 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-d488ecdc-41b7-4960-8099-9447b70513a5 None None] MFA Rules not processed for user `c444577f8f1a4c15b85c9964d57dc6b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:27.680171 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-d488ecdc-41b7-4960-8099-9447b70513a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:27.781907 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1082/2156] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:52:27 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:27.792873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916967c-80b8-4d58-9789-1f849a6e9bb1 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:27.794663 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-5916967c-80b8-4d58-9789-1f849a6e9bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:27.861458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916967c-80b8-4d58-9789-1f849a6e9bb1 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:27.865827 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6035b1f-2539-49cd-a708-19a33fb3d640 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:27.866590 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6035b1f-2539-49cd-a708-19a33fb3d640 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:27.866929 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6035b1f-2539-49cd-a708-19a33fb3d640 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:27.867228 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6035b1f-2539-49cd-a708-19a33fb3d640 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:27.879180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6035b1f-2539-49cd-a708-19a33fb3d640 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:27.880714 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6035b1f-2539-49cd-a708-19a33fb3d640 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:27.903120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1075/2157] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:52:27 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:52:29.720458 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488ecdc-41b7-4960-8099-9447b70513a5 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:29.787829 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488ecdc-41b7-4960-8099-9447b70513a5 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:29.792787 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf9177-aca7-4cf4-9e35-dbc8686c3ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:29.793661 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf9177-aca7-4cf4-9e35-dbc8686c3ee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:29.794047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf9177-aca7-4cf4-9e35-dbc8686c3ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:29.794321 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf9177-aca7-4cf4-9e35-dbc8686c3ee5 admin admin] PATH_INFO: `/v3/users/6747cd48737d438ab57948e12fdb1f39` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:29.795530 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf9177-aca7-4cf4-9e35-dbc8686c3ee5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6747cd48737d438ab57948e12fdb1f39)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:29.797550 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf9177-aca7-4cf4-9e35-dbc8686c3ee5 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:29.816091 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:30.065224 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-b3bf9177-aca7-4cf4-9e35-dbc8686c3ee5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6747cd48737d438ab57948e12fdb1f39'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:30.065878 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-b3bf9177-aca7-4cf4-9e35-dbc8686c3ee5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6747cd48737d438ab57948e12fdb1f39'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:30.066469 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-b3bf9177-aca7-4cf4-9e35-dbc8686c3ee5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6747cd48737d438ab57948e12fdb1f39'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:30.073774 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-b3bf9177-aca7-4cf4-9e35-dbc8686c3ee5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6747cd48737d438ab57948e12fdb1f39'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:30.158530 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-b3bf9177-aca7-4cf4-9e35-dbc8686c3ee5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6747cd48737d438ab57948e12fdb1f39'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:30.180207 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1083/2158] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:52:29 2022] DELETE /identity/v3/users/6747cd48737d438ab57948e12fdb1f39 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:30.186644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6f45a-01c5-45e2-bad6-0a3f405f800a None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:30.187159 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6f45a-01c5-45e2-bad6-0a3f405f800a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:30.187546 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6f45a-01c5-45e2-bad6-0a3f405f800a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:30.205990 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:30.212494 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-66d6f45a-01c5-45e2-bad6-0a3f405f800a None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:30.214595 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-66d6f45a-01c5-45e2-bad6-0a3f405f800a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:30.283677 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1076/2159] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:30.294948 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf9177-aca7-4cf4-9e35-dbc8686c3ee5 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:30.296602 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-b3bf9177-aca7-4cf4-9e35-dbc8686c3ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:30.367295 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf9177-aca7-4cf4-9e35-dbc8686c3ee5 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:30.372350 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6da57-c8e1-4eb0-a695-ba1ce0ced565 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:30.373143 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6da57-c8e1-4eb0-a695-ba1ce0ced565 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:30.373511 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6da57-c8e1-4eb0-a695-ba1ce0ced565 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:30.373864 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6da57-c8e1-4eb0-a695-ba1ce0ced565 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:30.386222 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6da57-c8e1-4eb0-a695-ba1ce0ced565 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:30.388056 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6da57-c8e1-4eb0-a695-ba1ce0ced565 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:30.399988 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1084/2160] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:52:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:52:30.840705 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6f45a-01c5-45e2-bad6-0a3f405f800a None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:30.846564 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-66d6f45a-01c5-45e2-bad6-0a3f405f800a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:30.857875 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6f45a-01c5-45e2-bad6-0a3f405f800a None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:30.873654 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a2f75-ed02-400b-9955-861302fe4097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:30.875420 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a2f75-ed02-400b-9955-861302fe4097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:30.875920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a2f75-ed02-400b-9955-861302fe4097 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:30.876331 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a2f75-ed02-400b-9955-861302fe4097 admin admin] PATH_INFO: `/v3/projects/c0fa4e495e8343a882c64ee895a28280` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:30.877966 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a2f75-ed02-400b-9955-861302fe4097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0fa4e495e8343a882c64ee895a28280)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:30.880332 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a2f75-ed02-400b-9955-861302fe4097 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:31.002033 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-e25a2f75-ed02-400b-9955-861302fe4097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0fa4e495e8343a882c64ee895a28280', 'request_id': 'req-e25a2f75-ed02-400b-9955-861302fe4097'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:31.008905 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-e25a2f75-ed02-400b-9955-861302fe4097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0fa4e495e8343a882c64ee895a28280', 'request_id': 'req-e25a2f75-ed02-400b-9955-861302fe4097'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:31.017046 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-e25a2f75-ed02-400b-9955-861302fe4097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0fa4e495e8343a882c64ee895a28280', 'request_id': 'req-e25a2f75-ed02-400b-9955-861302fe4097'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:31.117656 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-e25a2f75-ed02-400b-9955-861302fe4097 admin admin] The token cache is being invalidate because project c0fa4e495e8343a882c64ee895a28280 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:52:31.117872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-e25a2f75-ed02-400b-9955-861302fe4097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:31.118496 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-e25a2f75-ed02-400b-9955-861302fe4097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:31.120296 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1077/2161] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:52:30 2022] DELETE /identity/v3/projects/c0fa4e495e8343a882c64ee895a28280 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:31.124994 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6da57-c8e1-4eb0-a695-ba1ce0ced565 service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:31.137699 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6da57-c8e1-4eb0-a695-ba1ce0ced565 service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:31.197340 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f51363-65eb-4530-bbd1-ec375aac482c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:31.212333 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f51363-65eb-4530-bbd1-ec375aac482c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:31.212333 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f51363-65eb-4530-bbd1-ec375aac482c admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:31.212333 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f51363-65eb-4530-bbd1-ec375aac482c admin admin] PATH_INFO: `/v3/users/c444577f8f1a4c15b85c9964d57dc6b9` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:31.212333 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f51363-65eb-4530-bbd1-ec375aac482c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c444577f8f1a4c15b85c9964d57dc6b9)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:31.212333 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f51363-65eb-4530-bbd1-ec375aac482c admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:31.413002 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:31.422168 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-99f51363-65eb-4530-bbd1-ec375aac482c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c444577f8f1a4c15b85c9964d57dc6b9'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:31.422828 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-99f51363-65eb-4530-bbd1-ec375aac482c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c444577f8f1a4c15b85c9964d57dc6b9'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:31.423468 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-99f51363-65eb-4530-bbd1-ec375aac482c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c444577f8f1a4c15b85c9964d57dc6b9'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:31.430671 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-99f51363-65eb-4530-bbd1-ec375aac482c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c444577f8f1a4c15b85c9964d57dc6b9'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:31.506567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-99f51363-65eb-4530-bbd1-ec375aac482c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c444577f8f1a4c15b85c9964d57dc6b9'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:31.525539 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1085/2162] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:52:31 2022] DELETE /identity/v3/users/c444577f8f1a4c15b85c9964d57dc6b9 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:31.959655 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a2f75-ed02-400b-9955-861302fe4097 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:31.961335 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-e25a2f75-ed02-400b-9955-861302fe4097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:31.977500 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a2f75-ed02-400b-9955-861302fe4097 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:32.048214 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d820aa-012f-4388-8ea3-914bb14e6361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:32.049228 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d820aa-012f-4388-8ea3-914bb14e6361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:32.049573 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d820aa-012f-4388-8ea3-914bb14e6361 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:32.049937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d820aa-012f-4388-8ea3-914bb14e6361 admin admin] PATH_INFO: `/v3/projects/05d90389865747a7a125e08fcfbc3b73` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:32.051503 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d820aa-012f-4388-8ea3-914bb14e6361 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05d90389865747a7a125e08fcfbc3b73)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:32.053516 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d820aa-012f-4388-8ea3-914bb14e6361 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:32.154346 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:32.168956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-04d820aa-012f-4388-8ea3-914bb14e6361 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05d90389865747a7a125e08fcfbc3b73', 'request_id': 'req-04d820aa-012f-4388-8ea3-914bb14e6361'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:32.176125 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-04d820aa-012f-4388-8ea3-914bb14e6361 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05d90389865747a7a125e08fcfbc3b73', 'request_id': 'req-04d820aa-012f-4388-8ea3-914bb14e6361'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:32.182380 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-04d820aa-012f-4388-8ea3-914bb14e6361 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05d90389865747a7a125e08fcfbc3b73', 'request_id': 'req-04d820aa-012f-4388-8ea3-914bb14e6361'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:32.313891 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-04d820aa-012f-4388-8ea3-914bb14e6361 admin admin] The token cache is being invalidate because project 05d90389865747a7a125e08fcfbc3b73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:52:32.314207 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-04d820aa-012f-4388-8ea3-914bb14e6361 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:32.315044 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-04d820aa-012f-4388-8ea3-914bb14e6361 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:32.316914 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1078/2163] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:52:31 2022] DELETE /identity/v3/projects/05d90389865747a7a125e08fcfbc3b73 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:32.323448 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8600087-1352-47d9-9227-ec8e3b4668b7 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:32.324332 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8600087-1352-47d9-9227-ec8e3b4668b7 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:32.324520 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8600087-1352-47d9-9227-ec8e3b4668b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:32.345556 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-e8600087-1352-47d9-9227-ec8e3b4668b7 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:32.346883 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-e8600087-1352-47d9-9227-ec8e3b4668b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:32.419035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1086/2164] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:32.426959 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201558a5-c21d-4b0e-8fc3-4b856d1ceef8 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:32.427353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201558a5-c21d-4b0e-8fc3-4b856d1ceef8 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:32.427745 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201558a5-c21d-4b0e-8fc3-4b856d1ceef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:32.452283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-201558a5-c21d-4b0e-8fc3-4b856d1ceef8 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:32.453740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-201558a5-c21d-4b0e-8fc3-4b856d1ceef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:32.464055 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1079/2165] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:32.470596 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8600087-1352-47d9-9227-ec8e3b4668b7 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:32.482366 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8600087-1352-47d9-9227-ec8e3b4668b7 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:32.487176 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f4886-9dad-4c9a-a252-ae50d4bda9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:32.487875 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f4886-9dad-4c9a-a252-ae50d4bda9da admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:32.488155 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f4886-9dad-4c9a-a252-ae50d4bda9da admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:32.488438 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f4886-9dad-4c9a-a252-ae50d4bda9da admin admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:32.489169 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f4886-9dad-4c9a-a252-ae50d4bda9da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:52:32.489478 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f4886-9dad-4c9a-a252-ae50d4bda9da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:32.491079 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f4886-9dad-4c9a-a252-ae50d4bda9da admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:32.508262 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1087/2166] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:52:32.514788 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201558a5-c21d-4b0e-8fc3-4b856d1ceef8 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:32.524525 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201558a5-c21d-4b0e-8fc3-4b856d1ceef8 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:32.530298 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07644625-4015-4742-951e-a0f83e3a4e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:32.530948 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07644625-4015-4742-951e-a0f83e3a4e86 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:32.531228 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07644625-4015-4742-951e-a0f83e3a4e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:32.531509 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07644625-4015-4742-951e-a0f83e3a4e86 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:32.532427 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07644625-4015-4742-951e-a0f83e3a4e86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:32.534314 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07644625-4015-4742-951e-a0f83e3a4e86 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:32.620231 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1080/2167] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:52:32 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:52:32.632085 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f4886-9dad-4c9a-a252-ae50d4bda9da admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:32.644558 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f4886-9dad-4c9a-a252-ae50d4bda9da admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:32.712463 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a89760-442e-4710-9085-672115c87e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:32.713262 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a89760-442e-4710-9085-672115c87e42 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:32.713597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a89760-442e-4710-9085-672115c87e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:32.715160 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a89760-442e-4710-9085-672115c87e42 admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:32.715160 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a89760-442e-4710-9085-672115c87e42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:32.717798 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a89760-442e-4710-9085-672115c87e42 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:32.896292 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1088/2168] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:52:32 2022] POST /identity/v3/users => generated 294 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:52:32.901126 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07644625-4015-4742-951e-a0f83e3a4e86 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:32.916280 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07644625-4015-4742-951e-a0f83e3a4e86 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:32.922444 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08398dd9-f1e7-47e0-9779-8653acc954e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:32.923480 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08398dd9-f1e7-47e0-9779-8653acc954e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:32.923951 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08398dd9-f1e7-47e0-9779-8653acc954e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:32.924314 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08398dd9-f1e7-47e0-9779-8653acc954e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:32.925213 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08398dd9-f1e7-47e0-9779-8653acc954e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:32.927450 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08398dd9-f1e7-47e0-9779-8653acc954e7 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:32.941428 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1081/2169] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:32.946105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a89760-442e-4710-9085-672115c87e42 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:32.959640 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a89760-442e-4710-9085-672115c87e42 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:32.967130 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2cd90-3372-439e-bc2a-86a9298c3e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:32.968023 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2cd90-3372-439e-bc2a-86a9298c3e6c admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:32.968309 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2cd90-3372-439e-bc2a-86a9298c3e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:32.968590 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2cd90-3372-439e-bc2a-86a9298c3e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:32.969336 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d2cd90-3372-439e-bc2a-86a9298c3e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:32.970939 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d2cd90-3372-439e-bc2a-86a9298c3e6c admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:32.991893 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1089/2170] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:32.998582 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08398dd9-f1e7-47e0-9779-8653acc954e7 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:33.007997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08398dd9-f1e7-47e0-9779-8653acc954e7 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:33.014747 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d2ab6-8f9f-4a8a-bde9-84ca27402bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:33.015667 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d2ab6-8f9f-4a8a-bde9-84ca27402bcb admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:33.015969 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d2ab6-8f9f-4a8a-bde9-84ca27402bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:33.016227 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d2ab6-8f9f-4a8a-bde9-84ca27402bcb admin admin] PATH_INFO: `/v3/projects/34cd0cc02f904284b77286c38badaa27/users/9c2d7cf9491247a9a5e529b639d2bc89/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:33.035645 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d2ab6-8f9f-4a8a-bde9-84ca27402bcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=34cd0cc02f904284b77286c38badaa27, user_id=9c2d7cf9491247a9a5e529b639d2bc89, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:33.038313 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d2ab6-8f9f-4a8a-bde9-84ca27402bcb admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:33.138496 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1082/2171] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:52:32 2022] PUT /identity/v3/projects/34cd0cc02f904284b77286c38badaa27/users/9c2d7cf9491247a9a5e529b639d2bc89/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:33.151833 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adf707-6c0b-49a2-9fcc-ad1014c25555 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:33.152228 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adf707-6c0b-49a2-9fcc-ad1014c25555 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:33.152574 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adf707-6c0b-49a2-9fcc-ad1014c25555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:33.186236 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-95adf707-6c0b-49a2-9fcc-ad1014c25555 None None] MFA Rules not processed for user `9c2d7cf9491247a9a5e529b639d2bc89`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:33.187588 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-95adf707-6c0b-49a2-9fcc-ad1014c25555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:33.197999 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:33.257487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1090/2172] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:52:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:33.263258 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d2ab6-8f9f-4a8a-bde9-84ca27402bcb admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:33.349402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d2ab6-8f9f-4a8a-bde9-84ca27402bcb admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:33.355150 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855094b-e7f5-42f1-9ff8-959631bc83fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:33.355873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855094b-e7f5-42f1-9ff8-959631bc83fb admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:33.356165 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855094b-e7f5-42f1-9ff8-959631bc83fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:33.356503 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855094b-e7f5-42f1-9ff8-959631bc83fb admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:33.357357 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855094b-e7f5-42f1-9ff8-959631bc83fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:33.359718 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855094b-e7f5-42f1-9ff8-959631bc83fb admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:33.482973 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1083/2173] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:52:33 2022] POST /identity/v3/projects => generated 389 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:52:33.486776 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95adf707-6c0b-49a2-9fcc-ad1014c25555 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:33.498491 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95adf707-6c0b-49a2-9fcc-ad1014c25555 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:33.567037 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0642996-a662-40b0-9f3b-362b99d9378e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:33.568044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0642996-a662-40b0-9f3b-362b99d9378e admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:33.568441 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0642996-a662-40b0-9f3b-362b99d9378e admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:33.568918 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0642996-a662-40b0-9f3b-362b99d9378e admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:33.569632 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0642996-a662-40b0-9f3b-362b99d9378e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:33.571547 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0642996-a662-40b0-9f3b-362b99d9378e admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:33.668273 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1091/2174] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:52:33 2022] POST /identity/v3/users => generated 301 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:52:33.673313 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855094b-e7f5-42f1-9ff8-959631bc83fb admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:33.685964 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855094b-e7f5-42f1-9ff8-959631bc83fb admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:33.692675 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c9291-01f0-4df0-b630-262222f319a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:33.693776 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c9291-01f0-4df0-b630-262222f319a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:33.694194 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c9291-01f0-4df0-b630-262222f319a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:33.694610 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c9291-01f0-4df0-b630-262222f319a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:33.695796 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c9291-01f0-4df0-b630-262222f319a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:33.698320 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c9291-01f0-4df0-b630-262222f319a0 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:33.712292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1084/2175] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:52:33.717107 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0642996-a662-40b0-9f3b-362b99d9378e admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:33.728962 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0642996-a662-40b0-9f3b-362b99d9378e admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:33.735010 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3215e4f-32ac-4e3e-848b-7ed695afc051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:33.735963 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3215e4f-32ac-4e3e-848b-7ed695afc051 admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:33.736251 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3215e4f-32ac-4e3e-848b-7ed695afc051 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:33.736529 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3215e4f-32ac-4e3e-848b-7ed695afc051 admin admin] PATH_INFO: `/v3/projects/3e5fdbc83f92401ebf18ada6d825be96/users/d9d88c37c7d245b1bc78652aa522b736/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:33.753720 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3215e4f-32ac-4e3e-848b-7ed695afc051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e5fdbc83f92401ebf18ada6d825be96, user_id=d9d88c37c7d245b1bc78652aa522b736, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:33.756399 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3215e4f-32ac-4e3e-848b-7ed695afc051 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:33.838976 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1092/2176] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:52:33 2022] PUT /identity/v3/projects/3e5fdbc83f92401ebf18ada6d825be96/users/d9d88c37c7d245b1bc78652aa522b736/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:33.843060 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c9291-01f0-4df0-b630-262222f319a0 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:33.854389 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c9291-01f0-4df0-b630-262222f319a0 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:33.887047 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:33.916858 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8006b2-294b-43ff-9901-dcc5adcb8e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:33.917541 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8006b2-294b-43ff-9901-dcc5adcb8e4e admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:33.917825 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8006b2-294b-43ff-9901-dcc5adcb8e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:33.918104 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8006b2-294b-43ff-9901-dcc5adcb8e4e admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:33.918834 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8006b2-294b-43ff-9901-dcc5adcb8e4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:33.920487 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8006b2-294b-43ff-9901-dcc5adcb8e4e admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:33.931598 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1085/2177] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:33.936769 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3215e4f-32ac-4e3e-848b-7ed695afc051 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:33.947093 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3215e4f-32ac-4e3e-848b-7ed695afc051 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:33.952077 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc784ad1-8db6-4bfc-b12f-4c1e80de8a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:33.952954 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc784ad1-8db6-4bfc-b12f-4c1e80de8a2b admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:33.955281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc784ad1-8db6-4bfc-b12f-4c1e80de8a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:33.955281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc784ad1-8db6-4bfc-b12f-4c1e80de8a2b admin admin] PATH_INFO: `/v3/projects/3e5fdbc83f92401ebf18ada6d825be96/users/d9d88c37c7d245b1bc78652aa522b736/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:33.955497 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc784ad1-8db6-4bfc-b12f-4c1e80de8a2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e5fdbc83f92401ebf18ada6d825be96, user_id=d9d88c37c7d245b1bc78652aa522b736, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:33.958130 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc784ad1-8db6-4bfc-b12f-4c1e80de8a2b admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:33.969419 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1093/2178] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:52:33 2022] PUT /identity/v3/projects/3e5fdbc83f92401ebf18ada6d825be96/users/d9d88c37c7d245b1bc78652aa522b736/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:33.981600 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5cdb7-1a89-4ede-9015-1d4ff51e9e73 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:33.982672 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5cdb7-1a89-4ede-9015-1d4ff51e9e73 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:33.983034 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5cdb7-1a89-4ede-9015-1d4ff51e9e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:34.018782 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-65f5cdb7-1a89-4ede-9015-1d4ff51e9e73 None None] MFA Rules not processed for user `d9d88c37c7d245b1bc78652aa522b736`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:34.020260 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-65f5cdb7-1a89-4ede-9015-1d4ff51e9e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:34.095210 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1086/2179] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:52:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:34.107405 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc784ad1-8db6-4bfc-b12f-4c1e80de8a2b admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:34.115787 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-bc784ad1-8db6-4bfc-b12f-4c1e80de8a2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:34.188297 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc784ad1-8db6-4bfc-b12f-4c1e80de8a2b admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:34.192542 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948468c-2ce8-4503-a603-5d76c5699bd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:34.193332 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948468c-2ce8-4503-a603-5d76c5699bd8 service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:34.193625 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948468c-2ce8-4503-a603-5d76c5699bd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:34.193973 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948468c-2ce8-4503-a603-5d76c5699bd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:34.205498 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0948468c-2ce8-4503-a603-5d76c5699bd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:34.207055 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0948468c-2ce8-4503-a603-5d76c5699bd8 service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:34.218738 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1094/2180] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:52:34 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:52:34.386553 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f5cdb7-1a89-4ede-9015-1d4ff51e9e73 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:34.456159 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f5cdb7-1a89-4ede-9015-1d4ff51e9e73 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:34.461289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e7ecd-78f5-4a7e-813f-4f0a6f5a80b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:34.462157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e7ecd-78f5-4a7e-813f-4f0a6f5a80b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:34.462484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e7ecd-78f5-4a7e-813f-4f0a6f5a80b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:34.462761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e7ecd-78f5-4a7e-813f-4f0a6f5a80b4 admin admin] PATH_INFO: `/v3/users/9c2d7cf9491247a9a5e529b639d2bc89` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:34.463988 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e7ecd-78f5-4a7e-813f-4f0a6f5a80b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c2d7cf9491247a9a5e529b639d2bc89)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:34.466222 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e7ecd-78f5-4a7e-813f-4f0a6f5a80b4 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:34.676515 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-e34e7ecd-78f5-4a7e-813f-4f0a6f5a80b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c2d7cf9491247a9a5e529b639d2bc89'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:34.677317 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-e34e7ecd-78f5-4a7e-813f-4f0a6f5a80b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c2d7cf9491247a9a5e529b639d2bc89'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:34.686010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:34.688523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-e34e7ecd-78f5-4a7e-813f-4f0a6f5a80b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c2d7cf9491247a9a5e529b639d2bc89'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:34.689620 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-e34e7ecd-78f5-4a7e-813f-4f0a6f5a80b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c2d7cf9491247a9a5e529b639d2bc89'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:34.822057 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-e34e7ecd-78f5-4a7e-813f-4f0a6f5a80b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c2d7cf9491247a9a5e529b639d2bc89'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:34.849688 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1087/2181] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:52:34 2022] DELETE /identity/v3/users/9c2d7cf9491247a9a5e529b639d2bc89 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:34.855548 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3cb97-a4d2-42d4-a120-df3daeddd534 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:34.856379 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3cb97-a4d2-42d4-a120-df3daeddd534 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:34.858258 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3cb97-a4d2-42d4-a120-df3daeddd534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:34.874523 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:34.880913 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-baa3cb97-a4d2-42d4-a120-df3daeddd534 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:34.882063 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-baa3cb97-a4d2-42d4-a120-df3daeddd534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:34.943914 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1095/2182] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:52:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:34.966732 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e7ecd-78f5-4a7e-813f-4f0a6f5a80b4 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:34.970244 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-e34e7ecd-78f5-4a7e-813f-4f0a6f5a80b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:35.055075 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e7ecd-78f5-4a7e-813f-4f0a6f5a80b4 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:35.059657 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f546176-67ac-4408-aa1c-8c391938780c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:35.060321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f546176-67ac-4408-aa1c-8c391938780c service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:35.060610 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f546176-67ac-4408-aa1c-8c391938780c service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:35.060897 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f546176-67ac-4408-aa1c-8c391938780c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:35.070398 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f546176-67ac-4408-aa1c-8c391938780c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:35.071870 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f546176-67ac-4408-aa1c-8c391938780c service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:35.082012 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1088/2183] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:52:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:52:35.760824 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3cb97-a4d2-42d4-a120-df3daeddd534 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:35.763147 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-baa3cb97-a4d2-42d4-a120-df3daeddd534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:35.778223 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3cb97-a4d2-42d4-a120-df3daeddd534 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:35.785099 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f9426-2396-4d13-a5dc-667d2a14cf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:35.797940 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f9426-2396-4d13-a5dc-667d2a14cf3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:35.798935 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f9426-2396-4d13-a5dc-667d2a14cf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:35.816692 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f9426-2396-4d13-a5dc-667d2a14cf3f admin admin] PATH_INFO: `/v3/projects/34cd0cc02f904284b77286c38badaa27` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:35.816692 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f9426-2396-4d13-a5dc-667d2a14cf3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=34cd0cc02f904284b77286c38badaa27)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:35.816692 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f9426-2396-4d13-a5dc-667d2a14cf3f admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:35.944070 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-ba3f9426-2396-4d13-a5dc-667d2a14cf3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34cd0cc02f904284b77286c38badaa27', 'request_id': 'req-ba3f9426-2396-4d13-a5dc-667d2a14cf3f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:35.961786 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-ba3f9426-2396-4d13-a5dc-667d2a14cf3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34cd0cc02f904284b77286c38badaa27', 'request_id': 'req-ba3f9426-2396-4d13-a5dc-667d2a14cf3f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:35.971511 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-ba3f9426-2396-4d13-a5dc-667d2a14cf3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34cd0cc02f904284b77286c38badaa27', 'request_id': 'req-ba3f9426-2396-4d13-a5dc-667d2a14cf3f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:36.073031 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-ba3f9426-2396-4d13-a5dc-667d2a14cf3f admin admin] The token cache is being invalidate because project 34cd0cc02f904284b77286c38badaa27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:52:36.073369 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-ba3f9426-2396-4d13-a5dc-667d2a14cf3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:36.075374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-ba3f9426-2396-4d13-a5dc-667d2a14cf3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:36.077353 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1096/2184] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:52:35 2022] DELETE /identity/v3/projects/34cd0cc02f904284b77286c38badaa27 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:36.081912 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f546176-67ac-4408-aa1c-8c391938780c service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:36.094615 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f546176-67ac-4408-aa1c-8c391938780c service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:36.177955 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183d62c-d37c-4c18-a29d-7612cfe44871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:36.179660 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183d62c-d37c-4c18-a29d-7612cfe44871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:36.180077 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183d62c-d37c-4c18-a29d-7612cfe44871 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:36.180560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183d62c-d37c-4c18-a29d-7612cfe44871 admin admin] PATH_INFO: `/v3/users/d9d88c37c7d245b1bc78652aa522b736` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:36.182158 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183d62c-d37c-4c18-a29d-7612cfe44871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9d88c37c7d245b1bc78652aa522b736)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:36.187226 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183d62c-d37c-4c18-a29d-7612cfe44871 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:36.406496 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f183d62c-d37c-4c18-a29d-7612cfe44871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9d88c37c7d245b1bc78652aa522b736'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:36.407229 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f183d62c-d37c-4c18-a29d-7612cfe44871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9d88c37c7d245b1bc78652aa522b736'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:36.415395 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f183d62c-d37c-4c18-a29d-7612cfe44871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9d88c37c7d245b1bc78652aa522b736'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:36.416295 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f183d62c-d37c-4c18-a29d-7612cfe44871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9d88c37c7d245b1bc78652aa522b736'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:36.490040 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f183d62c-d37c-4c18-a29d-7612cfe44871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9d88c37c7d245b1bc78652aa522b736'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:36.502241 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:36.510529 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1089/2185] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:52:36 2022] DELETE /identity/v3/users/d9d88c37c7d245b1bc78652aa522b736 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:37.065117 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f9426-2396-4d13-a5dc-667d2a14cf3f admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:37.068976 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-ba3f9426-2396-4d13-a5dc-667d2a14cf3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:37.084621 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f9426-2396-4d13-a5dc-667d2a14cf3f admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:37.159285 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7006f-81ba-4cc6-852f-d7abcdf01ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:37.160212 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7006f-81ba-4cc6-852f-d7abcdf01ae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:37.160492 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7006f-81ba-4cc6-852f-d7abcdf01ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:37.160765 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7006f-81ba-4cc6-852f-d7abcdf01ae1 admin admin] PATH_INFO: `/v3/projects/3e5fdbc83f92401ebf18ada6d825be96` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:37.161950 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7006f-81ba-4cc6-852f-d7abcdf01ae1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e5fdbc83f92401ebf18ada6d825be96)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:37.164163 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7006f-81ba-4cc6-852f-d7abcdf01ae1 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:37.291667 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:37.312636 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-26f7006f-81ba-4cc6-852f-d7abcdf01ae1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e5fdbc83f92401ebf18ada6d825be96', 'request_id': 'req-26f7006f-81ba-4cc6-852f-d7abcdf01ae1'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:37.320688 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-26f7006f-81ba-4cc6-852f-d7abcdf01ae1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e5fdbc83f92401ebf18ada6d825be96', 'request_id': 'req-26f7006f-81ba-4cc6-852f-d7abcdf01ae1'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:37.328275 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-26f7006f-81ba-4cc6-852f-d7abcdf01ae1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e5fdbc83f92401ebf18ada6d825be96', 'request_id': 'req-26f7006f-81ba-4cc6-852f-d7abcdf01ae1'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:37.397294 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-26f7006f-81ba-4cc6-852f-d7abcdf01ae1 admin admin] The token cache is being invalidate because project 3e5fdbc83f92401ebf18ada6d825be96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:52:37.397588 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-26f7006f-81ba-4cc6-852f-d7abcdf01ae1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:37.398226 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-26f7006f-81ba-4cc6-852f-d7abcdf01ae1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:37.400026 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1097/2186] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:52:37 2022] DELETE /identity/v3/projects/3e5fdbc83f92401ebf18ada6d825be96 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:37.406228 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101f373-18ca-4a1a-bc62-ecbacc0ed82e None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:37.406758 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101f373-18ca-4a1a-bc62-ecbacc0ed82e None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:37.406906 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101f373-18ca-4a1a-bc62-ecbacc0ed82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:37.428590 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-8101f373-18ca-4a1a-bc62-ecbacc0ed82e None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:37.429806 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-8101f373-18ca-4a1a-bc62-ecbacc0ed82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:37.496763 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1090/2187] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:37.505449 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcfb4e-fbb0-4b01-a28f-42862cb085bb None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:37.505741 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcfb4e-fbb0-4b01-a28f-42862cb085bb None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:37.506031 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcfb4e-fbb0-4b01-a28f-42862cb085bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:37.529239 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-b3dcfb4e-fbb0-4b01-a28f-42862cb085bb None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:37.531196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-b3dcfb4e-fbb0-4b01-a28f-42862cb085bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:37.540453 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1098/2188] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:37.545305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101f373-18ca-4a1a-bc62-ecbacc0ed82e None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:37.556414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101f373-18ca-4a1a-bc62-ecbacc0ed82e None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:37.564594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f0c9d-53ab-42b8-9776-818cadac43b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:37.565279 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f0c9d-53ab-42b8-9776-818cadac43b3 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:37.565627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f0c9d-53ab-42b8-9776-818cadac43b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:37.565945 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f0c9d-53ab-42b8-9776-818cadac43b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:37.566822 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f0c9d-53ab-42b8-9776-818cadac43b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:52:37.567238 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f0c9d-53ab-42b8-9776-818cadac43b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:37.569109 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f0c9d-53ab-42b8-9776-818cadac43b3 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:37.584881 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1091/2189] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:52:37.590122 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dcfb4e-fbb0-4b01-a28f-42862cb085bb None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:37.601745 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dcfb4e-fbb0-4b01-a28f-42862cb085bb None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:37.606781 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9372708-5178-475f-88c9-c7f54398f11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:37.607442 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9372708-5178-475f-88c9-c7f54398f11e admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:37.617201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9372708-5178-475f-88c9-c7f54398f11e admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:37.617201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9372708-5178-475f-88c9-c7f54398f11e admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:37.617201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9372708-5178-475f-88c9-c7f54398f11e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:37.617201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9372708-5178-475f-88c9-c7f54398f11e admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:37.698615 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1099/2190] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:52:37 2022] POST /identity/v3/projects => generated 359 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:52:37.703550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f0c9d-53ab-42b8-9776-818cadac43b3 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:37.716108 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f0c9d-53ab-42b8-9776-818cadac43b3 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:37.781195 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ccfa7-2b08-4296-997f-2a9b4b9ab301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:37.781896 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ccfa7-2b08-4296-997f-2a9b4b9ab301 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:37.782239 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ccfa7-2b08-4296-997f-2a9b4b9ab301 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:37.783155 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ccfa7-2b08-4296-997f-2a9b4b9ab301 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:37.783569 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ccfa7-2b08-4296-997f-2a9b4b9ab301 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:37.785613 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ccfa7-2b08-4296-997f-2a9b4b9ab301 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:37.846769 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1092/2191] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:52:37 2022] POST /identity/v3/users => generated 280 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:52:37.851052 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9372708-5178-475f-88c9-c7f54398f11e admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:37.864659 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9372708-5178-475f-88c9-c7f54398f11e admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:37.870150 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa1622-04cc-493f-acb2-f721554d24b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:37.870911 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa1622-04cc-493f-acb2-f721554d24b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:37.871153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa1622-04cc-493f-acb2-f721554d24b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:37.871430 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa1622-04cc-493f-acb2-f721554d24b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:37.872945 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa1622-04cc-493f-acb2-f721554d24b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:37.875352 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa1622-04cc-493f-acb2-f721554d24b7 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:37.893494 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1100/2192] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:37.895301 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ccfa7-2b08-4296-997f-2a9b4b9ab301 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:37.908158 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ccfa7-2b08-4296-997f-2a9b4b9ab301 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:37.913496 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538b1dd-ffc0-4760-be45-4b5fe9a9a0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:37.914250 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538b1dd-ffc0-4760-be45-4b5fe9a9a0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:37.914550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538b1dd-ffc0-4760-be45-4b5fe9a9a0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:37.914833 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538b1dd-ffc0-4760-be45-4b5fe9a9a0f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:37.915631 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538b1dd-ffc0-4760-be45-4b5fe9a9a0f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:37.917240 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538b1dd-ffc0-4760-be45-4b5fe9a9a0f2 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:37.933683 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1093/2193] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:37.940960 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa1622-04cc-493f-acb2-f721554d24b7 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:37.952418 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa1622-04cc-493f-acb2-f721554d24b7 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:37.958047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18b6a7-f2c6-4ad1-8f51-28ff7d779b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:37.958996 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18b6a7-f2c6-4ad1-8f51-28ff7d779b2c admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:37.959284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18b6a7-f2c6-4ad1-8f51-28ff7d779b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:37.962128 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18b6a7-f2c6-4ad1-8f51-28ff7d779b2c admin admin] PATH_INFO: `/v3/projects/5b118cf74d0145c1b46bdfed5286fc69/users/e1f21651d3a74b88b5c5b505d9812841/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:37.976678 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18b6a7-f2c6-4ad1-8f51-28ff7d779b2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b118cf74d0145c1b46bdfed5286fc69, user_id=e1f21651d3a74b88b5c5b505d9812841, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:37.979971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18b6a7-f2c6-4ad1-8f51-28ff7d779b2c admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:38.039196 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538b1dd-ffc0-4760-be45-4b5fe9a9a0f2 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:38.041476 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b538b1dd-ffc0-4760-be45-4b5fe9a9a0f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:38.056941 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538b1dd-ffc0-4760-be45-4b5fe9a9a0f2 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:38.062762 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17961712-225f-482f-a594-44d415575f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:38.063643 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17961712-225f-482f-a594-44d415575f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:38.063933 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17961712-225f-482f-a594-44d415575f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:38.064201 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17961712-225f-482f-a594-44d415575f0e admin admin] PATH_INFO: `/v3/users/93a315d24cc74f9391ce934ba53ccbc3` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:38.065440 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17961712-225f-482f-a594-44d415575f0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=93a315d24cc74f9391ce934ba53ccbc3)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:38.067373 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17961712-225f-482f-a594-44d415575f0e admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:38.149646 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1101/2194] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:52:37 2022] PUT /identity/v3/projects/5b118cf74d0145c1b46bdfed5286fc69/users/e1f21651d3a74b88b5c5b505d9812841/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:52:38.163493 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df623310-069f-48ad-982b-caa90b09a12b None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:38.163834 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df623310-069f-48ad-982b-caa90b09a12b None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:38.164166 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df623310-069f-48ad-982b-caa90b09a12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:38.196917 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-df623310-069f-48ad-982b-caa90b09a12b None None] MFA Rules not processed for user `e1f21651d3a74b88b5c5b505d9812841`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:38.198156 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-df623310-069f-48ad-982b-caa90b09a12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:38.269427 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1102/2195] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:52:38 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:52:38.324938 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-17961712-225f-482f-a594-44d415575f0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93a315d24cc74f9391ce934ba53ccbc3'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:38.326674 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-17961712-225f-482f-a594-44d415575f0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93a315d24cc74f9391ce934ba53ccbc3'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:38.332215 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df623310-069f-48ad-982b-caa90b09a12b None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:38.335194 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-df623310-069f-48ad-982b-caa90b09a12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:38.336765 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:38.339579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-17961712-225f-482f-a594-44d415575f0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93a315d24cc74f9391ce934ba53ccbc3'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:38.341346 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-17961712-225f-482f-a594-44d415575f0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93a315d24cc74f9391ce934ba53ccbc3'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:38.404620 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-17961712-225f-482f-a594-44d415575f0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93a315d24cc74f9391ce934ba53ccbc3'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:38.417240 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:38.424724 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df623310-069f-48ad-982b-caa90b09a12b None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:38.426655 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1094/2196] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:52:38 2022] DELETE /identity/v3/users/93a315d24cc74f9391ce934ba53ccbc3 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:52:38.433238 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d7861-05be-46da-b318-3b400fc5b6e3 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:38.433681 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d7861-05be-46da-b318-3b400fc5b6e3 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:38.433981 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d7861-05be-46da-b318-3b400fc5b6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:38.458643 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-958d7861-05be-46da-b318-3b400fc5b6e3 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:38.460109 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-958d7861-05be-46da-b318-3b400fc5b6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:38.493603 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c515ed-bfa1-498b-b13c-4aebcd73e830 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:38.498202 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c515ed-bfa1-498b-b13c-4aebcd73e830 service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:38.498202 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c515ed-bfa1-498b-b13c-4aebcd73e830 service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:38.498202 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c515ed-bfa1-498b-b13c-4aebcd73e830 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:38.498202 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-c9c515ed-bfa1-498b-b13c-4aebcd73e830 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:38.538468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1095/2197] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:52:38.549237 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d7861-05be-46da-b318-3b400fc5b6e3 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:38.551208 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-958d7861-05be-46da-b318-3b400fc5b6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:38.575981 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c515ed-bfa1-498b-b13c-4aebcd73e830 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:38.578017 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c515ed-bfa1-498b-b13c-4aebcd73e830 service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:38.587104 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1103/2198] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:52:38 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:52:38.604750 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c515ed-bfa1-498b-b13c-4aebcd73e830 service cinder] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:38.606934 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-c9c515ed-bfa1-498b-b13c-4aebcd73e830 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:38.623342 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d7861-05be-46da-b318-3b400fc5b6e3 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:38.624099 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c515ed-bfa1-498b-b13c-4aebcd73e830 service cinder] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:38.630736 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a73ba8-d132-4fce-bffb-f6362f4ca231 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:38.630736 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a73ba8-d132-4fce-bffb-f6362f4ca231 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:38.630736 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a73ba8-d132-4fce-bffb-f6362f4ca231 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:38.630736 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a73ba8-d132-4fce-bffb-f6362f4ca231 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:38.642399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a73ba8-d132-4fce-bffb-f6362f4ca231 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:38.643872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a73ba8-d132-4fce-bffb-f6362f4ca231 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:38.645829 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550e2db-179f-4e46-9bfe-77e5c003c6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:38.647764 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550e2db-179f-4e46-9bfe-77e5c003c6dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:38.648326 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550e2db-179f-4e46-9bfe-77e5c003c6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:38.648637 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550e2db-179f-4e46-9bfe-77e5c003c6dc admin admin] PATH_INFO: `/v3/users/e1f21651d3a74b88b5c5b505d9812841` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:38.652776 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550e2db-179f-4e46-9bfe-77e5c003c6dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1f21651d3a74b88b5c5b505d9812841)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:38.669477 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550e2db-179f-4e46-9bfe-77e5c003c6dc admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:38.669630 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1096/2199] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:52:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:52:38.879638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-c550e2db-179f-4e46-9bfe-77e5c003c6dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1f21651d3a74b88b5c5b505d9812841'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:38.880663 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-c550e2db-179f-4e46-9bfe-77e5c003c6dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1f21651d3a74b88b5c5b505d9812841'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:38.881512 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-c550e2db-179f-4e46-9bfe-77e5c003c6dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1f21651d3a74b88b5c5b505d9812841'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:38.891446 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-c550e2db-179f-4e46-9bfe-77e5c003c6dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1f21651d3a74b88b5c5b505d9812841'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:38.975726 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-c550e2db-179f-4e46-9bfe-77e5c003c6dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1f21651d3a74b88b5c5b505d9812841'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:39.002760 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1104/2200] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:52:38 2022] DELETE /identity/v3/users/e1f21651d3a74b88b5c5b505d9812841 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:52:39.008548 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5a591-ae70-411e-86b2-8bf92499c915 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:39.008887 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5a591-ae70-411e-86b2-8bf92499c915 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:39.009180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5a591-ae70-411e-86b2-8bf92499c915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:39.030606 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-13d5a591-ae70-411e-86b2-8bf92499c915 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:39.032387 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-13d5a591-ae70-411e-86b2-8bf92499c915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:39.100048 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1097/2201] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:39.111423 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550e2db-179f-4e46-9bfe-77e5c003c6dc admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:39.112925 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-c550e2db-179f-4e46-9bfe-77e5c003c6dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:39.124513 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5a591-ae70-411e-86b2-8bf92499c915 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:39.126677 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-13d5a591-ae70-411e-86b2-8bf92499c915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:39.142005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5a591-ae70-411e-86b2-8bf92499c915 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:39.150449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68664124-047c-492e-8126-87ce4dde9b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:39.151410 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:39.157093 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68664124-047c-492e-8126-87ce4dde9b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:39.157093 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68664124-047c-492e-8126-87ce4dde9b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:39.157093 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68664124-047c-492e-8126-87ce4dde9b4b admin admin] PATH_INFO: `/v3/projects/46b20c969aa64af9bb32b01372073afd` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:39.157093 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68664124-047c-492e-8126-87ce4dde9b4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=46b20c969aa64af9bb32b01372073afd)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:39.158031 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68664124-047c-492e-8126-87ce4dde9b4b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:39.172343 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:39.181487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550e2db-179f-4e46-9bfe-77e5c003c6dc admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:39.186542 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621c621-a8cc-4b19-9826-9822edc0b3f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:39.188078 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621c621-a8cc-4b19-9826-9822edc0b3f6 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:39.188232 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621c621-a8cc-4b19-9826-9822edc0b3f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:39.188528 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621c621-a8cc-4b19-9826-9822edc0b3f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:39.198573 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621c621-a8cc-4b19-9826-9822edc0b3f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:39.200140 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621c621-a8cc-4b19-9826-9822edc0b3f6 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:39.210380 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1105/2202] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:52:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:52:39.307767 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-68664124-047c-492e-8126-87ce4dde9b4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46b20c969aa64af9bb32b01372073afd', 'request_id': 'req-68664124-047c-492e-8126-87ce4dde9b4b'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:39.315481 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-68664124-047c-492e-8126-87ce4dde9b4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46b20c969aa64af9bb32b01372073afd', 'request_id': 'req-68664124-047c-492e-8126-87ce4dde9b4b'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:39.324269 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-68664124-047c-492e-8126-87ce4dde9b4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46b20c969aa64af9bb32b01372073afd', 'request_id': 'req-68664124-047c-492e-8126-87ce4dde9b4b'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:39.430610 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-68664124-047c-492e-8126-87ce4dde9b4b admin admin] The token cache is being invalidate because project 46b20c969aa64af9bb32b01372073afd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:52:39.430610 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-68664124-047c-492e-8126-87ce4dde9b4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:39.439298 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-68664124-047c-492e-8126-87ce4dde9b4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:39.441613 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1098/2203] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:52:39 2022] DELETE /identity/v3/projects/46b20c969aa64af9bb32b01372073afd => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:39.817795 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621c621-a8cc-4b19-9826-9822edc0b3f6 service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:39.819286 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-a621c621-a8cc-4b19-9826-9822edc0b3f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:39.836690 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621c621-a8cc-4b19-9826-9822edc0b3f6 service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:39.839563 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68664124-047c-492e-8126-87ce4dde9b4b admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:39.841151 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-68664124-047c-492e-8126-87ce4dde9b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:39.915921 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59490b5-2437-40ec-9b51-1cecb7bec371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:39.916980 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59490b5-2437-40ec-9b51-1cecb7bec371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:39.917312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59490b5-2437-40ec-9b51-1cecb7bec371 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:39.917653 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59490b5-2437-40ec-9b51-1cecb7bec371 admin admin] PATH_INFO: `/v3/users/6f1335db2a374b31b377cd6933627618` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:39.919193 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59490b5-2437-40ec-9b51-1cecb7bec371 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f1335db2a374b31b377cd6933627618)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:39.921520 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59490b5-2437-40ec-9b51-1cecb7bec371 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:39.944622 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68664124-047c-492e-8126-87ce4dde9b4b admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:39.951455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98535f2d-af13-4810-bd10-1fc67875b77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:39.952459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98535f2d-af13-4810-bd10-1fc67875b77e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:39.952751 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98535f2d-af13-4810-bd10-1fc67875b77e admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:39.953036 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98535f2d-af13-4810-bd10-1fc67875b77e admin admin] PATH_INFO: `/v3/projects/5b118cf74d0145c1b46bdfed5286fc69` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:39.954587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98535f2d-af13-4810-bd10-1fc67875b77e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b118cf74d0145c1b46bdfed5286fc69)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:39.956805 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98535f2d-af13-4810-bd10-1fc67875b77e admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:40.120046 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-e59490b5-2437-40ec-9b51-1cecb7bec371 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f1335db2a374b31b377cd6933627618'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:40.120814 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-e59490b5-2437-40ec-9b51-1cecb7bec371 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f1335db2a374b31b377cd6933627618'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:40.121495 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-e59490b5-2437-40ec-9b51-1cecb7bec371 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f1335db2a374b31b377cd6933627618'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:40.121952 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-98535f2d-af13-4810-bd10-1fc67875b77e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b118cf74d0145c1b46bdfed5286fc69', 'request_id': 'req-98535f2d-af13-4810-bd10-1fc67875b77e'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:40.137447 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-98535f2d-af13-4810-bd10-1fc67875b77e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b118cf74d0145c1b46bdfed5286fc69', 'request_id': 'req-98535f2d-af13-4810-bd10-1fc67875b77e'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:40.146409 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-98535f2d-af13-4810-bd10-1fc67875b77e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b118cf74d0145c1b46bdfed5286fc69', 'request_id': 'req-98535f2d-af13-4810-bd10-1fc67875b77e'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:40.157903 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-e59490b5-2437-40ec-9b51-1cecb7bec371 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f1335db2a374b31b377cd6933627618'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:40.216385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-98535f2d-af13-4810-bd10-1fc67875b77e admin admin] The token cache is being invalidate because project 5b118cf74d0145c1b46bdfed5286fc69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:52:40.217015 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-98535f2d-af13-4810-bd10-1fc67875b77e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:40.217743 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-98535f2d-af13-4810-bd10-1fc67875b77e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:40.219653 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1099/2204] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:52:39 2022] DELETE /identity/v3/projects/5b118cf74d0145c1b46bdfed5286fc69 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:40.224157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f84e64-b72e-4603-afcc-cd546921e3be None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:40.224751 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f84e64-b72e-4603-afcc-cd546921e3be None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:40.225124 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f84e64-b72e-4603-afcc-cd546921e3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:40.248521 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-b6f84e64-b72e-4603-afcc-cd546921e3be None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:40.249766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b6f84e64-b72e-4603-afcc-cd546921e3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:40.277281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:40.289168 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-e59490b5-2437-40ec-9b51-1cecb7bec371 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f1335db2a374b31b377cd6933627618'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:40.310202 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1106/2205] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:52:39 2022] DELETE /identity/v3/users/6f1335db2a374b31b377cd6933627618 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:40.315395 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340031a1-8e22-43ec-88f5-90d99d6f78eb None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:40.315806 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340031a1-8e22-43ec-88f5-90d99d6f78eb None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:40.316029 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340031a1-8e22-43ec-88f5-90d99d6f78eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:40.323339 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1100/2206] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:52:40.332211 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb3f97-e09b-4687-853c-1a73bf635d21 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:40.332603 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb3f97-e09b-4687-853c-1a73bf635d21 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:40.332894 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb3f97-e09b-4687-853c-1a73bf635d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:40.336197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-340031a1-8e22-43ec-88f5-90d99d6f78eb None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:40.338088 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-340031a1-8e22-43ec-88f5-90d99d6f78eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:40.360241 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-64eb3f97-e09b-4687-853c-1a73bf635d21 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:40.361689 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-64eb3f97-e09b-4687-853c-1a73bf635d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:40.392812 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:40.413836 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1107/2207] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:40.420857 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340031a1-8e22-43ec-88f5-90d99d6f78eb None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:40.422371 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-340031a1-8e22-43ec-88f5-90d99d6f78eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:40.441640 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1101/2208] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:40.447169 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb3f97-e09b-4687-853c-1a73bf635d21 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:40.456408 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb3f97-e09b-4687-853c-1a73bf635d21 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:40.461243 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8c1d1-6fb2-462c-b3cf-26657acabe20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:40.461906 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8c1d1-6fb2-462c-b3cf-26657acabe20 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:40.462196 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8c1d1-6fb2-462c-b3cf-26657acabe20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:40.462478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8c1d1-6fb2-462c-b3cf-26657acabe20 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:40.463214 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8c1d1-6fb2-462c-b3cf-26657acabe20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:52:40.467283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8c1d1-6fb2-462c-b3cf-26657acabe20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:40.467283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8c1d1-6fb2-462c-b3cf-26657acabe20 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:40.485279 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1102/2209] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:52:40.487481 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340031a1-8e22-43ec-88f5-90d99d6f78eb None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:40.489694 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8c1d1-6fb2-462c-b3cf-26657acabe20 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:40.491810 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77d308-441f-4e9d-b13e-17cec1174f3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:40.492624 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77d308-441f-4e9d-b13e-17cec1174f3b service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:40.493099 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77d308-441f-4e9d-b13e-17cec1174f3b service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:40.493380 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77d308-441f-4e9d-b13e-17cec1174f3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:40.502484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8c1d1-6fb2-462c-b3cf-26657acabe20 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:40.514258 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1124b7-9553-4f86-9304-7e2d761cfbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:40.515021 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1124b7-9553-4f86-9304-7e2d761cfbe8 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:40.515396 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1124b7-9553-4f86-9304-7e2d761cfbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:40.515730 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1124b7-9553-4f86-9304-7e2d761cfbe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:40.516438 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1124b7-9553-4f86-9304-7e2d761cfbe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:40.518946 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1124b7-9553-4f86-9304-7e2d761cfbe8 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:40.521063 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77d308-441f-4e9d-b13e-17cec1174f3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:40.524187 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77d308-441f-4e9d-b13e-17cec1174f3b service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:40.536092 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1108/2210] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:52:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:52:40.596766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1103/2211] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:52:40 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:52:40.600719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77d308-441f-4e9d-b13e-17cec1174f3b service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:40.612980 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77d308-441f-4e9d-b13e-17cec1174f3b service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:40.676013 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c4348-68e1-4bf0-89b8-2bc9ed306740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:40.676758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c4348-68e1-4bf0-89b8-2bc9ed306740 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:40.677044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c4348-68e1-4bf0-89b8-2bc9ed306740 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:40.677319 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c4348-68e1-4bf0-89b8-2bc9ed306740 admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:40.678086 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c4348-68e1-4bf0-89b8-2bc9ed306740 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:40.680816 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c4348-68e1-4bf0-89b8-2bc9ed306740 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:40.776393 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1109/2212] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:52:40 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:52:40.781650 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1124b7-9553-4f86-9304-7e2d761cfbe8 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:40.793042 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1124b7-9553-4f86-9304-7e2d761cfbe8 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:40.801031 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cea57-c50f-4b33-a8a5-1a680bf10fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:40.801866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cea57-c50f-4b33-a8a5-1a680bf10fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:40.802317 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cea57-c50f-4b33-a8a5-1a680bf10fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:40.803300 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cea57-c50f-4b33-a8a5-1a680bf10fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:40.804388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33cea57-c50f-4b33-a8a5-1a680bf10fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:40.807109 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33cea57-c50f-4b33-a8a5-1a680bf10fa1 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:40.823442 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1104/2213] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:52:40.829043 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c4348-68e1-4bf0-89b8-2bc9ed306740 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:40.846136 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c4348-68e1-4bf0-89b8-2bc9ed306740 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:40.851337 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e56aca-b35a-4a06-917c-7b1f04ad34d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:40.852045 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e56aca-b35a-4a06-917c-7b1f04ad34d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:40.852334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e56aca-b35a-4a06-917c-7b1f04ad34d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:40.852612 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e56aca-b35a-4a06-917c-7b1f04ad34d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:40.853450 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e56aca-b35a-4a06-917c-7b1f04ad34d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:40.855163 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e56aca-b35a-4a06-917c-7b1f04ad34d1 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:40.867939 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1110/2214] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:40.872672 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cea57-c50f-4b33-a8a5-1a680bf10fa1 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:40.885304 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cea57-c50f-4b33-a8a5-1a680bf10fa1 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:40.891544 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66562d-390e-49ef-9ead-897dc35ba88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:40.892360 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66562d-390e-49ef-9ead-897dc35ba88f admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:40.892648 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66562d-390e-49ef-9ead-897dc35ba88f admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:40.892962 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66562d-390e-49ef-9ead-897dc35ba88f admin admin] PATH_INFO: `/v3/projects/85fe1e21c87f4daea07c283b0545f041/users/45fef5bf7c914f538eb1bf71623524fd/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:40.912618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66562d-390e-49ef-9ead-897dc35ba88f admin admin] RBAC: Authorizing `identity:create_grant(project_id=85fe1e21c87f4daea07c283b0545f041, user_id=45fef5bf7c914f538eb1bf71623524fd, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:40.916303 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66562d-390e-49ef-9ead-897dc35ba88f admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:41.045564 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1105/2215] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:52:40 2022] PUT /identity/v3/projects/85fe1e21c87f4daea07c283b0545f041/users/45fef5bf7c914f538eb1bf71623524fd/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:41.050688 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72532d-5149-491d-9ccb-6c39c80fc3d7 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:41.050979 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72532d-5149-491d-9ccb-6c39c80fc3d7 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:41.051264 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72532d-5149-491d-9ccb-6c39c80fc3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:41.066157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66562d-390e-49ef-9ead-897dc35ba88f admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:41.068025 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-cb66562d-390e-49ef-9ead-897dc35ba88f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:41.080641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-7b72532d-5149-491d-9ccb-6c39c80fc3d7 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:41.080641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-7b72532d-5149-491d-9ccb-6c39c80fc3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:41.148181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66562d-390e-49ef-9ead-897dc35ba88f admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:41.154020 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d4373-8d13-43e8-930a-baa34bca98a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:41.155353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d4373-8d13-43e8-930a-baa34bca98a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:41.155825 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d4373-8d13-43e8-930a-baa34bca98a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:41.156154 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d4373-8d13-43e8-930a-baa34bca98a0 admin admin] PATH_INFO: `/v3/projects/67883426f2bd4e4386ff067fb809f76d` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:41.157710 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d4373-8d13-43e8-930a-baa34bca98a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67883426f2bd4e4386ff067fb809f76d)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:41.158481 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1111/2216] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:52:41.160648 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d4373-8d13-43e8-930a-baa34bca98a0 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:41.162513 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:41.169679 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72532d-5149-491d-9ccb-6c39c80fc3d7 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:41.184065 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:41.233786 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72532d-5149-491d-9ccb-6c39c80fc3d7 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:41.238592 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf67ce-da0d-464d-a435-4bedd4f44eb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:41.239360 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf67ce-da0d-464d-a435-4bedd4f44eb2 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:41.239942 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf67ce-da0d-464d-a435-4bedd4f44eb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:41.240234 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf67ce-da0d-464d-a435-4bedd4f44eb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:41.252412 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf67ce-da0d-464d-a435-4bedd4f44eb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:41.252888 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-277d4373-8d13-43e8-930a-baa34bca98a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67883426f2bd4e4386ff067fb809f76d', 'request_id': 'req-277d4373-8d13-43e8-930a-baa34bca98a0'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:41.253865 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf67ce-da0d-464d-a435-4bedd4f44eb2 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:41.267166 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-277d4373-8d13-43e8-930a-baa34bca98a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67883426f2bd4e4386ff067fb809f76d', 'request_id': 'req-277d4373-8d13-43e8-930a-baa34bca98a0'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:41.275557 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-277d4373-8d13-43e8-930a-baa34bca98a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67883426f2bd4e4386ff067fb809f76d', 'request_id': 'req-277d4373-8d13-43e8-930a-baa34bca98a0'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:41.276017 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1112/2217] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:52:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:52:41.328216 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-277d4373-8d13-43e8-930a-baa34bca98a0 admin admin] The token cache is being invalidate because project 67883426f2bd4e4386ff067fb809f76d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:52:41.328757 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-277d4373-8d13-43e8-930a-baa34bca98a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:41.329685 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-277d4373-8d13-43e8-930a-baa34bca98a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:41.331908 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1106/2218] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:52:41 2022] DELETE /identity/v3/projects/67883426f2bd4e4386ff067fb809f76d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:41.336716 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf67ce-da0d-464d-a435-4bedd4f44eb2 service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:41.351850 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf67ce-da0d-464d-a435-4bedd4f44eb2 service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:41.429002 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d42eb1-c6a4-4d3d-9530-e46e01c7d118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:41.430022 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d42eb1-c6a4-4d3d-9530-e46e01c7d118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:41.430313 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d42eb1-c6a4-4d3d-9530-e46e01c7d118 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:41.430595 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d42eb1-c6a4-4d3d-9530-e46e01c7d118 admin admin] PATH_INFO: `/v3/users/b37a1135512f42ab8d55a1f276eccc5d` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:41.432178 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d42eb1-c6a4-4d3d-9530-e46e01c7d118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b37a1135512f42ab8d55a1f276eccc5d)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:41.434557 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d42eb1-c6a4-4d3d-9530-e46e01c7d118 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:41.614063 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-31d42eb1-c6a4-4d3d-9530-e46e01c7d118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b37a1135512f42ab8d55a1f276eccc5d'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:41.616413 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-31d42eb1-c6a4-4d3d-9530-e46e01c7d118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b37a1135512f42ab8d55a1f276eccc5d'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:41.617118 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-31d42eb1-c6a4-4d3d-9530-e46e01c7d118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b37a1135512f42ab8d55a1f276eccc5d'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:41.633164 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-31d42eb1-c6a4-4d3d-9530-e46e01c7d118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b37a1135512f42ab8d55a1f276eccc5d'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:41.684011 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-31d42eb1-c6a4-4d3d-9530-e46e01c7d118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b37a1135512f42ab8d55a1f276eccc5d'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:41.714474 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1113/2219] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:52:41 2022] DELETE /identity/v3/users/b37a1135512f42ab8d55a1f276eccc5d => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:42.549037 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d4373-8d13-43e8-930a-baa34bca98a0 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:42.550450 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-277d4373-8d13-43e8-930a-baa34bca98a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:42.564420 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d4373-8d13-43e8-930a-baa34bca98a0 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:42.626361 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e4136-9387-47ac-9e83-39bdf2d2a54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:42.627358 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e4136-9387-47ac-9e83-39bdf2d2a54a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:42.627682 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e4136-9387-47ac-9e83-39bdf2d2a54a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:42.628019 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e4136-9387-47ac-9e83-39bdf2d2a54a admin admin] PATH_INFO: `/v3/projects/d614e7cc5c584d60bc07bda236a92844` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:42.629300 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e4136-9387-47ac-9e83-39bdf2d2a54a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d614e7cc5c584d60bc07bda236a92844)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:42.631197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e4136-9387-47ac-9e83-39bdf2d2a54a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:42.808143 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f96e4136-9387-47ac-9e83-39bdf2d2a54a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd614e7cc5c584d60bc07bda236a92844', 'request_id': 'req-f96e4136-9387-47ac-9e83-39bdf2d2a54a'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:42.817457 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f96e4136-9387-47ac-9e83-39bdf2d2a54a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd614e7cc5c584d60bc07bda236a92844', 'request_id': 'req-f96e4136-9387-47ac-9e83-39bdf2d2a54a'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:42.823299 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54d557-2bfd-490a-b3ff-5969424e8495 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:42.823823 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54d557-2bfd-490a-b3ff-5969424e8495 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:42.824085 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54d557-2bfd-490a-b3ff-5969424e8495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:42.839145 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f96e4136-9387-47ac-9e83-39bdf2d2a54a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd614e7cc5c584d60bc07bda236a92844', 'request_id': 'req-f96e4136-9387-47ac-9e83-39bdf2d2a54a'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:42.859161 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-fa54d557-2bfd-490a-b3ff-5969424e8495 None None] MFA Rules not processed for user `45fef5bf7c914f538eb1bf71623524fd`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:42.860574 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-fa54d557-2bfd-490a-b3ff-5969424e8495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:42.887466 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:42.902568 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f96e4136-9387-47ac-9e83-39bdf2d2a54a admin admin] The token cache is being invalidate because project d614e7cc5c584d60bc07bda236a92844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:52:42.902863 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f96e4136-9387-47ac-9e83-39bdf2d2a54a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:42.905962 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f96e4136-9387-47ac-9e83-39bdf2d2a54a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:42.907657 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1107/2220] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:52:42 2022] DELETE /identity/v3/projects/d614e7cc5c584d60bc07bda236a92844 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:42.913557 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e01bb-f361-449d-be49-b590c347a1b2 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:42.913961 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e01bb-f361-449d-be49-b590c347a1b2 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:42.914389 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e01bb-f361-449d-be49-b590c347a1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:42.944194 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-656e01bb-f361-449d-be49-b590c347a1b2 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:42.945829 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-656e01bb-f361-449d-be49-b590c347a1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:42.951656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1114/2221] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:52:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:42.960885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54d557-2bfd-490a-b3ff-5969424e8495 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:42.962807 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-fa54d557-2bfd-490a-b3ff-5969424e8495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:42.968799 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:43.021710 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1108/2222] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:43.030532 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9b03d-7271-4109-94d4-75d45ab440a4 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:43.030820 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9b03d-7271-4109-94d4-75d45ab440a4 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:43.031168 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9b03d-7271-4109-94d4-75d45ab440a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:43.032721 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54d557-2bfd-490a-b3ff-5969424e8495 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:43.043539 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11aff6-1545-41ef-a29d-ac4b6638cd30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:43.043539 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11aff6-1545-41ef-a29d-ac4b6638cd30 service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:43.043539 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11aff6-1545-41ef-a29d-ac4b6638cd30 service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:43.043539 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11aff6-1545-41ef-a29d-ac4b6638cd30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:43.052204 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11aff6-1545-41ef-a29d-ac4b6638cd30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:43.053712 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11aff6-1545-41ef-a29d-ac4b6638cd30 service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:43.055075 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-2fc9b03d-7271-4109-94d4-75d45ab440a4 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:43.056349 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-2fc9b03d-7271-4109-94d4-75d45ab440a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:43.064386 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1115/2223] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:52:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:52:43.069017 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1109/2224] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:52:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:43.073443 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11aff6-1545-41ef-a29d-ac4b6638cd30 service cinder] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:43.084742 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11aff6-1545-41ef-a29d-ac4b6638cd30 service cinder] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:43.090768 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d15fa2-04dd-448f-85ea-02c18da4a086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:43.097926 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d15fa2-04dd-448f-85ea-02c18da4a086 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:43.097926 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d15fa2-04dd-448f-85ea-02c18da4a086 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:43.097926 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d15fa2-04dd-448f-85ea-02c18da4a086 admin admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:43.097926 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d15fa2-04dd-448f-85ea-02c18da4a086 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:52:43.097926 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d15fa2-04dd-448f-85ea-02c18da4a086 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:43.097926 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d15fa2-04dd-448f-85ea-02c18da4a086 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:43.113681 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1116/2225] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:52:43.118322 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9b03d-7271-4109-94d4-75d45ab440a4 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:43.130636 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9b03d-7271-4109-94d4-75d45ab440a4 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:43.138854 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b44faec-8ce6-4e36-89be-6bfa51425527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:43.139732 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44faec-8ce6-4e36-89be-6bfa51425527 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:43.140019 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44faec-8ce6-4e36-89be-6bfa51425527 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:43.140323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44faec-8ce6-4e36-89be-6bfa51425527 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:43.141005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b44faec-8ce6-4e36-89be-6bfa51425527 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:43.142921 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b44faec-8ce6-4e36-89be-6bfa51425527 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:43.213689 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1110/2226] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:52:43 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:52:43.218696 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d15fa2-04dd-448f-85ea-02c18da4a086 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:43.230073 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d15fa2-04dd-448f-85ea-02c18da4a086 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:43.331900 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed3aa4-8863-43c9-bcaf-94d95de9df04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:43.332706 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed3aa4-8863-43c9-bcaf-94d95de9df04 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:43.333051 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed3aa4-8863-43c9-bcaf-94d95de9df04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:43.339754 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed3aa4-8863-43c9-bcaf-94d95de9df04 admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:43.339754 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed3aa4-8863-43c9-bcaf-94d95de9df04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:43.339754 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed3aa4-8863-43c9-bcaf-94d95de9df04 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:43.418096 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1117/2227] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:52:43 2022] POST /identity/v3/users => generated 294 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:52:43.421876 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b44faec-8ce6-4e36-89be-6bfa51425527 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:43.433003 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b44faec-8ce6-4e36-89be-6bfa51425527 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:43.438623 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15cbb83-d27d-4156-8735-e3b19a2fed7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:43.439377 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cbb83-d27d-4156-8735-e3b19a2fed7e admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:43.439924 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cbb83-d27d-4156-8735-e3b19a2fed7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:43.440213 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cbb83-d27d-4156-8735-e3b19a2fed7e admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:43.440969 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15cbb83-d27d-4156-8735-e3b19a2fed7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:43.442705 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15cbb83-d27d-4156-8735-e3b19a2fed7e admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:43.458373 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1111/2228] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:52:43.459558 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed3aa4-8863-43c9-bcaf-94d95de9df04 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:43.470881 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed3aa4-8863-43c9-bcaf-94d95de9df04 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:43.476034 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7d07f-37ad-4b77-b139-0449f25cc3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:43.476839 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7d07f-37ad-4b77-b139-0449f25cc3bd admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:43.477247 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7d07f-37ad-4b77-b139-0449f25cc3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:43.477595 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7d07f-37ad-4b77-b139-0449f25cc3bd admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:43.478354 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee7d07f-37ad-4b77-b139-0449f25cc3bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:43.480003 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee7d07f-37ad-4b77-b139-0449f25cc3bd admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:43.493060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1118/2229] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:43.498006 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15cbb83-d27d-4156-8735-e3b19a2fed7e admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:43.508451 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15cbb83-d27d-4156-8735-e3b19a2fed7e admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:43.513920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa76ae-d268-48cf-b0b2-7af796b0c85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:43.514822 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa76ae-d268-48cf-b0b2-7af796b0c85f admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:43.515182 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa76ae-d268-48cf-b0b2-7af796b0c85f admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:43.515497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa76ae-d268-48cf-b0b2-7af796b0c85f admin admin] PATH_INFO: `/v3/projects/4ca5f44c37ec4edbb7997cd7b9225b99/users/69e2e651085c4861a8511ac00dd2b485/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:43.533542 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa76ae-d268-48cf-b0b2-7af796b0c85f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ca5f44c37ec4edbb7997cd7b9225b99, user_id=69e2e651085c4861a8511ac00dd2b485, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:43.536260 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa76ae-d268-48cf-b0b2-7af796b0c85f admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:43.640847 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1112/2230] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:52:43 2022] PUT /identity/v3/projects/4ca5f44c37ec4edbb7997cd7b9225b99/users/69e2e651085c4861a8511ac00dd2b485/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:43.652621 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939af2f-3f23-490c-a0a2-e61e4a84af93 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:43.652904 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939af2f-3f23-490c-a0a2-e61e4a84af93 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:43.653235 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939af2f-3f23-490c-a0a2-e61e4a84af93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:43.683557 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-1939af2f-3f23-490c-a0a2-e61e4a84af93 None None] MFA Rules not processed for user `69e2e651085c4861a8511ac00dd2b485`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:43.685703 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-1939af2f-3f23-490c-a0a2-e61e4a84af93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:43.714911 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:43.769280 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1119/2231] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:52:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:43.774859 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa76ae-d268-48cf-b0b2-7af796b0c85f admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:43.858309 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa76ae-d268-48cf-b0b2-7af796b0c85f admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:43.866623 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7067c-b546-4e7a-bbcd-5baf05d1ad8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:43.867296 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7067c-b546-4e7a-bbcd-5baf05d1ad8a admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:43.867581 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7067c-b546-4e7a-bbcd-5baf05d1ad8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:43.867891 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7067c-b546-4e7a-bbcd-5baf05d1ad8a admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:43.868645 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7067c-b546-4e7a-bbcd-5baf05d1ad8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:43.870581 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7067c-b546-4e7a-bbcd-5baf05d1ad8a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:44.007832 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1113/2232] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:52:43 2022] POST /identity/v3/projects => generated 387 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:52:44.011013 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939af2f-3f23-490c-a0a2-e61e4a84af93 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:44.021951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939af2f-3f23-490c-a0a2-e61e4a84af93 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:44.083220 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b36c7-21bb-4481-97d6-3aa5bb5b851e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:44.083937 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b36c7-21bb-4481-97d6-3aa5bb5b851e admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:44.084220 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b36c7-21bb-4481-97d6-3aa5bb5b851e admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:44.084496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b36c7-21bb-4481-97d6-3aa5bb5b851e admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:44.089382 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b36c7-21bb-4481-97d6-3aa5bb5b851e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:44.089382 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b36c7-21bb-4481-97d6-3aa5bb5b851e admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:44.199146 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1120/2233] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:52:44 2022] POST /identity/v3/users => generated 294 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:52:44.203180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7067c-b546-4e7a-bbcd-5baf05d1ad8a admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:44.213566 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7067c-b546-4e7a-bbcd-5baf05d1ad8a admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:44.219367 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ee4c3-3004-4525-bccc-077c45907505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:44.220079 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ee4c3-3004-4525-bccc-077c45907505 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:44.220364 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ee4c3-3004-4525-bccc-077c45907505 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:44.220639 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ee4c3-3004-4525-bccc-077c45907505 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:44.221379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ee4c3-3004-4525-bccc-077c45907505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:44.223039 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ee4c3-3004-4525-bccc-077c45907505 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:44.236385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1114/2234] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:44.240477 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b36c7-21bb-4481-97d6-3aa5bb5b851e admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:44.250840 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b36c7-21bb-4481-97d6-3aa5bb5b851e admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:44.255422 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cc242-1736-4855-ac25-4d8d45c9311b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:44.256108 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cc242-1736-4855-ac25-4d8d45c9311b admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:44.256384 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cc242-1736-4855-ac25-4d8d45c9311b admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:44.256656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cc242-1736-4855-ac25-4d8d45c9311b admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:44.257386 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cc242-1736-4855-ac25-4d8d45c9311b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:44.258974 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cc242-1736-4855-ac25-4d8d45c9311b admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:44.269828 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1121/2235] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:44.274086 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ee4c3-3004-4525-bccc-077c45907505 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:44.285905 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ee4c3-3004-4525-bccc-077c45907505 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:44.291276 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945f09d-ebbb-456b-95e2-e043cf5ef7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:44.292261 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945f09d-ebbb-456b-95e2-e043cf5ef7e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:44.292540 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945f09d-ebbb-456b-95e2-e043cf5ef7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:44.292814 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945f09d-ebbb-456b-95e2-e043cf5ef7e9 admin admin] PATH_INFO: `/v3/projects/5af1739210ad4274a4527d910abe77d0/users/6e141bd1468d428d9b39b13667a39e0f/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:44.310686 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945f09d-ebbb-456b-95e2-e043cf5ef7e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5af1739210ad4274a4527d910abe77d0, user_id=6e141bd1468d428d9b39b13667a39e0f, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:44.313356 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945f09d-ebbb-456b-95e2-e043cf5ef7e9 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:44.381420 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1115/2236] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:52:44 2022] PUT /identity/v3/projects/5af1739210ad4274a4527d910abe77d0/users/6e141bd1468d428d9b39b13667a39e0f/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:52:44.393456 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35871342-60d8-4314-a39d-8e2b15825bde None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:44.393774 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35871342-60d8-4314-a39d-8e2b15825bde None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:44.394055 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35871342-60d8-4314-a39d-8e2b15825bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:44.427853 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-35871342-60d8-4314-a39d-8e2b15825bde None None] MFA Rules not processed for user `6e141bd1468d428d9b39b13667a39e0f`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:44.429260 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-35871342-60d8-4314-a39d-8e2b15825bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:44.495393 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1122/2237] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:52:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:52:44.500083 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945f09d-ebbb-456b-95e2-e043cf5ef7e9 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:44.510065 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:44.568839 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945f09d-ebbb-456b-95e2-e043cf5ef7e9 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:44.573584 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff33db-f3e0-4b40-a0df-9b123698a6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:44.574285 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff33db-f3e0-4b40-a0df-9b123698a6d7 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:44.574578 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff33db-f3e0-4b40-a0df-9b123698a6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:44.574849 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff33db-f3e0-4b40-a0df-9b123698a6d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:44.576654 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff33db-f3e0-4b40-a0df-9b123698a6d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:44.578251 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff33db-f3e0-4b40-a0df-9b123698a6d7 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:44.708571 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1116/2238] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:52:44 2022] POST /identity/v3/projects => generated 387 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:52:44.713028 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35871342-60d8-4314-a39d-8e2b15825bde None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:44.725017 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35871342-60d8-4314-a39d-8e2b15825bde None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:44.757092 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:44.786098 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c49cb4-a671-4c1c-b4dc-2161ae1da91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:44.786790 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c49cb4-a671-4c1c-b4dc-2161ae1da91e admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:44.787080 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c49cb4-a671-4c1c-b4dc-2161ae1da91e admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:44.787411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c49cb4-a671-4c1c-b4dc-2161ae1da91e admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:44.788216 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c49cb4-a671-4c1c-b4dc-2161ae1da91e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:44.790169 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c49cb4-a671-4c1c-b4dc-2161ae1da91e admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:45.193215 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1123/2239] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:52:44 2022] POST /identity/v3/users => generated 300 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:52:45.200499 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff33db-f3e0-4b40-a0df-9b123698a6d7 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:45.211104 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff33db-f3e0-4b40-a0df-9b123698a6d7 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:45.216491 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fab59-dea5-49e9-9d14-6f6b8cc94332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:45.217160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fab59-dea5-49e9-9d14-6f6b8cc94332 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:45.217449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fab59-dea5-49e9-9d14-6f6b8cc94332 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:45.217732 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fab59-dea5-49e9-9d14-6f6b8cc94332 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:45.218473 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0fab59-dea5-49e9-9d14-6f6b8cc94332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:45.220180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0fab59-dea5-49e9-9d14-6f6b8cc94332 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:45.230988 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1117/2240] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:45.236173 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c49cb4-a671-4c1c-b4dc-2161ae1da91e admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:45.246636 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c49cb4-a671-4c1c-b4dc-2161ae1da91e admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:45.251492 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80468e47-7354-4a5a-bbb9-6f619cd254e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:45.252633 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80468e47-7354-4a5a-bbb9-6f619cd254e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:45.252923 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80468e47-7354-4a5a-bbb9-6f619cd254e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:45.253206 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80468e47-7354-4a5a-bbb9-6f619cd254e7 admin admin] PATH_INFO: `/v3/projects/7788de7cd526404c85f5256b45da2589/users/28355a96b87c49f28d85ae13a1b0b988/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:45.269293 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80468e47-7354-4a5a-bbb9-6f619cd254e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7788de7cd526404c85f5256b45da2589, user_id=28355a96b87c49f28d85ae13a1b0b988, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:45.273071 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80468e47-7354-4a5a-bbb9-6f619cd254e7 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:45.461603 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1124/2241] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:52:45 2022] PUT /identity/v3/projects/7788de7cd526404c85f5256b45da2589/users/28355a96b87c49f28d85ae13a1b0b988/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:45.466403 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fab59-dea5-49e9-9d14-6f6b8cc94332 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:45.476596 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fab59-dea5-49e9-9d14-6f6b8cc94332 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:45.538538 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0bdfb-9a29-431e-9b75-e2f0512ec9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:45.539221 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0bdfb-9a29-431e-9b75-e2f0512ec9ea admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:45.539510 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0bdfb-9a29-431e-9b75-e2f0512ec9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:45.539824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0bdfb-9a29-431e-9b75-e2f0512ec9ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:45.540599 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0bdfb-9a29-431e-9b75-e2f0512ec9ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:45.542192 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0bdfb-9a29-431e-9b75-e2f0512ec9ea admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:45.553099 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1118/2242] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:52:45.557664 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80468e47-7354-4a5a-bbb9-6f619cd254e7 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:45.568903 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80468e47-7354-4a5a-bbb9-6f619cd254e7 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:45.573683 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768e213-5382-4e2d-b475-49c3c55d6f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:45.574595 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768e213-5382-4e2d-b475-49c3c55d6f9e admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:45.574880 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768e213-5382-4e2d-b475-49c3c55d6f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:45.575368 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768e213-5382-4e2d-b475-49c3c55d6f9e admin admin] PATH_INFO: `/v3/projects/7788de7cd526404c85f5256b45da2589/users/28355a96b87c49f28d85ae13a1b0b988/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:45.577376 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b768e213-5382-4e2d-b475-49c3c55d6f9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7788de7cd526404c85f5256b45da2589, user_id=28355a96b87c49f28d85ae13a1b0b988, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:45.580124 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b768e213-5382-4e2d-b475-49c3c55d6f9e admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:45.590878 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1125/2243] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:52:45 2022] PUT /identity/v3/projects/7788de7cd526404c85f5256b45da2589/users/28355a96b87c49f28d85ae13a1b0b988/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:45.602353 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd9120-f6ce-4260-8141-870550b19981 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:45.602654 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd9120-f6ce-4260-8141-870550b19981 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:45.602941 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd9120-f6ce-4260-8141-870550b19981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:45.634096 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-d6dd9120-f6ce-4260-8141-870550b19981 None None] MFA Rules not processed for user `28355a96b87c49f28d85ae13a1b0b988`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:45.635381 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d6dd9120-f6ce-4260-8141-870550b19981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:45.717659 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1119/2244] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:52:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:45.734422 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768e213-5382-4e2d-b475-49c3c55d6f9e admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:45.736177 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-b768e213-5382-4e2d-b475-49c3c55d6f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:45.797759 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768e213-5382-4e2d-b475-49c3c55d6f9e admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:45.801499 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0e94f-d6e6-4aac-9ecc-690dd8b1a6ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:45.802157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0e94f-d6e6-4aac-9ecc-690dd8b1a6ac service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:45.802459 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0e94f-d6e6-4aac-9ecc-690dd8b1a6ac service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:45.802750 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0e94f-d6e6-4aac-9ecc-690dd8b1a6ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:45.813361 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0e94f-d6e6-4aac-9ecc-690dd8b1a6ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:45.814864 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0e94f-d6e6-4aac-9ecc-690dd8b1a6ac service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:45.826035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1126/2245] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:52:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:52:47.084967 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd9120-f6ce-4260-8141-870550b19981 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:47.089808 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:47.096192 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd9120-f6ce-4260-8141-870550b19981 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:47.099962 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19a2fc-1917-4ace-9ad5-4718aafb8204 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:47.100608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19a2fc-1917-4ace-9ad5-4718aafb8204 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:47.100893 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19a2fc-1917-4ace-9ad5-4718aafb8204 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:47.101243 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19a2fc-1917-4ace-9ad5-4718aafb8204 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:47.167148 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19a2fc-1917-4ace-9ad5-4718aafb8204 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:47.170204 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19a2fc-1917-4ace-9ad5-4718aafb8204 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:47.188150 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1120/2246] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:52:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:52:53.315063 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9a80b-92d6-44bb-8b48-3a9536adee8b None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:53.315587 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9a80b-92d6-44bb-8b48-3a9536adee8b None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:53.315587 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9a80b-92d6-44bb-8b48-3a9536adee8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:53.334189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-c0f9a80b-92d6-44bb-8b48-3a9536adee8b None None] MFA Rules not processed for user `45fef5bf7c914f538eb1bf71623524fd`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:53.335387 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-c0f9a80b-92d6-44bb-8b48-3a9536adee8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:53.390778 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1127/2247] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:52:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:57.240472 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=27 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:57.601356 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19a2fc-1917-4ace-9ad5-4718aafb8204 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:57.603118 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-ab19a2fc-1917-4ace-9ad5-4718aafb8204 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:57.604110 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9a80b-92d6-44bb-8b48-3a9536adee8b None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:57.614568 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9a80b-92d6-44bb-8b48-3a9536adee8b None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:57.619037 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace5639-b824-4bcc-80eb-d3fcc7e95c42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:57.619760 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace5639-b824-4bcc-80eb-d3fcc7e95c42 service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:57.620049 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace5639-b824-4bcc-80eb-d3fcc7e95c42 service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:57.620392 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace5639-b824-4bcc-80eb-d3fcc7e95c42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:57.653907 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:57.674922 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19a2fc-1917-4ace-9ad5-4718aafb8204 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:57.678676 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08810ea2-a9a7-4c2c-987d-dc34c65c1884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:57.679161 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08810ea2-a9a7-4c2c-987d-dc34c65c1884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:57.679460 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08810ea2-a9a7-4c2c-987d-dc34c65c1884 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:57.679773 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08810ea2-a9a7-4c2c-987d-dc34c65c1884 admin admin] PATH_INFO: `/v3/users/f077aa13553943a09bd1f95a678a11c8` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:57.681085 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08810ea2-a9a7-4c2c-987d-dc34c65c1884 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f077aa13553943a09bd1f95a678a11c8)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:57.682949 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08810ea2-a9a7-4c2c-987d-dc34c65c1884 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:57.690567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace5639-b824-4bcc-80eb-d3fcc7e95c42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:57.692362 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace5639-b824-4bcc-80eb-d3fcc7e95c42 service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:57.706243 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1128/2248] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:52:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:52:58.032931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-08810ea2-a9a7-4c2c-987d-dc34c65c1884 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f077aa13553943a09bd1f95a678a11c8'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:58.033702 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-08810ea2-a9a7-4c2c-987d-dc34c65c1884 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f077aa13553943a09bd1f95a678a11c8'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:58.042209 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-08810ea2-a9a7-4c2c-987d-dc34c65c1884 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f077aa13553943a09bd1f95a678a11c8'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:58.042949 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-08810ea2-a9a7-4c2c-987d-dc34c65c1884 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f077aa13553943a09bd1f95a678a11c8'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:58.146290 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-08810ea2-a9a7-4c2c-987d-dc34c65c1884 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f077aa13553943a09bd1f95a678a11c8'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:58.169388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1121/2249] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:52:57 2022] DELETE /identity/v3/users/f077aa13553943a09bd1f95a678a11c8 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:52:58.174205 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413d98e-cb2a-4b41-ad3f-45418374271f None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:58.174492 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413d98e-cb2a-4b41-ad3f-45418374271f None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:58.174817 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413d98e-cb2a-4b41-ad3f-45418374271f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:58.203655 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-b413d98e-cb2a-4b41-ad3f-45418374271f None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:58.205595 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-b413d98e-cb2a-4b41-ad3f-45418374271f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:58.286849 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1129/2250] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:58.297628 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08810ea2-a9a7-4c2c-987d-dc34c65c1884 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:58.299103 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-08810ea2-a9a7-4c2c-987d-dc34c65c1884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:58.360522 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08810ea2-a9a7-4c2c-987d-dc34c65c1884 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:58.364329 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63569b99-1433-4256-b1d8-8e32c9f206f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:58.364981 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63569b99-1433-4256-b1d8-8e32c9f206f3 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:58.365267 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63569b99-1433-4256-b1d8-8e32c9f206f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:58.365601 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63569b99-1433-4256-b1d8-8e32c9f206f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:58.375691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63569b99-1433-4256-b1d8-8e32c9f206f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:58.377124 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63569b99-1433-4256-b1d8-8e32c9f206f3 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:58.387920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1122/2251] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:52:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:52:59.076052 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413d98e-cb2a-4b41-ad3f-45418374271f None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:59.079751 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-b413d98e-cb2a-4b41-ad3f-45418374271f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:59.097373 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413d98e-cb2a-4b41-ad3f-45418374271f None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:59.104626 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa46fb-07cc-4a49-b32b-dcca1b1f51ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:59.104910 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa46fb-07cc-4a49-b32b-dcca1b1f51ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:59.105138 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa46fb-07cc-4a49-b32b-dcca1b1f51ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:59.105436 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa46fb-07cc-4a49-b32b-dcca1b1f51ab admin admin] PATH_INFO: `/v3/projects/78cc9a5023834c0893a1bdb2250cae8a` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:59.107336 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa46fb-07cc-4a49-b32b-dcca1b1f51ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=78cc9a5023834c0893a1bdb2250cae8a)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:59.109640 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa46fb-07cc-4a49-b32b-dcca1b1f51ab admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:59.246072 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-6efa46fb-07cc-4a49-b32b-dcca1b1f51ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78cc9a5023834c0893a1bdb2250cae8a', 'request_id': 'req-6efa46fb-07cc-4a49-b32b-dcca1b1f51ab'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:59.253576 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-6efa46fb-07cc-4a49-b32b-dcca1b1f51ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78cc9a5023834c0893a1bdb2250cae8a', 'request_id': 'req-6efa46fb-07cc-4a49-b32b-dcca1b1f51ab'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:59.260886 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-6efa46fb-07cc-4a49-b32b-dcca1b1f51ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78cc9a5023834c0893a1bdb2250cae8a', 'request_id': 'req-6efa46fb-07cc-4a49-b32b-dcca1b1f51ab'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:59.342577 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-6efa46fb-07cc-4a49-b32b-dcca1b1f51ab admin admin] The token cache is being invalidate because project 78cc9a5023834c0893a1bdb2250cae8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:52:59.343229 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-6efa46fb-07cc-4a49-b32b-dcca1b1f51ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:59.344146 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-6efa46fb-07cc-4a49-b32b-dcca1b1f51ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:52:59.347652 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1130/2252] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:52:59 2022] DELETE /identity/v3/projects/78cc9a5023834c0893a1bdb2250cae8a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:52:59.350839 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61048417-5097-4b20-904a-f5ddac2c7587 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:59.351307 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61048417-5097-4b20-904a-f5ddac2c7587 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:59.351500 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61048417-5097-4b20-904a-f5ddac2c7587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:59.381814 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-61048417-5097-4b20-904a-f5ddac2c7587 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:59.383791 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-61048417-5097-4b20-904a-f5ddac2c7587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:59.407779 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:52:59.456690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1123/2253] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:59.470767 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612578f-54d7-455d-8b8f-fd6416ca4de2 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:59.470767 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612578f-54d7-455d-8b8f-fd6416ca4de2 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:59.470767 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612578f-54d7-455d-8b8f-fd6416ca4de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:59.503798 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-6612578f-54d7-455d-8b8f-fd6416ca4de2 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:52:59.505160 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-6612578f-54d7-455d-8b8f-fd6416ca4de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:52:59.524939 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1131/2254] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:52:59.537213 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61048417-5097-4b20-904a-f5ddac2c7587 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:59.557966 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61048417-5097-4b20-904a-f5ddac2c7587 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:59.565709 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5f757-5bef-4159-bf98-972cbf30f662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:59.567267 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5f757-5bef-4159-bf98-972cbf30f662 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:59.568704 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5f757-5bef-4159-bf98-972cbf30f662 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:59.570013 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5f757-5bef-4159-bf98-972cbf30f662 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:59.571121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5f757-5bef-4159-bf98-972cbf30f662 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:52:59.571863 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5f757-5bef-4159-bf98-972cbf30f662 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:59.589285 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5f757-5bef-4159-bf98-972cbf30f662 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:59.629035 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1124/2255] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:52:59.633400 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612578f-54d7-455d-8b8f-fd6416ca4de2 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:59.653277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612578f-54d7-455d-8b8f-fd6416ca4de2 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:59.666599 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42c299-b4e1-4dae-8834-88b17c8c25ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:59.667280 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42c299-b4e1-4dae-8834-88b17c8c25ad admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:59.667563 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42c299-b4e1-4dae-8834-88b17c8c25ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:59.667954 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42c299-b4e1-4dae-8834-88b17c8c25ad admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:59.668665 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42c299-b4e1-4dae-8834-88b17c8c25ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:59.671273 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42c299-b4e1-4dae-8834-88b17c8c25ad admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:59.783883 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1132/2256] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:52:59 2022] POST /identity/v3/projects => generated 399 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:52:59.788126 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5f757-5bef-4159-bf98-972cbf30f662 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:52:59.799225 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5f757-5bef-4159-bf98-972cbf30f662 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:52:59.874942 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64706f63-71ac-4633-8639-1b83e1fd6b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:52:59.875644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64706f63-71ac-4633-8639-1b83e1fd6b96 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:52:59.885218 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64706f63-71ac-4633-8639-1b83e1fd6b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:52:59.885218 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64706f63-71ac-4633-8639-1b83e1fd6b96 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:52:59.885218 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64706f63-71ac-4633-8639-1b83e1fd6b96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:52:59.885218 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64706f63-71ac-4633-8639-1b83e1fd6b96 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:52:59.972182 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1125/2257] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:52:59 2022] POST /identity/v3/users => generated 300 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:52:59.979106 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42c299-b4e1-4dae-8834-88b17c8c25ad admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:00.000572 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42c299-b4e1-4dae-8834-88b17c8c25ad admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:00.003763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f42f1-6ec7-4255-ae4e-6cf58aef5c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:00.016796 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f42f1-6ec7-4255-ae4e-6cf58aef5c20 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:00.017439 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f42f1-6ec7-4255-ae4e-6cf58aef5c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:00.017958 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f42f1-6ec7-4255-ae4e-6cf58aef5c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:00.019182 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f42f1-6ec7-4255-ae4e-6cf58aef5c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:00.021210 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f42f1-6ec7-4255-ae4e-6cf58aef5c20 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:00.052853 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1133/2258] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:53:00.057378 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64706f63-71ac-4633-8639-1b83e1fd6b96 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:00.082160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64706f63-71ac-4633-8639-1b83e1fd6b96 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:00.088174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c509270-1002-4f86-9c6c-44aa3b195860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:00.089510 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c509270-1002-4f86-9c6c-44aa3b195860 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:00.089962 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c509270-1002-4f86-9c6c-44aa3b195860 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:00.090394 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c509270-1002-4f86-9c6c-44aa3b195860 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:00.092687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c509270-1002-4f86-9c6c-44aa3b195860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:00.094782 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c509270-1002-4f86-9c6c-44aa3b195860 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:00.107729 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1126/2259] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:53:00.112103 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f42f1-6ec7-4255-ae4e-6cf58aef5c20 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:00.143422 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f42f1-6ec7-4255-ae4e-6cf58aef5c20 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:00.161373 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68713565-a745-41ea-9285-15aca34d7bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:00.162743 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68713565-a745-41ea-9285-15aca34d7bef admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:00.163218 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68713565-a745-41ea-9285-15aca34d7bef admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:00.163728 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68713565-a745-41ea-9285-15aca34d7bef admin admin] PATH_INFO: `/v3/projects/3db9d7e560c540bcad5461030ea8895c/users/34d1c7a7359441eaa93fc1bcbe98dc75/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:00.191232 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:00.204885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68713565-a745-41ea-9285-15aca34d7bef admin admin] RBAC: Authorizing `identity:create_grant(project_id=3db9d7e560c540bcad5461030ea8895c, user_id=34d1c7a7359441eaa93fc1bcbe98dc75, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:00.207982 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68713565-a745-41ea-9285-15aca34d7bef admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:00.315450 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1134/2260] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:53:00 2022] PUT /identity/v3/projects/3db9d7e560c540bcad5461030ea8895c/users/34d1c7a7359441eaa93fc1bcbe98dc75/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:53:00.412402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c54c4-3d8b-47d6-bd24-3a113f43f519 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:00.413972 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c54c4-3d8b-47d6-bd24-3a113f43f519 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:00.414808 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c54c4-3d8b-47d6-bd24-3a113f43f519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:00.447831 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-a33c54c4-3d8b-47d6-bd24-3a113f43f519 None None] MFA Rules not processed for user `34d1c7a7359441eaa93fc1bcbe98dc75`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:53:00.449172 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a33c54c4-3d8b-47d6-bd24-3a113f43f519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:00.525832 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1127/2261] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:53:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:53:00.539676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68713565-a745-41ea-9285-15aca34d7bef admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:00.541371 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-68713565-a745-41ea-9285-15aca34d7bef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:00.603756 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68713565-a745-41ea-9285-15aca34d7bef admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:00.608566 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77672d66-81f3-4b96-8c9b-8d819cd1b9da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:00.609253 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77672d66-81f3-4b96-8c9b-8d819cd1b9da service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:00.609541 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77672d66-81f3-4b96-8c9b-8d819cd1b9da service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:00.609804 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77672d66-81f3-4b96-8c9b-8d819cd1b9da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:00.619090 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77672d66-81f3-4b96-8c9b-8d819cd1b9da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:00.620631 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77672d66-81f3-4b96-8c9b-8d819cd1b9da service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:00.631304 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1135/2262] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:53:00 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:53:02.316923 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c54c4-3d8b-47d6-bd24-3a113f43f519 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:02.318359 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a33c54c4-3d8b-47d6-bd24-3a113f43f519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:02.340085 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:02.388633 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c54c4-3d8b-47d6-bd24-3a113f43f519 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:02.393592 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8451d-c53d-419c-a422-eaccd228944a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:02.394472 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8451d-c53d-419c-a422-eaccd228944a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:02.394762 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8451d-c53d-419c-a422-eaccd228944a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:02.395042 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8451d-c53d-419c-a422-eaccd228944a admin admin] PATH_INFO: `/v3/users/69e2e651085c4861a8511ac00dd2b485` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:02.396275 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8451d-c53d-419c-a422-eaccd228944a admin admin] RBAC: Authorizing `identity:delete_user(user_id=69e2e651085c4861a8511ac00dd2b485)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:02.398315 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8451d-c53d-419c-a422-eaccd228944a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:02.596818 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-bfd8451d-c53d-419c-a422-eaccd228944a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69e2e651085c4861a8511ac00dd2b485'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:02.597498 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-bfd8451d-c53d-419c-a422-eaccd228944a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69e2e651085c4861a8511ac00dd2b485'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:02.605438 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-bfd8451d-c53d-419c-a422-eaccd228944a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69e2e651085c4861a8511ac00dd2b485'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:02.606463 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-bfd8451d-c53d-419c-a422-eaccd228944a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69e2e651085c4861a8511ac00dd2b485'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:02.683490 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-bfd8451d-c53d-419c-a422-eaccd228944a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69e2e651085c4861a8511ac00dd2b485'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:02.705711 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1128/2263] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:53:02 2022] DELETE /identity/v3/users/69e2e651085c4861a8511ac00dd2b485 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:53:02.710511 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f97a3-b02d-46b9-8a11-4a6e4d4a2aa9 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:02.711002 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f97a3-b02d-46b9-8a11-4a6e4d4a2aa9 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:02.711121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f97a3-b02d-46b9-8a11-4a6e4d4a2aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:02.731076 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-e78f97a3-b02d-46b9-8a11-4a6e4d4a2aa9 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:53:02.732401 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-e78f97a3-b02d-46b9-8a11-4a6e4d4a2aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:02.802480 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1136/2264] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:53:02.814860 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8451d-c53d-419c-a422-eaccd228944a admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:02.816356 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-bfd8451d-c53d-419c-a422-eaccd228944a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:02.880640 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8451d-c53d-419c-a422-eaccd228944a admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:02.884943 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a7c65-0de0-4897-be1c-476bfa9f3de1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:02.886583 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a7c65-0de0-4897-be1c-476bfa9f3de1 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:02.886583 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a7c65-0de0-4897-be1c-476bfa9f3de1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:02.886583 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a7c65-0de0-4897-be1c-476bfa9f3de1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:02.898663 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a7c65-0de0-4897-be1c-476bfa9f3de1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:02.900394 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a7c65-0de0-4897-be1c-476bfa9f3de1 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:02.916791 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1129/2265] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:53:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:53:03.526573 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f97a3-b02d-46b9-8a11-4a6e4d4a2aa9 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:03.529257 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-e78f97a3-b02d-46b9-8a11-4a6e4d4a2aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:03.552523 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f97a3-b02d-46b9-8a11-4a6e4d4a2aa9 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:03.562291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38befb2-a117-4d41-8060-8f00b9420037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:03.567575 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38befb2-a117-4d41-8060-8f00b9420037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:03.567575 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38befb2-a117-4d41-8060-8f00b9420037 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:03.567575 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38befb2-a117-4d41-8060-8f00b9420037 admin admin] PATH_INFO: `/v3/projects/4ca5f44c37ec4edbb7997cd7b9225b99` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:03.567575 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38befb2-a117-4d41-8060-8f00b9420037 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ca5f44c37ec4edbb7997cd7b9225b99)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:03.567575 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38befb2-a117-4d41-8060-8f00b9420037 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:03.690768 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-a38befb2-a117-4d41-8060-8f00b9420037 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ca5f44c37ec4edbb7997cd7b9225b99', 'request_id': 'req-a38befb2-a117-4d41-8060-8f00b9420037'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:03.697662 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-a38befb2-a117-4d41-8060-8f00b9420037 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ca5f44c37ec4edbb7997cd7b9225b99', 'request_id': 'req-a38befb2-a117-4d41-8060-8f00b9420037'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:03.705061 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-a38befb2-a117-4d41-8060-8f00b9420037 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ca5f44c37ec4edbb7997cd7b9225b99', 'request_id': 'req-a38befb2-a117-4d41-8060-8f00b9420037'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:03.808840 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-a38befb2-a117-4d41-8060-8f00b9420037 admin admin] The token cache is being invalidate because project 4ca5f44c37ec4edbb7997cd7b9225b99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:53:03.815444 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-a38befb2-a117-4d41-8060-8f00b9420037 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:03.815444 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-a38befb2-a117-4d41-8060-8f00b9420037 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:03.815444 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1137/2266] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:53:03 2022] DELETE /identity/v3/projects/4ca5f44c37ec4edbb7997cd7b9225b99 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:53:03.818264 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a7c65-0de0-4897-be1c-476bfa9f3de1 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:03.829951 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a7c65-0de0-4897-be1c-476bfa9f3de1 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:03.875181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:03.895870 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231e40c-bf86-436f-a752-754447105843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:03.896816 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231e40c-bf86-436f-a752-754447105843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:03.897111 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231e40c-bf86-436f-a752-754447105843 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:03.897391 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231e40c-bf86-436f-a752-754447105843 admin admin] PATH_INFO: `/v3/users/6e141bd1468d428d9b39b13667a39e0f` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:03.898639 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231e40c-bf86-436f-a752-754447105843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e141bd1468d428d9b39b13667a39e0f)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:03.900666 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231e40c-bf86-436f-a752-754447105843 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:04.054343 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b231e40c-bf86-436f-a752-754447105843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e141bd1468d428d9b39b13667a39e0f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:04.055035 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b231e40c-bf86-436f-a752-754447105843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e141bd1468d428d9b39b13667a39e0f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:04.062521 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b231e40c-bf86-436f-a752-754447105843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e141bd1468d428d9b39b13667a39e0f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:04.063219 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b231e40c-bf86-436f-a752-754447105843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e141bd1468d428d9b39b13667a39e0f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:04.111904 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b231e40c-bf86-436f-a752-754447105843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e141bd1468d428d9b39b13667a39e0f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:04.130193 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1130/2267] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:53:03 2022] DELETE /identity/v3/users/6e141bd1468d428d9b39b13667a39e0f => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:53:04.320780 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a1885-856c-463a-aa28-a33a8a17b18b None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:04.321353 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a1885-856c-463a-aa28-a33a8a17b18b None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:04.321799 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a1885-856c-463a-aa28-a33a8a17b18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:04.347894 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-819a1885-856c-463a-aa28-a33a8a17b18b None None] MFA Rules not processed for user `e416de38c3354372909e3f13678e5b54`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:53:04.349325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-819a1885-856c-463a-aa28-a33a8a17b18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:04.364500 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:04.432128 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1138/2268] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:53:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:53:04.563549 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231e40c-bf86-436f-a752-754447105843 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:04.563549 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b231e40c-bf86-436f-a752-754447105843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:04.660151 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231e40c-bf86-436f-a752-754447105843 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:04.667194 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8bf55-f744-4f40-9147-e924e5f4bbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:04.668117 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8bf55-f744-4f40-9147-e924e5f4bbc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:04.672493 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8bf55-f744-4f40-9147-e924e5f4bbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:04.672493 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8bf55-f744-4f40-9147-e924e5f4bbc4 admin admin] PATH_INFO: `/v3/projects/5af1739210ad4274a4527d910abe77d0` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:04.672493 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8bf55-f744-4f40-9147-e924e5f4bbc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5af1739210ad4274a4527d910abe77d0)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:04.672493 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8bf55-f744-4f40-9147-e924e5f4bbc4 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:04.828954 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b7e8bf55-f744-4f40-9147-e924e5f4bbc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5af1739210ad4274a4527d910abe77d0', 'request_id': 'req-b7e8bf55-f744-4f40-9147-e924e5f4bbc4'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:04.835786 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b7e8bf55-f744-4f40-9147-e924e5f4bbc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5af1739210ad4274a4527d910abe77d0', 'request_id': 'req-b7e8bf55-f744-4f40-9147-e924e5f4bbc4'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:04.842666 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:04.844024 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b7e8bf55-f744-4f40-9147-e924e5f4bbc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5af1739210ad4274a4527d910abe77d0', 'request_id': 'req-b7e8bf55-f744-4f40-9147-e924e5f4bbc4'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:04.916003 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b7e8bf55-f744-4f40-9147-e924e5f4bbc4 admin admin] The token cache is being invalidate because project 5af1739210ad4274a4527d910abe77d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:53:04.916003 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b7e8bf55-f744-4f40-9147-e924e5f4bbc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:04.916826 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b7e8bf55-f744-4f40-9147-e924e5f4bbc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:04.918421 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1131/2269] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:53:04 2022] DELETE /identity/v3/projects/5af1739210ad4274a4527d910abe77d0 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:53:04.923154 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a1885-856c-463a-aa28-a33a8a17b18b None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:04.936219 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a1885-856c-463a-aa28-a33a8a17b18b None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:05.044019 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741df30-a15b-4a94-890c-a11491b6768f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:05.044019 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741df30-a15b-4a94-890c-a11491b6768f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:05.044019 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741df30-a15b-4a94-890c-a11491b6768f admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:05.044019 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741df30-a15b-4a94-890c-a11491b6768f admin admin] PATH_INFO: `/v3/users/28355a96b87c49f28d85ae13a1b0b988` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:05.045776 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741df30-a15b-4a94-890c-a11491b6768f admin admin] RBAC: Authorizing `identity:delete_user(user_id=28355a96b87c49f28d85ae13a1b0b988)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:05.048972 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741df30-a15b-4a94-890c-a11491b6768f admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:05.177292 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-6741df30-a15b-4a94-890c-a11491b6768f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28355a96b87c49f28d85ae13a1b0b988'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:05.177948 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-6741df30-a15b-4a94-890c-a11491b6768f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28355a96b87c49f28d85ae13a1b0b988'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:05.178545 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-6741df30-a15b-4a94-890c-a11491b6768f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28355a96b87c49f28d85ae13a1b0b988'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:05.186991 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-6741df30-a15b-4a94-890c-a11491b6768f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28355a96b87c49f28d85ae13a1b0b988'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:05.263970 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-6741df30-a15b-4a94-890c-a11491b6768f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28355a96b87c49f28d85ae13a1b0b988'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:05.292537 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1139/2270] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:53:04 2022] DELETE /identity/v3/users/28355a96b87c49f28d85ae13a1b0b988 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:53:05.782913 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8bf55-f744-4f40-9147-e924e5f4bbc4 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:05.784469 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b7e8bf55-f744-4f40-9147-e924e5f4bbc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:05.798323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8bf55-f744-4f40-9147-e924e5f4bbc4 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:05.862260 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd36ae3-5778-4049-a9a7-cba63f4a5a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:05.863470 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd36ae3-5778-4049-a9a7-cba63f4a5a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:05.863834 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd36ae3-5778-4049-a9a7-cba63f4a5a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:05.864122 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd36ae3-5778-4049-a9a7-cba63f4a5a77 admin admin] PATH_INFO: `/v3/projects/7788de7cd526404c85f5256b45da2589` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:05.865296 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd36ae3-5778-4049-a9a7-cba63f4a5a77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7788de7cd526404c85f5256b45da2589)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:05.867241 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd36ae3-5778-4049-a9a7-cba63f4a5a77 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:06.011874 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7cd36ae3-5778-4049-a9a7-cba63f4a5a77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7788de7cd526404c85f5256b45da2589', 'request_id': 'req-7cd36ae3-5778-4049-a9a7-cba63f4a5a77'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:06.024930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7cd36ae3-5778-4049-a9a7-cba63f4a5a77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7788de7cd526404c85f5256b45da2589', 'request_id': 'req-7cd36ae3-5778-4049-a9a7-cba63f4a5a77'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:06.033625 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7cd36ae3-5778-4049-a9a7-cba63f4a5a77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7788de7cd526404c85f5256b45da2589', 'request_id': 'req-7cd36ae3-5778-4049-a9a7-cba63f4a5a77'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:06.142028 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7cd36ae3-5778-4049-a9a7-cba63f4a5a77 admin admin] The token cache is being invalidate because project 7788de7cd526404c85f5256b45da2589 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:53:06.142715 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7cd36ae3-5778-4049-a9a7-cba63f4a5a77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:06.143939 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7cd36ae3-5778-4049-a9a7-cba63f4a5a77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:06.146555 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1132/2271] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:53:05 2022] DELETE /identity/v3/projects/7788de7cd526404c85f5256b45da2589 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:53:06.158012 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546ef6f-ba3f-426c-a447-4e98997a1ae3 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:06.158850 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546ef6f-ba3f-426c-a447-4e98997a1ae3 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:06.159000 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546ef6f-ba3f-426c-a447-4e98997a1ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:06.194828 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-d546ef6f-ba3f-426c-a447-4e98997a1ae3 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:53:06.197187 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-d546ef6f-ba3f-426c-a447-4e98997a1ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:06.270606 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:06.327040 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1140/2272] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:53:06.340055 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e02573-1968-49fc-9da1-03b5c52c2628 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:06.340556 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e02573-1968-49fc-9da1-03b5c52c2628 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:06.340988 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e02573-1968-49fc-9da1-03b5c52c2628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:06.388472 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-34e02573-1968-49fc-9da1-03b5c52c2628 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:53:06.391771 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-34e02573-1968-49fc-9da1-03b5c52c2628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:06.407038 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1133/2273] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:53:06.414228 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546ef6f-ba3f-426c-a447-4e98997a1ae3 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:06.437980 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546ef6f-ba3f-426c-a447-4e98997a1ae3 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:06.445234 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96baa24c-2259-41f5-aaff-63dcc42afa52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:06.446424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96baa24c-2259-41f5-aaff-63dcc42afa52 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:06.446751 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96baa24c-2259-41f5-aaff-63dcc42afa52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:06.447168 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96baa24c-2259-41f5-aaff-63dcc42afa52 admin admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:06.448531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96baa24c-2259-41f5-aaff-63dcc42afa52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:53:06.449020 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96baa24c-2259-41f5-aaff-63dcc42afa52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:06.451907 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96baa24c-2259-41f5-aaff-63dcc42afa52 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:06.471095 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1141/2274] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:53:06.477621 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e02573-1968-49fc-9da1-03b5c52c2628 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:06.494526 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e02573-1968-49fc-9da1-03b5c52c2628 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:06.501918 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731125eb-2ef0-4ccf-9cbf-40feba228e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:06.502615 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731125eb-2ef0-4ccf-9cbf-40feba228e1d admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:06.502903 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731125eb-2ef0-4ccf-9cbf-40feba228e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:06.503190 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731125eb-2ef0-4ccf-9cbf-40feba228e1d admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:06.503961 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731125eb-2ef0-4ccf-9cbf-40feba228e1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:06.505912 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731125eb-2ef0-4ccf-9cbf-40feba228e1d admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:06.615430 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1134/2275] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:53:06 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:53:06.620539 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96baa24c-2259-41f5-aaff-63dcc42afa52 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:06.641308 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96baa24c-2259-41f5-aaff-63dcc42afa52 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:06.735427 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aaf374-ccdb-43bb-a7ab-9851cecf26c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:06.737318 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aaf374-ccdb-43bb-a7ab-9851cecf26c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:06.737729 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aaf374-ccdb-43bb-a7ab-9851cecf26c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:06.738126 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aaf374-ccdb-43bb-a7ab-9851cecf26c9 admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:06.739137 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aaf374-ccdb-43bb-a7ab-9851cecf26c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:06.742043 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aaf374-ccdb-43bb-a7ab-9851cecf26c9 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:06.861747 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1142/2276] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:53:06 2022] POST /identity/v3/users => generated 287 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:53:06.865961 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731125eb-2ef0-4ccf-9cbf-40feba228e1d admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:06.877311 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731125eb-2ef0-4ccf-9cbf-40feba228e1d admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:06.882394 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b3ae5-2bcd-4f1b-947e-95c9994207ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:06.886337 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b3ae5-2bcd-4f1b-947e-95c9994207ca admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:06.886337 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b3ae5-2bcd-4f1b-947e-95c9994207ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:06.886337 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b3ae5-2bcd-4f1b-947e-95c9994207ca admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:06.886337 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b3ae5-2bcd-4f1b-947e-95c9994207ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:06.886681 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b3ae5-2bcd-4f1b-947e-95c9994207ca admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:06.897896 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1135/2277] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:53:06.902096 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aaf374-ccdb-43bb-a7ab-9851cecf26c9 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:06.912613 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aaf374-ccdb-43bb-a7ab-9851cecf26c9 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:06.917287 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320634de-13aa-4593-8c58-c0722b96e74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:06.917956 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320634de-13aa-4593-8c58-c0722b96e74d admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:06.918246 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320634de-13aa-4593-8c58-c0722b96e74d admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:06.918528 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320634de-13aa-4593-8c58-c0722b96e74d admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:06.919476 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320634de-13aa-4593-8c58-c0722b96e74d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:06.921142 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320634de-13aa-4593-8c58-c0722b96e74d admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:06.932309 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1143/2278] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:53:06.937656 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b3ae5-2bcd-4f1b-947e-95c9994207ca admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:06.947933 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b3ae5-2bcd-4f1b-947e-95c9994207ca admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:06.953542 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd59848-a16a-4649-a0df-fb5bfa7d809b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:06.954435 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd59848-a16a-4649-a0df-fb5bfa7d809b admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:06.954716 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd59848-a16a-4649-a0df-fb5bfa7d809b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:06.954998 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd59848-a16a-4649-a0df-fb5bfa7d809b admin admin] PATH_INFO: `/v3/projects/c70a23973ca549a8ba5ad02f2acbc15b/users/3bb7ff0443d345c6a1018c256d12ef5f/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:06.971499 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd59848-a16a-4649-a0df-fb5bfa7d809b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c70a23973ca549a8ba5ad02f2acbc15b, user_id=3bb7ff0443d345c6a1018c256d12ef5f, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:06.974229 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd59848-a16a-4649-a0df-fb5bfa7d809b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:07.051393 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1136/2279] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:53:06 2022] PUT /identity/v3/projects/c70a23973ca549a8ba5ad02f2acbc15b/users/3bb7ff0443d345c6a1018c256d12ef5f/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:53:07.056772 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010772e-175b-40bd-b1bd-deeb3f53b1f1 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:07.057067 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010772e-175b-40bd-b1bd-deeb3f53b1f1 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:07.057352 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010772e-175b-40bd-b1bd-deeb3f53b1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:07.077549 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-2010772e-175b-40bd-b1bd-deeb3f53b1f1 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:53:07.078782 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-2010772e-175b-40bd-b1bd-deeb3f53b1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:07.141615 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1144/2280] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:53:07.151789 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd59848-a16a-4649-a0df-fb5bfa7d809b admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:07.154153 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-fdd59848-a16a-4649-a0df-fb5bfa7d809b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:07.174066 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:07.218512 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd59848-a16a-4649-a0df-fb5bfa7d809b admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:07.222324 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9601341c-9f17-46c6-ab0f-98dd80a2f7e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:07.222983 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601341c-9f17-46c6-ab0f-98dd80a2f7e7 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:07.232537 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601341c-9f17-46c6-ab0f-98dd80a2f7e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:07.232537 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601341c-9f17-46c6-ab0f-98dd80a2f7e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:07.234591 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9601341c-9f17-46c6-ab0f-98dd80a2f7e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:07.236164 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9601341c-9f17-46c6-ab0f-98dd80a2f7e7 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:07.245889 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1137/2281] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:53:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:53:08.552117 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d89cbe-1a74-4082-9e5c-085c72fbb1c5 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:08.552778 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d89cbe-1a74-4082-9e5c-085c72fbb1c5 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:08.552778 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d89cbe-1a74-4082-9e5c-085c72fbb1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:08.588313 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-d5d89cbe-1a74-4082-9e5c-085c72fbb1c5 None None] MFA Rules not processed for user `3bb7ff0443d345c6a1018c256d12ef5f`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:53:08.589731 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-d5d89cbe-1a74-4082-9e5c-085c72fbb1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:08.632029 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:08.682535 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1145/2282] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:53:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:53:08.687597 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9601341c-9f17-46c6-ab0f-98dd80a2f7e7 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:08.698557 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9601341c-9f17-46c6-ab0f-98dd80a2f7e7 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:08.704342 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8254cd-a59e-414f-bbdb-21472889349d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:08.705287 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8254cd-a59e-414f-bbdb-21472889349d admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:08.705569 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8254cd-a59e-414f-bbdb-21472889349d admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:08.706083 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8254cd-a59e-414f-bbdb-21472889349d admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:08.707052 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8254cd-a59e-414f-bbdb-21472889349d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:08.709588 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8254cd-a59e-414f-bbdb-21472889349d admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:08.794553 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1138/2283] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:53:08 2022] POST /identity/v3/projects => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:53:08.798667 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d89cbe-1a74-4082-9e5c-085c72fbb1c5 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:08.810924 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d89cbe-1a74-4082-9e5c-085c72fbb1c5 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:08.869465 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7cdc9-3a07-4968-b5d3-1f1fb1a3bf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:08.870195 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7cdc9-3a07-4968-b5d3-1f1fb1a3bf98 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:08.870487 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7cdc9-3a07-4968-b5d3-1f1fb1a3bf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:08.870760 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7cdc9-3a07-4968-b5d3-1f1fb1a3bf98 admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:08.872453 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de7cdc9-3a07-4968-b5d3-1f1fb1a3bf98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:08.874372 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de7cdc9-3a07-4968-b5d3-1f1fb1a3bf98 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:08.952733 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1146/2284] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:53:08 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:53:08.957076 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8254cd-a59e-414f-bbdb-21472889349d admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:08.968662 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8254cd-a59e-414f-bbdb-21472889349d admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:08.974432 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbdf4dc-1108-4a37-9b75-12167548c05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:08.982699 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdf4dc-1108-4a37-9b75-12167548c05d admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:08.982699 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdf4dc-1108-4a37-9b75-12167548c05d admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:08.982699 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdf4dc-1108-4a37-9b75-12167548c05d admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:08.982699 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbdf4dc-1108-4a37-9b75-12167548c05d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:08.982699 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbdf4dc-1108-4a37-9b75-12167548c05d admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:08.990341 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1139/2285] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:53:08.994438 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7cdc9-3a07-4968-b5d3-1f1fb1a3bf98 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:09.004901 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7cdc9-3a07-4968-b5d3-1f1fb1a3bf98 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:09.009747 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4c795-43fd-4f1c-be6a-de51773115aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:09.010759 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4c795-43fd-4f1c-be6a-de51773115aa admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:09.011048 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4c795-43fd-4f1c-be6a-de51773115aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:09.011326 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4c795-43fd-4f1c-be6a-de51773115aa admin admin] PATH_INFO: `/v3/projects/ec8e5721c835421d80d47aaeab67c029/users/a0f8a31b4e5e42de85ccc269f922dc5d/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:09.027759 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe4c795-43fd-4f1c-be6a-de51773115aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec8e5721c835421d80d47aaeab67c029, user_id=a0f8a31b4e5e42de85ccc269f922dc5d, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:09.031504 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe4c795-43fd-4f1c-be6a-de51773115aa admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:09.130627 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1147/2286] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:53:08 2022] PUT /identity/v3/projects/ec8e5721c835421d80d47aaeab67c029/users/a0f8a31b4e5e42de85ccc269f922dc5d/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:53:09.134590 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbdf4dc-1108-4a37-9b75-12167548c05d admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:09.145732 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbdf4dc-1108-4a37-9b75-12167548c05d admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:09.205289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42473f28-b859-4782-8179-9b8e72f3edc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:09.205956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42473f28-b859-4782-8179-9b8e72f3edc2 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:09.206240 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42473f28-b859-4782-8179-9b8e72f3edc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:09.206516 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42473f28-b859-4782-8179-9b8e72f3edc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:09.207243 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42473f28-b859-4782-8179-9b8e72f3edc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:09.208872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42473f28-b859-4782-8179-9b8e72f3edc2 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:09.219084 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1140/2287] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:53:09.223485 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4c795-43fd-4f1c-be6a-de51773115aa admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:09.234869 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4c795-43fd-4f1c-be6a-de51773115aa admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:09.239701 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f7e65-34ae-40ff-8620-89ca0ce87cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:09.240582 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f7e65-34ae-40ff-8620-89ca0ce87cc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:09.240869 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f7e65-34ae-40ff-8620-89ca0ce87cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:09.241143 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f7e65-34ae-40ff-8620-89ca0ce87cc7 admin admin] PATH_INFO: `/v3/projects/ec8e5721c835421d80d47aaeab67c029/users/a0f8a31b4e5e42de85ccc269f922dc5d/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:09.243357 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f7e65-34ae-40ff-8620-89ca0ce87cc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec8e5721c835421d80d47aaeab67c029, user_id=a0f8a31b4e5e42de85ccc269f922dc5d, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:09.246101 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f7e65-34ae-40ff-8620-89ca0ce87cc7 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:09.256614 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1148/2288] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:53:09 2022] PUT /identity/v3/projects/ec8e5721c835421d80d47aaeab67c029/users/a0f8a31b4e5e42de85ccc269f922dc5d/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:53:10.616547 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276287c-4047-4c98-af98-384ae379dd60 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:10.617110 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276287c-4047-4c98-af98-384ae379dd60 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:10.617110 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276287c-4047-4c98-af98-384ae379dd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:10.651845 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-f276287c-4047-4c98-af98-384ae379dd60 None None] MFA Rules not processed for user `a0f8a31b4e5e42de85ccc269f922dc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:53:10.653652 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f276287c-4047-4c98-af98-384ae379dd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:10.764289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1141/2289] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:53:10 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:53:10.777831 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f7e65-34ae-40ff-8620-89ca0ce87cc7 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:10.782227 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-9c3f7e65-34ae-40ff-8620-89ca0ce87cc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:10.848304 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f7e65-34ae-40ff-8620-89ca0ce87cc7 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:10.851928 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c284b7a-849a-4ef3-b8bc-0ae2e6e66583 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:10.852619 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c284b7a-849a-4ef3-b8bc-0ae2e6e66583 service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:10.852904 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c284b7a-849a-4ef3-b8bc-0ae2e6e66583 service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:10.853182 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c284b7a-849a-4ef3-b8bc-0ae2e6e66583 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:10.905513 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:10.942022 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c284b7a-849a-4ef3-b8bc-0ae2e6e66583 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:10.943643 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c284b7a-849a-4ef3-b8bc-0ae2e6e66583 service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:10.964212 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1149/2290] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:53:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:53:12.704196 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276287c-4047-4c98-af98-384ae379dd60 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:12.705953 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f276287c-4047-4c98-af98-384ae379dd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:12.724629 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276287c-4047-4c98-af98-384ae379dd60 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:12.728330 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ef4a8-7427-4186-9472-f58eec1816a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:12.728992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ef4a8-7427-4186-9472-f58eec1816a1 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:12.729280 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ef4a8-7427-4186-9472-f58eec1816a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:12.729557 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ef4a8-7427-4186-9472-f58eec1816a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:12.738491 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:12.744287 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ef4a8-7427-4186-9472-f58eec1816a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:12.747599 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ef4a8-7427-4186-9472-f58eec1816a1 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:12.760352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1142/2291] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:53:12 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:53:13.169428 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c284b7a-849a-4ef3-b8bc-0ae2e6e66583 service cinder] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:13.170965 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-4c284b7a-849a-4ef3-b8bc-0ae2e6e66583 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:13.238301 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c284b7a-849a-4ef3-b8bc-0ae2e6e66583 service cinder] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:13.243994 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922da3b-5a39-45f4-94b1-117a3771c104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:13.244985 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922da3b-5a39-45f4-94b1-117a3771c104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:13.245384 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922da3b-5a39-45f4-94b1-117a3771c104 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:13.245750 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922da3b-5a39-45f4-94b1-117a3771c104 admin admin] PATH_INFO: `/v3/users/34d1c7a7359441eaa93fc1bcbe98dc75` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:13.247254 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2922da3b-5a39-45f4-94b1-117a3771c104 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34d1c7a7359441eaa93fc1bcbe98dc75)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:13.252055 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2922da3b-5a39-45f4-94b1-117a3771c104 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:13.476318 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-2922da3b-5a39-45f4-94b1-117a3771c104 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34d1c7a7359441eaa93fc1bcbe98dc75'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:13.477116 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-2922da3b-5a39-45f4-94b1-117a3771c104 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34d1c7a7359441eaa93fc1bcbe98dc75'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:13.477800 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-2922da3b-5a39-45f4-94b1-117a3771c104 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34d1c7a7359441eaa93fc1bcbe98dc75'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:13.485166 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-2922da3b-5a39-45f4-94b1-117a3771c104 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34d1c7a7359441eaa93fc1bcbe98dc75'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:13.576041 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-2922da3b-5a39-45f4-94b1-117a3771c104 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34d1c7a7359441eaa93fc1bcbe98dc75'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:13.596899 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1150/2292] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:53:13 2022] DELETE /identity/v3/users/34d1c7a7359441eaa93fc1bcbe98dc75 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:53:13.601641 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434a606-9bac-4f0b-b169-f7787bbdff04 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:13.601936 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434a606-9bac-4f0b-b169-f7787bbdff04 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:13.602217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434a606-9bac-4f0b-b169-f7787bbdff04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:13.622205 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-8434a606-9bac-4f0b-b169-f7787bbdff04 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:53:13.623761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-8434a606-9bac-4f0b-b169-f7787bbdff04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:13.696869 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1143/2293] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:53:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:53:13.708648 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922da3b-5a39-45f4-94b1-117a3771c104 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:13.710205 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-2922da3b-5a39-45f4-94b1-117a3771c104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:13.775599 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922da3b-5a39-45f4-94b1-117a3771c104 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:13.781158 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2edbb9d-8209-4d0a-83eb-4509c0a3934c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:13.781857 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edbb9d-8209-4d0a-83eb-4509c0a3934c service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:13.782186 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edbb9d-8209-4d0a-83eb-4509c0a3934c service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:13.784649 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edbb9d-8209-4d0a-83eb-4509c0a3934c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:13.794443 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2edbb9d-8209-4d0a-83eb-4509c0a3934c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:13.797091 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2edbb9d-8209-4d0a-83eb-4509c0a3934c service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:13.808687 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1151/2294] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:53:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:53:14.450369 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434a606-9bac-4f0b-b169-f7787bbdff04 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:14.452716 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-8434a606-9bac-4f0b-b169-f7787bbdff04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:14.472576 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434a606-9bac-4f0b-b169-f7787bbdff04 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:14.479416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56dae5-f62c-47fc-b461-6772ca17316c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:14.480224 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56dae5-f62c-47fc-b461-6772ca17316c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:14.480514 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56dae5-f62c-47fc-b461-6772ca17316c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:14.480792 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56dae5-f62c-47fc-b461-6772ca17316c admin admin] PATH_INFO: `/v3/projects/3db9d7e560c540bcad5461030ea8895c` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:14.483257 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56dae5-f62c-47fc-b461-6772ca17316c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3db9d7e560c540bcad5461030ea8895c)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:14.485266 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56dae5-f62c-47fc-b461-6772ca17316c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:14.638553 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-8e56dae5-f62c-47fc-b461-6772ca17316c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3db9d7e560c540bcad5461030ea8895c', 'request_id': 'req-8e56dae5-f62c-47fc-b461-6772ca17316c'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:14.646106 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-8e56dae5-f62c-47fc-b461-6772ca17316c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3db9d7e560c540bcad5461030ea8895c', 'request_id': 'req-8e56dae5-f62c-47fc-b461-6772ca17316c'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:14.652053 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-8e56dae5-f62c-47fc-b461-6772ca17316c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3db9d7e560c540bcad5461030ea8895c', 'request_id': 'req-8e56dae5-f62c-47fc-b461-6772ca17316c'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:14.808293 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-8e56dae5-f62c-47fc-b461-6772ca17316c admin admin] The token cache is being invalidate because project 3db9d7e560c540bcad5461030ea8895c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:53:14.808590 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-8e56dae5-f62c-47fc-b461-6772ca17316c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:14.809268 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-8e56dae5-f62c-47fc-b461-6772ca17316c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:14.810979 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1144/2295] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:53:14 2022] DELETE /identity/v3/projects/3db9d7e560c540bcad5461030ea8895c => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:53:14.816363 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e466b0f-9a12-4097-834f-a6acb2d1a252 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:14.816991 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e466b0f-9a12-4097-834f-a6acb2d1a252 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:14.817898 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e466b0f-9a12-4097-834f-a6acb2d1a252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:14.831878 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:14.847814 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-3e466b0f-9a12-4097-834f-a6acb2d1a252 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:53:14.849176 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-3e466b0f-9a12-4097-834f-a6acb2d1a252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:14.938881 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1152/2296] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:53:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:53:14.946614 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28701816-da02-40c4-86e5-0a824bee7868 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:14.947093 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28701816-da02-40c4-86e5-0a824bee7868 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:14.947449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28701816-da02-40c4-86e5-0a824bee7868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:14.971639 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-28701816-da02-40c4-86e5-0a824bee7868 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:53:14.973657 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-28701816-da02-40c4-86e5-0a824bee7868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:14.988956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1145/2297] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:53:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:53:14.996593 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e466b0f-9a12-4097-834f-a6acb2d1a252 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:15.009120 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e466b0f-9a12-4097-834f-a6acb2d1a252 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:15.014949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bac5d4-6e9a-422f-9637-51a45ee2db0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:15.015806 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bac5d4-6e9a-422f-9637-51a45ee2db0d admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:15.016255 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bac5d4-6e9a-422f-9637-51a45ee2db0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:15.016534 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bac5d4-6e9a-422f-9637-51a45ee2db0d admin admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:15.017276 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bac5d4-6e9a-422f-9637-51a45ee2db0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:53:15.017586 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bac5d4-6e9a-422f-9637-51a45ee2db0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:15.019633 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bac5d4-6e9a-422f-9637-51a45ee2db0d admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:15.035251 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1153/2298] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:53:15.039281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28701816-da02-40c4-86e5-0a824bee7868 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:15.053464 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28701816-da02-40c4-86e5-0a824bee7868 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:15.064645 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb6791-ea32-4ee7-b7e7-af47e500db27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:15.065479 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb6791-ea32-4ee7-b7e7-af47e500db27 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:15.065765 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb6791-ea32-4ee7-b7e7-af47e500db27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:15.067002 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb6791-ea32-4ee7-b7e7-af47e500db27 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:15.067838 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb6791-ea32-4ee7-b7e7-af47e500db27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:15.073845 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb6791-ea32-4ee7-b7e7-af47e500db27 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:15.183814 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1146/2299] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:53:15 2022] POST /identity/v3/projects => generated 371 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:53:15.188585 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bac5d4-6e9a-422f-9637-51a45ee2db0d admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:15.200868 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bac5d4-6e9a-422f-9637-51a45ee2db0d admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:15.284115 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48e03b-ee91-463f-bfa8-c6bb4f91930d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:15.284944 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48e03b-ee91-463f-bfa8-c6bb4f91930d admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:15.285294 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48e03b-ee91-463f-bfa8-c6bb4f91930d admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:15.285643 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48e03b-ee91-463f-bfa8-c6bb4f91930d admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:15.286413 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48e03b-ee91-463f-bfa8-c6bb4f91930d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:15.288608 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48e03b-ee91-463f-bfa8-c6bb4f91930d admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:15.376565 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1154/2300] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:53:15 2022] POST /identity/v3/users => generated 286 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:53:15.381397 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb6791-ea32-4ee7-b7e7-af47e500db27 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:15.392608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb6791-ea32-4ee7-b7e7-af47e500db27 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:15.397433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e3507-3308-4fae-af27-bcbeb53402d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:15.398097 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e3507-3308-4fae-af27-bcbeb53402d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:15.398472 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e3507-3308-4fae-af27-bcbeb53402d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:15.398750 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e3507-3308-4fae-af27-bcbeb53402d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:15.399519 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e3507-3308-4fae-af27-bcbeb53402d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:15.401756 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e3507-3308-4fae-af27-bcbeb53402d3 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:15.412277 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1147/2301] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:53:15.416454 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48e03b-ee91-463f-bfa8-c6bb4f91930d admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:15.427754 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48e03b-ee91-463f-bfa8-c6bb4f91930d admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:15.432508 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f2e3b-63e2-46ff-a854-883a47a0ed9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:15.433170 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f2e3b-63e2-46ff-a854-883a47a0ed9c admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:15.433480 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f2e3b-63e2-46ff-a854-883a47a0ed9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:15.433760 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f2e3b-63e2-46ff-a854-883a47a0ed9c admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:15.435290 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f2e3b-63e2-46ff-a854-883a47a0ed9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:15.436937 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f2e3b-63e2-46ff-a854-883a47a0ed9c admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:15.448640 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1155/2302] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:53:15.453375 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e3507-3308-4fae-af27-bcbeb53402d3 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:15.463700 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e3507-3308-4fae-af27-bcbeb53402d3 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:15.471527 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e68b18-6851-42a0-b8af-93feb76c3cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:15.472476 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e68b18-6851-42a0-b8af-93feb76c3cf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:15.472765 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e68b18-6851-42a0-b8af-93feb76c3cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:15.473046 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e68b18-6851-42a0-b8af-93feb76c3cf3 admin admin] PATH_INFO: `/v3/projects/c2d403fe7404423681030b892a42a722/users/35719ec6e5634328aebc7ff6acdf1a0f/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:15.488389 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e68b18-6851-42a0-b8af-93feb76c3cf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2d403fe7404423681030b892a42a722, user_id=35719ec6e5634328aebc7ff6acdf1a0f, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:15.491033 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e68b18-6851-42a0-b8af-93feb76c3cf3 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:15.557839 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1148/2303] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:53:15 2022] PUT /identity/v3/projects/c2d403fe7404423681030b892a42a722/users/35719ec6e5634328aebc7ff6acdf1a0f/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:53:15.564802 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30089d-90b8-4190-94c1-bbb58aec5118 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:15.565132 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30089d-90b8-4190-94c1-bbb58aec5118 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:15.565411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30089d-90b8-4190-94c1-bbb58aec5118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:15.585484 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-cc30089d-90b8-4190-94c1-bbb58aec5118 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:53:15.586697 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-cc30089d-90b8-4190-94c1-bbb58aec5118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:15.847837 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1156/2304] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:53:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:53:15.848942 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e68b18-6851-42a0-b8af-93feb76c3cf3 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:15.848942 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b3e68b18-6851-42a0-b8af-93feb76c3cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:15.858395 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:15.903066 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e68b18-6851-42a0-b8af-93feb76c3cf3 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:15.907297 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0693a-6118-4f5c-8845-2aacf71d6908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:15.953172 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0693a-6118-4f5c-8845-2aacf71d6908 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:15.953172 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0693a-6118-4f5c-8845-2aacf71d6908 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:15.953172 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0693a-6118-4f5c-8845-2aacf71d6908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:15.953172 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0693a-6118-4f5c-8845-2aacf71d6908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:15.953172 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0693a-6118-4f5c-8845-2aacf71d6908 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:15.953172 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1149/2305] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:53:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:53:21.505521 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30089d-90b8-4190-94c1-bbb58aec5118 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:21.506999 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-cc30089d-90b8-4190-94c1-bbb58aec5118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:21.528007 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:21.688955 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30089d-90b8-4190-94c1-bbb58aec5118 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:21.700450 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68e375-6d1d-41f7-86af-7a8f59cd9bba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfb4be75496444dd897b880c2ac3e67e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:21.701708 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68e375-6d1d-41f7-86af-7a8f59cd9bba service placement] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:21.702608 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68e375-6d1d-41f7-86af-7a8f59cd9bba service placement] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:21.702889 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68e375-6d1d-41f7-86af-7a8f59cd9bba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:21.708096 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-9d68e375-6d1d-41f7-86af-7a8f59cd9bba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:21.729838 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68e375-6d1d-41f7-86af-7a8f59cd9bba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:21.732867 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68e375-6d1d-41f7-86af-7a8f59cd9bba service placement] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:21.748818 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1157/2306] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:53:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:53:22.818616 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948200a-5389-4944-9495-5a356f1b23cf None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:22.819459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948200a-5389-4944-9495-5a356f1b23cf None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:22.820016 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948200a-5389-4944-9495-5a356f1b23cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:22.851106 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-4948200a-5389-4944-9495-5a356f1b23cf None None] MFA Rules not processed for user `35719ec6e5634328aebc7ff6acdf1a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:53:22.852497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4948200a-5389-4944-9495-5a356f1b23cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:22.948399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1150/2307] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:53:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:53:22.953331 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68e375-6d1d-41f7-86af-7a8f59cd9bba service placement] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:22.963999 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68e375-6d1d-41f7-86af-7a8f59cd9bba service placement] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:22.968883 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e453d23-b0c5-4758-b8a8-03f20adc712b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:22.969546 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e453d23-b0c5-4758-b8a8-03f20adc712b admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:22.969828 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e453d23-b0c5-4758-b8a8-03f20adc712b admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:22.970109 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e453d23-b0c5-4758-b8a8-03f20adc712b admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:22.970808 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e453d23-b0c5-4758-b8a8-03f20adc712b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:22.972923 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e453d23-b0c5-4758-b8a8-03f20adc712b admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:23.063695 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1158/2308] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:53:22 2022] POST /identity/v3/projects => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:53:23.066305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948200a-5389-4944-9495-5a356f1b23cf None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:23.087175 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948200a-5389-4944-9495-5a356f1b23cf None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:23.155967 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955e9f9-3678-4626-89cf-f1aa3a14ed28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:23.156660 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955e9f9-3678-4626-89cf-f1aa3a14ed28 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:23.156947 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955e9f9-3678-4626-89cf-f1aa3a14ed28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:23.157228 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955e9f9-3678-4626-89cf-f1aa3a14ed28 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:23.157941 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955e9f9-3678-4626-89cf-f1aa3a14ed28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:23.159910 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955e9f9-3678-4626-89cf-f1aa3a14ed28 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:23.261086 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1151/2309] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:53:23 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:53:23.265187 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e453d23-b0c5-4758-b8a8-03f20adc712b admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:23.276325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e453d23-b0c5-4758-b8a8-03f20adc712b admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:23.282025 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c50269-6ec5-43a8-98a9-a808b2f2b917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:23.282779 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c50269-6ec5-43a8-98a9-a808b2f2b917 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:23.283273 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c50269-6ec5-43a8-98a9-a808b2f2b917 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:23.283638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c50269-6ec5-43a8-98a9-a808b2f2b917 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:23.284471 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c50269-6ec5-43a8-98a9-a808b2f2b917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:23.286410 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c50269-6ec5-43a8-98a9-a808b2f2b917 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:23.298477 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1159/2310] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:53:23.302857 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955e9f9-3678-4626-89cf-f1aa3a14ed28 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:23.315518 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955e9f9-3678-4626-89cf-f1aa3a14ed28 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:23.321460 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f731bb-6051-4e63-8cc6-af5840221135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:23.323265 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f731bb-6051-4e63-8cc6-af5840221135 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:23.323788 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f731bb-6051-4e63-8cc6-af5840221135 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:23.324266 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f731bb-6051-4e63-8cc6-af5840221135 admin admin] PATH_INFO: `/v3/projects/b9739d044fc2425d9a0bcdc4640d8cf7/users/623828dbdad3464c812d26e2cd26b1e1/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:23.351123 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f731bb-6051-4e63-8cc6-af5840221135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9739d044fc2425d9a0bcdc4640d8cf7, user_id=623828dbdad3464c812d26e2cd26b1e1, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:23.354163 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f731bb-6051-4e63-8cc6-af5840221135 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:23.423176 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c50269-6ec5-43a8-98a9-a808b2f2b917 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:23.424339 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1152/2311] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:53:23 2022] PUT /identity/v3/projects/b9739d044fc2425d9a0bcdc4640d8cf7/users/623828dbdad3464c812d26e2cd26b1e1/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:53:23.437452 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c50269-6ec5-43a8-98a9-a808b2f2b917 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:23.514725 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5657a-5527-4693-9b78-2bd9374f6bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:23.515841 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5657a-5527-4693-9b78-2bd9374f6bdb admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:23.516497 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5657a-5527-4693-9b78-2bd9374f6bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:23.516783 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5657a-5527-4693-9b78-2bd9374f6bdb admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:23.517553 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5657a-5527-4693-9b78-2bd9374f6bdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:23.519156 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5657a-5527-4693-9b78-2bd9374f6bdb admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:23.535593 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1160/2312] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:53:23.539939 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f731bb-6051-4e63-8cc6-af5840221135 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:23.552043 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f731bb-6051-4e63-8cc6-af5840221135 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:23.556916 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3717b-3d1a-4249-8d35-b549a31e4c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:23.557745 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3717b-3d1a-4249-8d35-b549a31e4c7d admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:23.558060 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3717b-3d1a-4249-8d35-b549a31e4c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:23.558337 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3717b-3d1a-4249-8d35-b549a31e4c7d admin admin] PATH_INFO: `/v3/projects/b9739d044fc2425d9a0bcdc4640d8cf7/users/623828dbdad3464c812d26e2cd26b1e1/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:23.560355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df3717b-3d1a-4249-8d35-b549a31e4c7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9739d044fc2425d9a0bcdc4640d8cf7, user_id=623828dbdad3464c812d26e2cd26b1e1, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:23.564267 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df3717b-3d1a-4249-8d35-b549a31e4c7d admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:23.571194 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:23.577455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1153/2313] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:53:23 2022] PUT /identity/v3/projects/b9739d044fc2425d9a0bcdc4640d8cf7/users/623828dbdad3464c812d26e2cd26b1e1/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:53:25.430652 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b951b6-f87b-400a-9dc6-e71ab69d5e3e None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:25.430652 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b951b6-f87b-400a-9dc6-e71ab69d5e3e None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:25.430652 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b951b6-f87b-400a-9dc6-e71ab69d5e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:25.479216 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-c3b951b6-f87b-400a-9dc6-e71ab69d5e3e None None] MFA Rules not processed for user `45fef5bf7c914f538eb1bf71623524fd`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:53:25.481569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-c3b951b6-f87b-400a-9dc6-e71ab69d5e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:25.596722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1161/2314] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:53:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:53:32.748331 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eec3e7-1a1b-4c32-8a52-385653b3bf62 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:32.749319 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eec3e7-1a1b-4c32-8a52-385653b3bf62 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:32.749677 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eec3e7-1a1b-4c32-8a52-385653b3bf62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:32.812803 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-40eec3e7-1a1b-4c32-8a52-385653b3bf62 None None] MFA Rules not processed for user `623828dbdad3464c812d26e2cd26b1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:53:32.820112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-40eec3e7-1a1b-4c32-8a52-385653b3bf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:32.853669 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b951b6-f87b-400a-9dc6-e71ab69d5e3e None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:32.855226 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-c3b951b6-f87b-400a-9dc6-e71ab69d5e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:32.884887 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:32.976359 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1154/2315] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:53:32 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:53:32.990795 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eec3e7-1a1b-4c32-8a52-385653b3bf62 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:32.993279 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-40eec3e7-1a1b-4c32-8a52-385653b3bf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:33.049839 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b951b6-f87b-400a-9dc6-e71ab69d5e3e None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:33.060479 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f35b5-1349-444d-99be-bd265c24180b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:33.062612 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f35b5-1349-444d-99be-bd265c24180b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:33.064212 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f35b5-1349-444d-99be-bd265c24180b admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:33.065096 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f35b5-1349-444d-99be-bd265c24180b admin admin] PATH_INFO: `/v3/users/9cf78ad2cb124595814b4d0eda60fb32` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:33.071600 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f35b5-1349-444d-99be-bd265c24180b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cf78ad2cb124595814b4d0eda60fb32)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:33.077541 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f35b5-1349-444d-99be-bd265c24180b admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:33.180726 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eec3e7-1a1b-4c32-8a52-385653b3bf62 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:33.187934 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd25b3b-0b99-41c1-bcca-4902afdf98d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:33.188618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd25b3b-0b99-41c1-bcca-4902afdf98d3 service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:33.189020 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd25b3b-0b99-41c1-bcca-4902afdf98d3 service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:33.189324 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd25b3b-0b99-41c1-bcca-4902afdf98d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:33.267976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd25b3b-0b99-41c1-bcca-4902afdf98d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:33.269776 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd25b3b-0b99-41c1-bcca-4902afdf98d3 service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:33.295810 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1155/2316] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:53:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:53:33.410912 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-a86f35b5-1349-444d-99be-bd265c24180b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cf78ad2cb124595814b4d0eda60fb32'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:33.412070 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-a86f35b5-1349-444d-99be-bd265c24180b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cf78ad2cb124595814b4d0eda60fb32'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:33.413162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-a86f35b5-1349-444d-99be-bd265c24180b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cf78ad2cb124595814b4d0eda60fb32'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:33.428114 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-a86f35b5-1349-444d-99be-bd265c24180b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cf78ad2cb124595814b4d0eda60fb32'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:33.541087 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-a86f35b5-1349-444d-99be-bd265c24180b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cf78ad2cb124595814b4d0eda60fb32'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:33.566072 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1162/2317] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:53:32 2022] DELETE /identity/v3/users/9cf78ad2cb124595814b4d0eda60fb32 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:53:33.571079 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b6175-a93b-47de-8692-3edfed184797 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:33.571445 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b6175-a93b-47de-8692-3edfed184797 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:33.572259 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b6175-a93b-47de-8692-3edfed184797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:33.598502 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-761b6175-a93b-47de-8692-3edfed184797 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:53:33.599789 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-761b6175-a93b-47de-8692-3edfed184797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:33.615734 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:33.675587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1156/2318] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:53:33.690416 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f35b5-1349-444d-99be-bd265c24180b admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:33.692729 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-a86f35b5-1349-444d-99be-bd265c24180b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:33.773561 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f35b5-1349-444d-99be-bd265c24180b admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:33.777548 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76df7e5-965f-4391-84e6-9f5860c9bd44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:33.778218 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76df7e5-965f-4391-84e6-9f5860c9bd44 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:33.778552 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76df7e5-965f-4391-84e6-9f5860c9bd44 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:33.779406 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76df7e5-965f-4391-84e6-9f5860c9bd44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:33.790290 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76df7e5-965f-4391-84e6-9f5860c9bd44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:33.791791 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76df7e5-965f-4391-84e6-9f5860c9bd44 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:33.805260 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1163/2319] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:53:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:53:34.417938 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b6175-a93b-47de-8692-3edfed184797 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:34.418966 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-761b6175-a93b-47de-8692-3edfed184797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:34.434742 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b6175-a93b-47de-8692-3edfed184797 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:34.446124 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf69b18-ab87-4f8e-99f8-55a40a726ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:34.447647 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf69b18-ab87-4f8e-99f8-55a40a726ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:34.449720 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf69b18-ab87-4f8e-99f8-55a40a726ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:34.450091 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf69b18-ab87-4f8e-99f8-55a40a726ec6 admin admin] PATH_INFO: `/v3/projects/568f8c3b69bc402cbc31070da7054840` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:34.453067 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf69b18-ab87-4f8e-99f8-55a40a726ec6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=568f8c3b69bc402cbc31070da7054840)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:34.455894 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf69b18-ab87-4f8e-99f8-55a40a726ec6 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:34.721551 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ddf69b18-ab87-4f8e-99f8-55a40a726ec6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '568f8c3b69bc402cbc31070da7054840', 'request_id': 'req-ddf69b18-ab87-4f8e-99f8-55a40a726ec6'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:34.729608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ddf69b18-ab87-4f8e-99f8-55a40a726ec6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '568f8c3b69bc402cbc31070da7054840', 'request_id': 'req-ddf69b18-ab87-4f8e-99f8-55a40a726ec6'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:34.740457 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ddf69b18-ab87-4f8e-99f8-55a40a726ec6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '568f8c3b69bc402cbc31070da7054840', 'request_id': 'req-ddf69b18-ab87-4f8e-99f8-55a40a726ec6'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:35.043675 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ddf69b18-ab87-4f8e-99f8-55a40a726ec6 admin admin] The token cache is being invalidate because project 568f8c3b69bc402cbc31070da7054840 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:53:35.043956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ddf69b18-ab87-4f8e-99f8-55a40a726ec6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:35.045192 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ddf69b18-ab87-4f8e-99f8-55a40a726ec6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:35.051839 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1157/2320] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:53:34 2022] DELETE /identity/v3/projects/568f8c3b69bc402cbc31070da7054840 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:53:35.054512 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f4175-8823-41cf-a6a3-3183364f2ab1 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:35.054999 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f4175-8823-41cf-a6a3-3183364f2ab1 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:35.059712 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f4175-8823-41cf-a6a3-3183364f2ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:35.079135 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-222f4175-8823-41cf-a6a3-3183364f2ab1 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:53:35.080806 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-222f4175-8823-41cf-a6a3-3183364f2ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:35.119999 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:35.188242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1164/2321] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:53:35.196071 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42177e6c-9839-479d-aa5a-607b3011573b None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:35.196364 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42177e6c-9839-479d-aa5a-607b3011573b None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:35.196643 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42177e6c-9839-479d-aa5a-607b3011573b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:35.224240 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-42177e6c-9839-479d-aa5a-607b3011573b None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:53:35.226463 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-42177e6c-9839-479d-aa5a-607b3011573b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:35.250253 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1158/2322] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:53:35.255364 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f4175-8823-41cf-a6a3-3183364f2ab1 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:35.268303 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f4175-8823-41cf-a6a3-3183364f2ab1 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:35.276793 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6fad9-00d5-4dce-8a0e-546350026b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:35.277384 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6fad9-00d5-4dce-8a0e-546350026b91 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:35.277887 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6fad9-00d5-4dce-8a0e-546350026b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:35.278620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6fad9-00d5-4dce-8a0e-546350026b91 admin admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:35.280238 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6fad9-00d5-4dce-8a0e-546350026b91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:53:35.280561 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6fad9-00d5-4dce-8a0e-546350026b91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:35.283042 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6fad9-00d5-4dce-8a0e-546350026b91 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:35.307845 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1165/2323] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:53:35.313469 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42177e6c-9839-479d-aa5a-607b3011573b None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:35.327704 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42177e6c-9839-479d-aa5a-607b3011573b None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:35.333386 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3af7c2-1a25-4b8c-b99c-172277943a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:35.336352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3af7c2-1a25-4b8c-b99c-172277943a44 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:35.336644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3af7c2-1a25-4b8c-b99c-172277943a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:35.336930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3af7c2-1a25-4b8c-b99c-172277943a44 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:35.337895 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3af7c2-1a25-4b8c-b99c-172277943a44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:35.340115 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3af7c2-1a25-4b8c-b99c-172277943a44 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:35.489176 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1159/2324] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:53:35 2022] POST /identity/v3/projects => generated 375 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:53:35.494068 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6fad9-00d5-4dce-8a0e-546350026b91 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:35.517411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6fad9-00d5-4dce-8a0e-546350026b91 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:35.689306 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fa1f4-6dd5-4618-ac5e-11bd7388a2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:35.690656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fa1f4-6dd5-4618-ac5e-11bd7388a2f1 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:35.691295 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fa1f4-6dd5-4618-ac5e-11bd7388a2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:35.691895 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fa1f4-6dd5-4618-ac5e-11bd7388a2f1 admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:35.693375 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3fa1f4-6dd5-4618-ac5e-11bd7388a2f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:35.725628 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3fa1f4-6dd5-4618-ac5e-11bd7388a2f1 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:35.914831 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1166/2325] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:53:35 2022] POST /identity/v3/users => generated 288 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:53:35.918662 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3af7c2-1a25-4b8c-b99c-172277943a44 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:35.953979 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3af7c2-1a25-4b8c-b99c-172277943a44 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:35.967740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced1f3e-2535-41a0-8e32-47c82cb0210c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:35.968712 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced1f3e-2535-41a0-8e32-47c82cb0210c admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:35.969007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced1f3e-2535-41a0-8e32-47c82cb0210c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:35.969331 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced1f3e-2535-41a0-8e32-47c82cb0210c admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:35.974609 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced1f3e-2535-41a0-8e32-47c82cb0210c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:35.974609 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced1f3e-2535-41a0-8e32-47c82cb0210c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:35.984741 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1160/2326] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:53:35.988411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fa1f4-6dd5-4618-ac5e-11bd7388a2f1 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:36.003304 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fa1f4-6dd5-4618-ac5e-11bd7388a2f1 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:36.011030 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e24534-f0ea-4f32-adaa-21c91f558f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:36.012114 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e24534-f0ea-4f32-adaa-21c91f558f94 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:36.012934 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e24534-f0ea-4f32-adaa-21c91f558f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:36.014049 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e24534-f0ea-4f32-adaa-21c91f558f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:36.015069 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e24534-f0ea-4f32-adaa-21c91f558f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:36.017142 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e24534-f0ea-4f32-adaa-21c91f558f94 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:36.032099 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1167/2327] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:53:36.036320 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced1f3e-2535-41a0-8e32-47c82cb0210c admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:36.053000 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced1f3e-2535-41a0-8e32-47c82cb0210c admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:36.059321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126a67f-f4f6-4c24-ba65-a594433b7e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:36.060851 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126a67f-f4f6-4c24-ba65-a594433b7e06 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:36.061365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126a67f-f4f6-4c24-ba65-a594433b7e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:36.061859 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126a67f-f4f6-4c24-ba65-a594433b7e06 admin admin] PATH_INFO: `/v3/projects/512c4d8a58ae44ad9d33280f3adf08eb/users/a68b8d62ceb940469ef66df571f9a7e7/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:36.082548 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126a67f-f4f6-4c24-ba65-a594433b7e06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=512c4d8a58ae44ad9d33280f3adf08eb, user_id=a68b8d62ceb940469ef66df571f9a7e7, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:36.085979 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126a67f-f4f6-4c24-ba65-a594433b7e06 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:36.247484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1161/2328] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:53:36 2022] PUT /identity/v3/projects/512c4d8a58ae44ad9d33280f3adf08eb/users/a68b8d62ceb940469ef66df571f9a7e7/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:53:36.255802 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e24534-f0ea-4f32-adaa-21c91f558f94 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:36.256897 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5649135-ed4c-4069-9a83-f7cb940dffc9 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:36.257211 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5649135-ed4c-4069-9a83-f7cb940dffc9 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:36.257498 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5649135-ed4c-4069-9a83-f7cb940dffc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:36.258630 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-e4e24534-f0ea-4f32-adaa-21c91f558f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:36.276364 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e24534-f0ea-4f32-adaa-21c91f558f94 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:36.283318 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-b5649135-ed4c-4069-9a83-f7cb940dffc9 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:53:36.283580 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b5649135-ed4c-4069-9a83-f7cb940dffc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:36.349146 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:36.359873 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84a594-31a5-4b04-b6a1-26eae07b8afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:36.360777 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84a594-31a5-4b04-b6a1-26eae07b8afc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:36.361052 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84a594-31a5-4b04-b6a1-26eae07b8afc admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:36.361622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84a594-31a5-4b04-b6a1-26eae07b8afc admin admin] PATH_INFO: `/v3/users/3bb7ff0443d345c6a1018c256d12ef5f` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:36.362591 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84a594-31a5-4b04-b6a1-26eae07b8afc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bb7ff0443d345c6a1018c256d12ef5f)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:36.364898 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84a594-31a5-4b04-b6a1-26eae07b8afc admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:36.387791 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1162/2329] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:53:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:53:36.396562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5649135-ed4c-4069-9a83-f7cb940dffc9 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:36.397990 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b5649135-ed4c-4069-9a83-f7cb940dffc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:36.474731 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5649135-ed4c-4069-9a83-f7cb940dffc9 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:36.478785 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53f697-17e0-4aa5-aa23-e95fbcf0aa07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:36.479462 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53f697-17e0-4aa5-aa23-e95fbcf0aa07 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:36.479788 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53f697-17e0-4aa5-aa23-e95fbcf0aa07 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:36.480069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53f697-17e0-4aa5-aa23-e95fbcf0aa07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:36.492359 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53f697-17e0-4aa5-aa23-e95fbcf0aa07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:36.494168 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53f697-17e0-4aa5-aa23-e95fbcf0aa07 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:36.508008 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1163/2330] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:53:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:53:36.573247 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:36.584068 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-eb84a594-31a5-4b04-b6a1-26eae07b8afc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bb7ff0443d345c6a1018c256d12ef5f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:36.585171 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-eb84a594-31a5-4b04-b6a1-26eae07b8afc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bb7ff0443d345c6a1018c256d12ef5f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:36.585833 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-eb84a594-31a5-4b04-b6a1-26eae07b8afc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bb7ff0443d345c6a1018c256d12ef5f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:36.596418 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-eb84a594-31a5-4b04-b6a1-26eae07b8afc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bb7ff0443d345c6a1018c256d12ef5f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:36.696862 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-eb84a594-31a5-4b04-b6a1-26eae07b8afc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bb7ff0443d345c6a1018c256d12ef5f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:36.740757 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1168/2331] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:53:36 2022] DELETE /identity/v3/users/3bb7ff0443d345c6a1018c256d12ef5f => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:53:37.069336 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53f697-17e0-4aa5-aa23-e95fbcf0aa07 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:37.084266 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53f697-17e0-4aa5-aa23-e95fbcf0aa07 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:37.201342 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963de59-fbd1-4690-accb-0568bcf7b1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:37.204246 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963de59-fbd1-4690-accb-0568bcf7b1a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:37.204246 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963de59-fbd1-4690-accb-0568bcf7b1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:37.204246 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963de59-fbd1-4690-accb-0568bcf7b1a4 admin admin] PATH_INFO: `/v3/projects/c70a23973ca549a8ba5ad02f2acbc15b` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:37.204883 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3963de59-fbd1-4690-accb-0568bcf7b1a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c70a23973ca549a8ba5ad02f2acbc15b)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:37.206456 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3963de59-fbd1-4690-accb-0568bcf7b1a4 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:37.361428 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3963de59-fbd1-4690-accb-0568bcf7b1a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c70a23973ca549a8ba5ad02f2acbc15b', 'request_id': 'req-3963de59-fbd1-4690-accb-0568bcf7b1a4'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:37.368069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3963de59-fbd1-4690-accb-0568bcf7b1a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c70a23973ca549a8ba5ad02f2acbc15b', 'request_id': 'req-3963de59-fbd1-4690-accb-0568bcf7b1a4'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:37.374569 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3963de59-fbd1-4690-accb-0568bcf7b1a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c70a23973ca549a8ba5ad02f2acbc15b', 'request_id': 'req-3963de59-fbd1-4690-accb-0568bcf7b1a4'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:37.465638 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3963de59-fbd1-4690-accb-0568bcf7b1a4 admin admin] The token cache is being invalidate because project c70a23973ca549a8ba5ad02f2acbc15b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:53:37.465931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3963de59-fbd1-4690-accb-0568bcf7b1a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:37.466737 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3963de59-fbd1-4690-accb-0568bcf7b1a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:37.468817 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1164/2332] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:53:37 2022] DELETE /identity/v3/projects/c70a23973ca549a8ba5ad02f2acbc15b => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:53:37.472697 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84a594-31a5-4b04-b6a1-26eae07b8afc admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:37.474147 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-eb84a594-31a5-4b04-b6a1-26eae07b8afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:37.491093 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84a594-31a5-4b04-b6a1-26eae07b8afc admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:37.565402 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf8bb1-fed5-43c3-a87d-84e3a8f51e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:37.566532 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf8bb1-fed5-43c3-a87d-84e3a8f51e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:37.567014 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf8bb1-fed5-43c3-a87d-84e3a8f51e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:37.567471 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf8bb1-fed5-43c3-a87d-84e3a8f51e62 admin admin] PATH_INFO: `/v3/users/a0f8a31b4e5e42de85ccc269f922dc5d` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:37.569353 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf8bb1-fed5-43c3-a87d-84e3a8f51e62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0f8a31b4e5e42de85ccc269f922dc5d)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:37.570980 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf8bb1-fed5-43c3-a87d-84e3a8f51e62 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:37.847144 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5ccf8bb1-fed5-43c3-a87d-84e3a8f51e62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0f8a31b4e5e42de85ccc269f922dc5d'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:37.847914 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5ccf8bb1-fed5-43c3-a87d-84e3a8f51e62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0f8a31b4e5e42de85ccc269f922dc5d'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:37.848460 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5ccf8bb1-fed5-43c3-a87d-84e3a8f51e62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0f8a31b4e5e42de85ccc269f922dc5d'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:37.855894 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5ccf8bb1-fed5-43c3-a87d-84e3a8f51e62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0f8a31b4e5e42de85ccc269f922dc5d'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:37.996841 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5ccf8bb1-fed5-43c3-a87d-84e3a8f51e62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0f8a31b4e5e42de85ccc269f922dc5d'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:38.018953 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1169/2333] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:53:37 2022] DELETE /identity/v3/users/a0f8a31b4e5e42de85ccc269f922dc5d => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:53:38.524920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963de59-fbd1-4690-accb-0568bcf7b1a4 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:38.526535 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-3963de59-fbd1-4690-accb-0568bcf7b1a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:38.544503 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963de59-fbd1-4690-accb-0568bcf7b1a4 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:38.637160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745bf38-658f-4b95-8f9c-8b4ad8b99604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:38.641136 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745bf38-658f-4b95-8f9c-8b4ad8b99604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:38.641136 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745bf38-658f-4b95-8f9c-8b4ad8b99604 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:38.641136 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745bf38-658f-4b95-8f9c-8b4ad8b99604 admin admin] PATH_INFO: `/v3/projects/ec8e5721c835421d80d47aaeab67c029` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:38.641473 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745bf38-658f-4b95-8f9c-8b4ad8b99604 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec8e5721c835421d80d47aaeab67c029)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:38.643882 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745bf38-658f-4b95-8f9c-8b4ad8b99604 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:38.691250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac17c88-1fd2-4b4f-b140-3e0127301550 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:38.691907 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac17c88-1fd2-4b4f-b140-3e0127301550 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:38.691907 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac17c88-1fd2-4b4f-b140-3e0127301550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:38.745893 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-3ac17c88-1fd2-4b4f-b140-3e0127301550 None None] MFA Rules not processed for user `35719ec6e5634328aebc7ff6acdf1a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:53:38.747390 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-3ac17c88-1fd2-4b4f-b140-3e0127301550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:38.815371 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:38.835044 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b745bf38-658f-4b95-8f9c-8b4ad8b99604 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec8e5721c835421d80d47aaeab67c029', 'request_id': 'req-b745bf38-658f-4b95-8f9c-8b4ad8b99604'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:38.848761 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1170/2334] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:53:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:53:38.853679 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b745bf38-658f-4b95-8f9c-8b4ad8b99604 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec8e5721c835421d80d47aaeab67c029', 'request_id': 'req-b745bf38-658f-4b95-8f9c-8b4ad8b99604'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:38.866851 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b745bf38-658f-4b95-8f9c-8b4ad8b99604 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec8e5721c835421d80d47aaeab67c029', 'request_id': 'req-b745bf38-658f-4b95-8f9c-8b4ad8b99604'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:39.033805 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b745bf38-658f-4b95-8f9c-8b4ad8b99604 admin admin] The token cache is being invalidate because project ec8e5721c835421d80d47aaeab67c029 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:53:39.034282 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b745bf38-658f-4b95-8f9c-8b4ad8b99604 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:39.035551 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b745bf38-658f-4b95-8f9c-8b4ad8b99604 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:39.038754 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1165/2335] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:53:38 2022] DELETE /identity/v3/projects/ec8e5721c835421d80d47aaeab67c029 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:53:39.047051 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f067261-0a4c-4dfc-810b-38eab4218658 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:39.047713 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f067261-0a4c-4dfc-810b-38eab4218658 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:39.047986 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f067261-0a4c-4dfc-810b-38eab4218658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:39.077002 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-3f067261-0a4c-4dfc-810b-38eab4218658 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:53:39.078319 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-3f067261-0a4c-4dfc-810b-38eab4218658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:39.164013 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:39.171416 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1171/2336] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:53:39.174097 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83360d88-725c-4113-9b3d-627e91b2eb34 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:39.174311 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83360d88-725c-4113-9b3d-627e91b2eb34 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:39.175057 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83360d88-725c-4113-9b3d-627e91b2eb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:39.210052 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-83360d88-725c-4113-9b3d-627e91b2eb34 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:53:39.211166 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-83360d88-725c-4113-9b3d-627e91b2eb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:39.220856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1166/2337] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:53:39.226426 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f067261-0a4c-4dfc-810b-38eab4218658 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:39.240901 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f067261-0a4c-4dfc-810b-38eab4218658 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:39.248514 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f6f5c-b23b-44a8-ae4b-e4ee857036ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:39.249374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f6f5c-b23b-44a8-ae4b-e4ee857036ad admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:39.249663 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f6f5c-b23b-44a8-ae4b-e4ee857036ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:39.249941 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f6f5c-b23b-44a8-ae4b-e4ee857036ad admin admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:39.250740 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f6f5c-b23b-44a8-ae4b-e4ee857036ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:53:39.251056 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f6f5c-b23b-44a8-ae4b-e4ee857036ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:39.252820 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f6f5c-b23b-44a8-ae4b-e4ee857036ad admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:39.270032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1172/2338] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 08:53:39.284178 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83360d88-725c-4113-9b3d-627e91b2eb34 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:39.297872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83360d88-725c-4113-9b3d-627e91b2eb34 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:39.302736 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a902f5-9aa7-48d5-82c7-97825b3f1684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:39.303402 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a902f5-9aa7-48d5-82c7-97825b3f1684 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:39.303745 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a902f5-9aa7-48d5-82c7-97825b3f1684 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:39.303981 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a902f5-9aa7-48d5-82c7-97825b3f1684 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:39.304683 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a902f5-9aa7-48d5-82c7-97825b3f1684 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:39.307503 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a902f5-9aa7-48d5-82c7-97825b3f1684 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:39.524237 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1167/2339] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:53:39 2022] POST /identity/v3/projects => generated 383 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:53:39.528165 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f6f5c-b23b-44a8-ae4b-e4ee857036ad admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:39.542944 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f6f5c-b23b-44a8-ae4b-e4ee857036ad admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:39.626783 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a34bba-9fed-4331-97fa-dd388d383d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:39.627646 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a34bba-9fed-4331-97fa-dd388d383d2f admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:39.628135 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a34bba-9fed-4331-97fa-dd388d383d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:39.628615 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a34bba-9fed-4331-97fa-dd388d383d2f admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:39.629342 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a34bba-9fed-4331-97fa-dd388d383d2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:39.631537 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a34bba-9fed-4331-97fa-dd388d383d2f admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:39.791585 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1173/2340] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:53:39 2022] POST /identity/v3/users => generated 292 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:53:39.798654 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a902f5-9aa7-48d5-82c7-97825b3f1684 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:39.814449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a902f5-9aa7-48d5-82c7-97825b3f1684 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:39.827384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603fac8-57d0-4cff-847a-389eaa8601ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:39.827869 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603fac8-57d0-4cff-847a-389eaa8601ed admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:39.828236 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603fac8-57d0-4cff-847a-389eaa8601ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:39.828584 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603fac8-57d0-4cff-847a-389eaa8601ed admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:39.829593 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3603fac8-57d0-4cff-847a-389eaa8601ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:39.844315 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3603fac8-57d0-4cff-847a-389eaa8601ed admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:39.866431 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1168/2341] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:53:39.869056 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a34bba-9fed-4331-97fa-dd388d383d2f admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:39.895862 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a34bba-9fed-4331-97fa-dd388d383d2f admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:39.905717 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f7d8d-3462-4c37-9551-8374ea114fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:39.907829 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f7d8d-3462-4c37-9551-8374ea114fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:39.908631 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f7d8d-3462-4c37-9551-8374ea114fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:39.909815 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f7d8d-3462-4c37-9551-8374ea114fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:39.911813 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f7d8d-3462-4c37-9551-8374ea114fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:39.916580 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f7d8d-3462-4c37-9551-8374ea114fa5 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:39.938424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1174/2342] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:53:39.942754 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603fac8-57d0-4cff-847a-389eaa8601ed admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:39.956600 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603fac8-57d0-4cff-847a-389eaa8601ed admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:39.963742 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0c577-3448-4766-9920-b26632f371ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:39.964743 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0c577-3448-4766-9920-b26632f371ee admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:39.965104 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0c577-3448-4766-9920-b26632f371ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:39.965452 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0c577-3448-4766-9920-b26632f371ee admin admin] PATH_INFO: `/v3/projects/832611fb4b82454191785729005b1a49/users/12559259d7ba42f68a519d94a7b4e546/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:40.002334 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0c577-3448-4766-9920-b26632f371ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=832611fb4b82454191785729005b1a49, user_id=12559259d7ba42f68a519d94a7b4e546, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:40.008443 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0c577-3448-4766-9920-b26632f371ee admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:40.109830 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1169/2343] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:53:39 2022] PUT /identity/v3/projects/832611fb4b82454191785729005b1a49/users/12559259d7ba42f68a519d94a7b4e546/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:53:40.121299 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6242d-ab81-4269-b2e1-c822db5a55c1 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:40.121672 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6242d-ab81-4269-b2e1-c822db5a55c1 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:40.122015 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6242d-ab81-4269-b2e1-c822db5a55c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:40.167384 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-84e6242d-ab81-4269-b2e1-c822db5a55c1 None None] MFA Rules not processed for user `12559259d7ba42f68a519d94a7b4e546`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:53:40.169034 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-84e6242d-ab81-4269-b2e1-c822db5a55c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:40.271936 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1175/2344] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:53:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:53:40.289263 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0c577-3448-4766-9920-b26632f371ee admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:40.291254 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c4e0c577-3448-4766-9920-b26632f371ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:40.425184 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0c577-3448-4766-9920-b26632f371ee admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:40.429450 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56fb4af-ead4-438c-867e-c1ae7d824fae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:40.430135 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fb4af-ead4-438c-867e-c1ae7d824fae service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:40.431493 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fb4af-ead4-438c-867e-c1ae7d824fae service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:40.431493 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fb4af-ead4-438c-867e-c1ae7d824fae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:40.444177 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56fb4af-ead4-438c-867e-c1ae7d824fae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:40.445663 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56fb4af-ead4-438c-867e-c1ae7d824fae service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:40.457719 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1170/2345] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:53:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:53:41.001205 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:41.288936 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:44.152306 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0ebf3-0c46-4d6e-88fb-f7d819895d4a None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:44.153022 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0ebf3-0c46-4d6e-88fb-f7d819895d4a None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:44.153022 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0ebf3-0c46-4d6e-88fb-f7d819895d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:44.213701 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-5bc0ebf3-0c46-4d6e-88fb-f7d819895d4a None None] MFA Rules not processed for user `a68b8d62ceb940469ef66df571f9a7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:53:44.214939 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-5bc0ebf3-0c46-4d6e-88fb-f7d819895d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:44.351667 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1176/2346] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:53:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:53:44.360583 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56fb4af-ead4-438c-867e-c1ae7d824fae service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:44.362627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f56fb4af-ead4-438c-867e-c1ae7d824fae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:44.475496 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56fb4af-ead4-438c-867e-c1ae7d824fae service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:44.485356 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921c94c-637e-4d4c-a597-f926a3d881f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:44.486390 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921c94c-637e-4d4c-a597-f926a3d881f8 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:44.486747 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921c94c-637e-4d4c-a597-f926a3d881f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:44.487113 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921c94c-637e-4d4c-a597-f926a3d881f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:44.487923 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921c94c-637e-4d4c-a597-f926a3d881f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:44.491728 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921c94c-637e-4d4c-a597-f926a3d881f8 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:44.623227 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1171/2347] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:53:44 2022] POST /identity/v3/projects => generated 377 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:53:44.627909 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0ebf3-0c46-4d6e-88fb-f7d819895d4a None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:44.643000 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0ebf3-0c46-4d6e-88fb-f7d819895d4a None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:44.734700 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e5a42-a847-438d-9f7a-09a90989dc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:44.734700 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e5a42-a847-438d-9f7a-09a90989dc17 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:44.735140 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e5a42-a847-438d-9f7a-09a90989dc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:44.735500 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e5a42-a847-438d-9f7a-09a90989dc17 admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:44.736761 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e5a42-a847-438d-9f7a-09a90989dc17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:44.740844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e5a42-a847-438d-9f7a-09a90989dc17 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:44.832638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1177/2348] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:53:44 2022] POST /identity/v3/users => generated 295 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:53:44.838736 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921c94c-637e-4d4c-a597-f926a3d881f8 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:44.858307 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921c94c-637e-4d4c-a597-f926a3d881f8 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:44.865546 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4248e50-99c2-412f-8641-bf4c1f4872a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:44.866568 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4248e50-99c2-412f-8641-bf4c1f4872a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:44.867075 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4248e50-99c2-412f-8641-bf4c1f4872a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:44.867474 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4248e50-99c2-412f-8641-bf4c1f4872a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:44.868615 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4248e50-99c2-412f-8641-bf4c1f4872a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:44.870571 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4248e50-99c2-412f-8641-bf4c1f4872a7 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:44.899735 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1172/2349] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:53:44.903210 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e5a42-a847-438d-9f7a-09a90989dc17 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:44.920066 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e5a42-a847-438d-9f7a-09a90989dc17 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:44.926075 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0a470-1ecd-4d9c-a584-c3af3b8d2bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:44.927038 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0a470-1ecd-4d9c-a584-c3af3b8d2bdc admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:44.927323 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0a470-1ecd-4d9c-a584-c3af3b8d2bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:44.927602 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0a470-1ecd-4d9c-a584-c3af3b8d2bdc admin admin] PATH_INFO: `/v3/projects/c4dbcf21c87342d486ea9f412712d08d/users/532aea5062f946ddbc5dc3d78c62c47b/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:44.946208 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0a470-1ecd-4d9c-a584-c3af3b8d2bdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4dbcf21c87342d486ea9f412712d08d, user_id=532aea5062f946ddbc5dc3d78c62c47b, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:44.949357 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0a470-1ecd-4d9c-a584-c3af3b8d2bdc admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:45.043833 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1178/2350] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:53:44 2022] PUT /identity/v3/projects/c4dbcf21c87342d486ea9f412712d08d/users/532aea5062f946ddbc5dc3d78c62c47b/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:53:45.048648 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4248e50-99c2-412f-8641-bf4c1f4872a7 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:45.059577 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4248e50-99c2-412f-8641-bf4c1f4872a7 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:45.133349 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f73db-9d52-4adf-9885-5172991d48bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:45.134128 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f73db-9d52-4adf-9885-5172991d48bd admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:45.134567 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f73db-9d52-4adf-9885-5172991d48bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:45.134887 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f73db-9d52-4adf-9885-5172991d48bd admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:45.135789 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f73db-9d52-4adf-9885-5172991d48bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:45.137413 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f73db-9d52-4adf-9885-5172991d48bd admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:45.148783 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1173/2351] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:53:45.153190 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0a470-1ecd-4d9c-a584-c3af3b8d2bdc admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:45.165243 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0a470-1ecd-4d9c-a584-c3af3b8d2bdc admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:45.175545 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136db2fd-af17-4d56-9bc1-cd9241baf1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:45.176720 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136db2fd-af17-4d56-9bc1-cd9241baf1e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:45.181038 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136db2fd-af17-4d56-9bc1-cd9241baf1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:45.181038 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136db2fd-af17-4d56-9bc1-cd9241baf1e0 admin admin] PATH_INFO: `/v3/projects/c4dbcf21c87342d486ea9f412712d08d/users/532aea5062f946ddbc5dc3d78c62c47b/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:45.182129 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136db2fd-af17-4d56-9bc1-cd9241baf1e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4dbcf21c87342d486ea9f412712d08d, user_id=532aea5062f946ddbc5dc3d78c62c47b, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:45.185067 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136db2fd-af17-4d56-9bc1-cd9241baf1e0 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:45.200371 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1179/2352] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:53:45 2022] PUT /identity/v3/projects/c4dbcf21c87342d486ea9f412712d08d/users/532aea5062f946ddbc5dc3d78c62c47b/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:53:52.182835 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d71abe-69ac-4926-8f79-07b21cac00ee None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:52.183393 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d71abe-69ac-4926-8f79-07b21cac00ee None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:52.183393 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d71abe-69ac-4926-8f79-07b21cac00ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:52.222799 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-f0d71abe-69ac-4926-8f79-07b21cac00ee None None] MFA Rules not processed for user `532aea5062f946ddbc5dc3d78c62c47b`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:53:52.224176 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f0d71abe-69ac-4926-8f79-07b21cac00ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:52.280918 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:52.323205 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1174/2353] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:53:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:53:52.331029 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136db2fd-af17-4d56-9bc1-cd9241baf1e0 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:52.333104 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-136db2fd-af17-4d56-9bc1-cd9241baf1e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:52.371395 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:52.446020 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136db2fd-af17-4d56-9bc1-cd9241baf1e0 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:52.454210 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92aa13-7b23-4f35-b2cf-1d415f9c52d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:52.455103 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92aa13-7b23-4f35-b2cf-1d415f9c52d3 service nova] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:52.455394 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92aa13-7b23-4f35-b2cf-1d415f9c52d3 service nova] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:52.455707 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92aa13-7b23-4f35-b2cf-1d415f9c52d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:52.527830 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92aa13-7b23-4f35-b2cf-1d415f9c52d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:52.529903 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92aa13-7b23-4f35-b2cf-1d415f9c52d3 service nova] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:52.542370 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1180/2354] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:53:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:53:56.807560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d71abe-69ac-4926-8f79-07b21cac00ee None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:56.906592 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d71abe-69ac-4926-8f79-07b21cac00ee None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:56.912233 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b56a4-473c-4c94-b25b-1c39120cc130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:56.912823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b56a4-473c-4c94-b25b-1c39120cc130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:56.913032 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b56a4-473c-4c94-b25b-1c39120cc130 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:56.913314 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b56a4-473c-4c94-b25b-1c39120cc130 admin admin] PATH_INFO: `/v3/users/12559259d7ba42f68a519d94a7b4e546` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:56.914759 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b56a4-473c-4c94-b25b-1c39120cc130 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12559259d7ba42f68a519d94a7b4e546)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:56.916963 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b56a4-473c-4c94-b25b-1c39120cc130 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:57.103136 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-485b56a4-473c-4c94-b25b-1c39120cc130 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12559259d7ba42f68a519d94a7b4e546'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:57.104161 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-485b56a4-473c-4c94-b25b-1c39120cc130 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12559259d7ba42f68a519d94a7b4e546'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:57.116081 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-485b56a4-473c-4c94-b25b-1c39120cc130 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12559259d7ba42f68a519d94a7b4e546'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:57.126867 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-485b56a4-473c-4c94-b25b-1c39120cc130 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12559259d7ba42f68a519d94a7b4e546'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:57.219887 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-485b56a4-473c-4c94-b25b-1c39120cc130 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12559259d7ba42f68a519d94a7b4e546'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:57.255438 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1175/2355] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:53:56 2022] DELETE /identity/v3/users/12559259d7ba42f68a519d94a7b4e546 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:53:57.260571 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d8957-c55d-458d-bd07-15368ad69d6f None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:57.261078 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d8957-c55d-458d-bd07-15368ad69d6f None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:57.264749 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d8957-c55d-458d-bd07-15368ad69d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:57.286348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-bc0d8957-c55d-458d-bd07-15368ad69d6f None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:53:57.288459 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-bc0d8957-c55d-458d-bd07-15368ad69d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:57.360773 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1181/2356] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:53:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:53:57.370894 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b56a4-473c-4c94-b25b-1c39120cc130 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:57.372682 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-485b56a4-473c-4c94-b25b-1c39120cc130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:57.466438 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b56a4-473c-4c94-b25b-1c39120cc130 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:57.473378 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7575613-8d8a-460a-aff7-95e7e263d41e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:57.474431 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7575613-8d8a-460a-aff7-95e7e263d41e service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:57.475054 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7575613-8d8a-460a-aff7-95e7e263d41e service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:57.475779 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7575613-8d8a-460a-aff7-95e7e263d41e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:57.495195 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7575613-8d8a-460a-aff7-95e7e263d41e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:57.496705 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7575613-8d8a-460a-aff7-95e7e263d41e service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:57.503996 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:57.509503 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1176/2357] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:53:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:53:58.094724 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d8957-c55d-458d-bd07-15368ad69d6f None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:58.096402 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-bc0d8957-c55d-458d-bd07-15368ad69d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:58.110913 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d8957-c55d-458d-bd07-15368ad69d6f None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:58.127944 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02141f-7d44-4919-a08b-91c0130878d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:58.127944 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02141f-7d44-4919-a08b-91c0130878d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:58.127944 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02141f-7d44-4919-a08b-91c0130878d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:58.127944 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02141f-7d44-4919-a08b-91c0130878d0 admin admin] PATH_INFO: `/v3/projects/832611fb4b82454191785729005b1a49` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:58.128301 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02141f-7d44-4919-a08b-91c0130878d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=832611fb4b82454191785729005b1a49)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:58.128301 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02141f-7d44-4919-a08b-91c0130878d0 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:58.339790 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-ef02141f-7d44-4919-a08b-91c0130878d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '832611fb4b82454191785729005b1a49', 'request_id': 'req-ef02141f-7d44-4919-a08b-91c0130878d0'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:58.340907 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:58.349811 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-ef02141f-7d44-4919-a08b-91c0130878d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '832611fb4b82454191785729005b1a49', 'request_id': 'req-ef02141f-7d44-4919-a08b-91c0130878d0'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:58.356843 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-ef02141f-7d44-4919-a08b-91c0130878d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '832611fb4b82454191785729005b1a49', 'request_id': 'req-ef02141f-7d44-4919-a08b-91c0130878d0'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:58.511513 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-ef02141f-7d44-4919-a08b-91c0130878d0 admin admin] The token cache is being invalidate because project 832611fb4b82454191785729005b1a49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:53:58.511958 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-ef02141f-7d44-4919-a08b-91c0130878d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:58.512658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-ef02141f-7d44-4919-a08b-91c0130878d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:53:58.515192 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1182/2358] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:53:58 2022] DELETE /identity/v3/projects/832611fb4b82454191785729005b1a49 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:53:58.530071 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61d6c2-6aeb-4919-94f2-8af08287b4b0 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:58.531362 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61d6c2-6aeb-4919-94f2-8af08287b4b0 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:58.531362 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61d6c2-6aeb-4919-94f2-8af08287b4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:58.553309 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-4e61d6c2-6aeb-4919-94f2-8af08287b4b0 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:53:58.554557 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4e61d6c2-6aeb-4919-94f2-8af08287b4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:58.621034 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1177/2359] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:53:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:53:58.629917 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a5bd1-531d-4e3b-abee-b96c7cd4009e None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:58.630206 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a5bd1-531d-4e3b-abee-b96c7cd4009e None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:58.630489 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a5bd1-531d-4e3b-abee-b96c7cd4009e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:58.652398 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-1f6a5bd1-531d-4e3b-abee-b96c7cd4009e None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:53:58.654086 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-1f6a5bd1-531d-4e3b-abee-b96c7cd4009e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:58.664856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1183/2360] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:53:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:53:58.669379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61d6c2-6aeb-4919-94f2-8af08287b4b0 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:58.679824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61d6c2-6aeb-4919-94f2-8af08287b4b0 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:58.686552 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963a179-4b50-4633-8d29-18ed13db167d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:58.687233 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963a179-4b50-4633-8d29-18ed13db167d admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:58.687559 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963a179-4b50-4633-8d29-18ed13db167d admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:58.687872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963a179-4b50-4633-8d29-18ed13db167d admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:58.688638 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0963a179-4b50-4633-8d29-18ed13db167d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:53:58.688951 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0963a179-4b50-4633-8d29-18ed13db167d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:58.690573 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0963a179-4b50-4633-8d29-18ed13db167d admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:58.704133 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1178/2361] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:53:58.711301 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a5bd1-531d-4e3b-abee-b96c7cd4009e None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:58.724927 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a5bd1-531d-4e3b-abee-b96c7cd4009e None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:58.732467 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92f372-5e61-49c6-9602-c6f46ea709f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:58.733151 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92f372-5e61-49c6-9602-c6f46ea709f1 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:58.733440 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92f372-5e61-49c6-9602-c6f46ea709f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:58.733726 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92f372-5e61-49c6-9602-c6f46ea709f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:58.734440 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92f372-5e61-49c6-9602-c6f46ea709f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:58.736446 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92f372-5e61-49c6-9602-c6f46ea709f1 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:58.846662 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1184/2362] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:53:58 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:53:58.850140 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963a179-4b50-4633-8d29-18ed13db167d admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:58.861268 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963a179-4b50-4633-8d29-18ed13db167d admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:58.925362 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81256b-7d95-4d36-9b69-33b5b86cda32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:58.926045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81256b-7d95-4d36-9b69-33b5b86cda32 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:58.926329 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81256b-7d95-4d36-9b69-33b5b86cda32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:58.926749 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81256b-7d95-4d36-9b69-33b5b86cda32 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:58.927458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81256b-7d95-4d36-9b69-33b5b86cda32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:58.929465 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81256b-7d95-4d36-9b69-33b5b86cda32 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:59.012019 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1179/2363] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:53:58 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:53:59.017253 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92f372-5e61-49c6-9602-c6f46ea709f1 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:59.032065 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92f372-5e61-49c6-9602-c6f46ea709f1 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:59.038109 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e3acf-9163-4377-ad09-03c097c346cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:59.039178 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e3acf-9163-4377-ad09-03c097c346cb admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:59.039669 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e3acf-9163-4377-ad09-03c097c346cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:59.040108 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e3acf-9163-4377-ad09-03c097c346cb admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:59.041272 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e3acf-9163-4377-ad09-03c097c346cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:59.043638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e3acf-9163-4377-ad09-03c097c346cb admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:59.059550 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1185/2364] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:53:59.064732 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81256b-7d95-4d36-9b69-33b5b86cda32 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:59.082732 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81256b-7d95-4d36-9b69-33b5b86cda32 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:59.090212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6248d-504f-4aae-8137-127faebaf57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:59.092047 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6248d-504f-4aae-8137-127faebaf57c admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:59.092405 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6248d-504f-4aae-8137-127faebaf57c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:59.092845 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6248d-504f-4aae-8137-127faebaf57c admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:59.094069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6248d-504f-4aae-8137-127faebaf57c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:59.096869 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6248d-504f-4aae-8137-127faebaf57c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:59.109952 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1180/2365] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:53:59.116724 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e3acf-9163-4377-ad09-03c097c346cb admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:59.128241 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e3acf-9163-4377-ad09-03c097c346cb admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:59.133116 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd39b2-f933-4835-8df3-3829c69a795f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:59.134105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd39b2-f933-4835-8df3-3829c69a795f admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:59.134482 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd39b2-f933-4835-8df3-3829c69a795f admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:59.134655 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd39b2-f933-4835-8df3-3829c69a795f admin admin] PATH_INFO: `/v3/projects/ee36fffea5054d7ea32ec274068a7594/users/3b53701b3f834c6499abcf89662e7d1d/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:59.152604 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd39b2-f933-4835-8df3-3829c69a795f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee36fffea5054d7ea32ec274068a7594, user_id=3b53701b3f834c6499abcf89662e7d1d, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:59.155684 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd39b2-f933-4835-8df3-3829c69a795f admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:59.214775 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1186/2366] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:53:59 2022] PUT /identity/v3/projects/ee36fffea5054d7ea32ec274068a7594/users/3b53701b3f834c6499abcf89662e7d1d/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:53:59.226502 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e3b73-7cbe-477d-9d81-c929aa08eb06 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:59.226811 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e3b73-7cbe-477d-9d81-c929aa08eb06 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:59.227091 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e3b73-7cbe-477d-9d81-c929aa08eb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:59.257738 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-993e3b73-7cbe-477d-9d81-c929aa08eb06 None None] MFA Rules not processed for user `3b53701b3f834c6499abcf89662e7d1d`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:53:59.259309 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-993e3b73-7cbe-477d-9d81-c929aa08eb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:59.322978 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:53:59.333449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1181/2367] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:53:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:53:59.345082 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd39b2-f933-4835-8df3-3829c69a795f admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:53:59.347105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-e1dd39b2-f933-4835-8df3-3829c69a795f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:53:59.412204 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd39b2-f933-4835-8df3-3829c69a795f admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:53:59.416789 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a4475-9f34-44ed-afda-4c819a397223 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:53:59.417459 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a4475-9f34-44ed-afda-4c819a397223 service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:53:59.417747 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a4475-9f34-44ed-afda-4c819a397223 service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:53:59.418121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a4475-9f34-44ed-afda-4c819a397223 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:53:59.428541 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a4475-9f34-44ed-afda-4c819a397223 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:53:59.430090 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a4475-9f34-44ed-afda-4c819a397223 service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:53:59.441488 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1187/2368] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:53:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:54:07.600928 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511443c-3b50-4577-8075-91b553e357d3 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:07.601411 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511443c-3b50-4577-8075-91b553e357d3 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:07.601411 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511443c-3b50-4577-8075-91b553e357d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:07.627436 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-4511443c-3b50-4577-8075-91b553e357d3 None None] MFA Rules not processed for user `b3c1d56bc0a64411a68f97a4417b0379`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:54:07.627606 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4511443c-3b50-4577-8075-91b553e357d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:54:07.705056 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1182/2369] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Jul 25 08:54:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:54:07.757427 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a4475-9f34-44ed-afda-4c819a397223 service cinder] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:54:07.759204 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-6f7a4475-9f34-44ed-afda-4c819a397223 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:54:07.863441 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a4475-9f34-44ed-afda-4c819a397223 service cinder] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:54:07.868808 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6cbc54-43e5-4f61-b99e-ba3faece3712 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2763e540681547d3a6677567b3be86ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:54:07.869474 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cbc54-43e5-4f61-b99e-ba3faece3712 service swift] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:07.869756 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cbc54-43e5-4f61-b99e-ba3faece3712 service swift] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:07.870030 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cbc54-43e5-4f61-b99e-ba3faece3712 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:07.880497 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6cbc54-43e5-4f61-b99e-ba3faece3712 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:54:07.882141 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6cbc54-43e5-4f61-b99e-ba3faece3712 service swift] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:54:07.892046 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1188/2370] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Jul 25 08:54:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 08:54:17.693622 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=27 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:54:17.888250 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=91,keystone:DELETE=3,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:54:31.429936 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4243e-4a5c-49d4-9f74-dc1ca4b486cc None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:31.430461 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4243e-4a5c-49d4-9f74-dc1ca4b486cc None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:31.430563 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4243e-4a5c-49d4-9f74-dc1ca4b486cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:31.456532 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-5ad4243e-4a5c-49d4-9f74-dc1ca4b486cc None None] MFA Rules not processed for user `b3c1d56bc0a64411a68f97a4417b0379`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:54:31.458042 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-5ad4243e-4a5c-49d4-9f74-dc1ca4b486cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:54:31.468098 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1183/2371] 10.222.0.18 () {58 vars in 967 bytes} [Mon Jul 25 08:54:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:54:31.484478 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6cbc54-43e5-4f61-b99e-ba3faece3712 service swift] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:54:31.495375 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6cbc54-43e5-4f61-b99e-ba3faece3712 service swift] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:54:31.502455 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b9436-6502-44e3-8388-6291981006d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2763e540681547d3a6677567b3be86ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:54:31.503348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b9436-6502-44e3-8388-6291981006d2 service swift] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:31.503515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b9436-6502-44e3-8388-6291981006d2 service swift] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:31.503731 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b9436-6502-44e3-8388-6291981006d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:31.513548 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b9436-6502-44e3-8388-6291981006d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:54:31.516720 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b9436-6502-44e3-8388-6291981006d2 service swift] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:54:31.527089 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1189/2372] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Jul 25 08:54:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 08:54:38.060248 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4243e-4a5c-49d4-9f74-dc1ca4b486cc None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:54:38.066739 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-5ad4243e-4a5c-49d4-9f74-dc1ca4b486cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:54:38.135680 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4243e-4a5c-49d4-9f74-dc1ca4b486cc None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:54:38.140663 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f520109-1435-40c9-8982-8b41581befae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:54:38.141674 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f520109-1435-40c9-8982-8b41581befae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:38.142221 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f520109-1435-40c9-8982-8b41581befae admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:38.142664 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f520109-1435-40c9-8982-8b41581befae admin admin] PATH_INFO: `/v3/users/45fef5bf7c914f538eb1bf71623524fd` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:38.143937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f520109-1435-40c9-8982-8b41581befae admin admin] RBAC: Authorizing `identity:delete_user(user_id=45fef5bf7c914f538eb1bf71623524fd)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:54:38.145942 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f520109-1435-40c9-8982-8b41581befae admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:54:38.360017 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-5f520109-1435-40c9-8982-8b41581befae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45fef5bf7c914f538eb1bf71623524fd'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:54:38.361211 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-5f520109-1435-40c9-8982-8b41581befae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45fef5bf7c914f538eb1bf71623524fd'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:54:38.369405 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-5f520109-1435-40c9-8982-8b41581befae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45fef5bf7c914f538eb1bf71623524fd'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:54:38.370146 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-5f520109-1435-40c9-8982-8b41581befae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45fef5bf7c914f538eb1bf71623524fd'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:54:38.430540 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-5f520109-1435-40c9-8982-8b41581befae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45fef5bf7c914f538eb1bf71623524fd'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:54:38.450061 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1184/2373] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:54:38 2022] DELETE /identity/v3/users/45fef5bf7c914f538eb1bf71623524fd => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:54:38.687409 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b9436-6502-44e3-8388-6291981006d2 service swift] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:54:38.695312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b9436-6502-44e3-8388-6291981006d2 service swift] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:54:38.770928 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe46eb-d778-4444-b259-5d25765c031f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:54:38.771840 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe46eb-d778-4444-b259-5d25765c031f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:38.772136 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe46eb-d778-4444-b259-5d25765c031f admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:38.772410 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe46eb-d778-4444-b259-5d25765c031f admin admin] PATH_INFO: `/v3/projects/85fe1e21c87f4daea07c283b0545f041` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:38.773644 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe46eb-d778-4444-b259-5d25765c031f admin admin] RBAC: Authorizing `identity:delete_project(project_id=85fe1e21c87f4daea07c283b0545f041)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:54:38.775557 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe46eb-d778-4444-b259-5d25765c031f admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:54:38.887401 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f2a23-87d7-4421-a6bc-62fa857c0282 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:38.887728 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f2a23-87d7-4421-a6bc-62fa857c0282 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:38.888015 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f2a23-87d7-4421-a6bc-62fa857c0282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:38.910384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-de6f2a23-87d7-4421-a6bc-62fa857c0282 None None] MFA Rules not processed for user `a68b8d62ceb940469ef66df571f9a7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:54:38.911973 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-de6f2a23-87d7-4421-a6bc-62fa857c0282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:54:38.913821 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-63fe46eb-d778-4444-b259-5d25765c031f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85fe1e21c87f4daea07c283b0545f041', 'request_id': 'req-63fe46eb-d778-4444-b259-5d25765c031f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:54:38.924148 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-63fe46eb-d778-4444-b259-5d25765c031f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85fe1e21c87f4daea07c283b0545f041', 'request_id': 'req-63fe46eb-d778-4444-b259-5d25765c031f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:54:38.936619 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-63fe46eb-d778-4444-b259-5d25765c031f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85fe1e21c87f4daea07c283b0545f041', 'request_id': 'req-63fe46eb-d778-4444-b259-5d25765c031f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:54:38.983762 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1185/2374] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:54:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:54:39.029739 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-63fe46eb-d778-4444-b259-5d25765c031f admin admin] The token cache is being invalidate because project 85fe1e21c87f4daea07c283b0545f041 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:54:39.030159 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-63fe46eb-d778-4444-b259-5d25765c031f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:54:39.030892 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-63fe46eb-d778-4444-b259-5d25765c031f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:54:39.033699 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1190/2375] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:54:38 2022] DELETE /identity/v3/projects/85fe1e21c87f4daea07c283b0545f041 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:54:39.044561 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafb9b6-7c7d-4cd2-b8ed-ad1bfcf32528 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:39.044721 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafb9b6-7c7d-4cd2-b8ed-ad1bfcf32528 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:39.045035 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafb9b6-7c7d-4cd2-b8ed-ad1bfcf32528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:39.067452 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-faafb9b6-7c7d-4cd2-b8ed-ad1bfcf32528 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:54:39.068751 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-faafb9b6-7c7d-4cd2-b8ed-ad1bfcf32528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:54:39.092977 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:54:39.150562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1186/2376] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:54:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:54:39.158473 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bce3c2-f07c-40f3-8cd3-1367a6c6ef1e None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:39.162267 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bce3c2-f07c-40f3-8cd3-1367a6c6ef1e None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:39.162267 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bce3c2-f07c-40f3-8cd3-1367a6c6ef1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:39.180095 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-f8bce3c2-f07c-40f3-8cd3-1367a6c6ef1e None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:54:39.181346 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-f8bce3c2-f07c-40f3-8cd3-1367a6c6ef1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:54:39.190271 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1191/2377] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:54:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:54:39.194633 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faafb9b6-7c7d-4cd2-b8ed-ad1bfcf32528 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:54:39.205271 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faafb9b6-7c7d-4cd2-b8ed-ad1bfcf32528 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:54:39.210689 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103f2c9-6f7b-49a3-aba0-9e71c57cf6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:54:39.213812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103f2c9-6f7b-49a3-aba0-9e71c57cf6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:39.213812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103f2c9-6f7b-49a3-aba0-9e71c57cf6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:39.213812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103f2c9-6f7b-49a3-aba0-9e71c57cf6d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:39.213812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103f2c9-6f7b-49a3-aba0-9e71c57cf6d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:54:39.213812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103f2c9-6f7b-49a3-aba0-9e71c57cf6d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:54:39.214772 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103f2c9-6f7b-49a3-aba0-9e71c57cf6d9 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:54:39.227481 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1187/2378] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:54:39.232015 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bce3c2-f07c-40f3-8cd3-1367a6c6ef1e None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:54:39.241794 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bce3c2-f07c-40f3-8cd3-1367a6c6ef1e None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:54:39.246537 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69434ab7-67d2-47ba-9969-77cf23300cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:54:39.247232 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69434ab7-67d2-47ba-9969-77cf23300cdd admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:39.247516 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69434ab7-67d2-47ba-9969-77cf23300cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:39.247823 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69434ab7-67d2-47ba-9969-77cf23300cdd admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:39.248535 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69434ab7-67d2-47ba-9969-77cf23300cdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:54:39.250446 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69434ab7-67d2-47ba-9969-77cf23300cdd admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:54:39.317876 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1192/2379] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:54:39 2022] POST /identity/v3/projects => generated 367 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:54:39.322127 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103f2c9-6f7b-49a3-aba0-9e71c57cf6d9 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:54:39.333306 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103f2c9-6f7b-49a3-aba0-9e71c57cf6d9 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:54:39.409632 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2d484-3eaa-4252-8184-a4c91bb374db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:54:39.410463 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2d484-3eaa-4252-8184-a4c91bb374db admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:39.414026 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2d484-3eaa-4252-8184-a4c91bb374db admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:39.414026 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2d484-3eaa-4252-8184-a4c91bb374db admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:39.414026 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2d484-3eaa-4252-8184-a4c91bb374db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:54:39.414026 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2d484-3eaa-4252-8184-a4c91bb374db admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:54:39.524741 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1188/2380] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:54:39 2022] POST /identity/v3/users => generated 284 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 08:54:39.529454 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69434ab7-67d2-47ba-9969-77cf23300cdd admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:54:39.551331 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69434ab7-67d2-47ba-9969-77cf23300cdd admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:54:39.556435 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771237b5-4328-4a92-a1d0-45001a1621b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:54:39.557296 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771237b5-4328-4a92-a1d0-45001a1621b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:39.557870 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771237b5-4328-4a92-a1d0-45001a1621b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:39.558215 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771237b5-4328-4a92-a1d0-45001a1621b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:39.559042 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771237b5-4328-4a92-a1d0-45001a1621b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:54:39.560776 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771237b5-4328-4a92-a1d0-45001a1621b7 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:54:39.572184 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1193/2381] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:54:39.576294 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2d484-3eaa-4252-8184-a4c91bb374db admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:54:39.587309 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2d484-3eaa-4252-8184-a4c91bb374db admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:54:39.593560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3ab0e-ec2e-4580-bd33-7da495be4bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:54:39.594337 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3ab0e-ec2e-4580-bd33-7da495be4bff admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:39.595293 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3ab0e-ec2e-4580-bd33-7da495be4bff admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:39.595867 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3ab0e-ec2e-4580-bd33-7da495be4bff admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:39.601821 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3ab0e-ec2e-4580-bd33-7da495be4bff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:54:39.601821 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3ab0e-ec2e-4580-bd33-7da495be4bff admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:54:39.612082 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1189/2382] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:54:39.616539 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771237b5-4328-4a92-a1d0-45001a1621b7 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:54:39.630498 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771237b5-4328-4a92-a1d0-45001a1621b7 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:54:39.635448 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebba92a-0c67-43e1-b1eb-feaeb7e43492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:54:39.636413 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebba92a-0c67-43e1-b1eb-feaeb7e43492 admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:39.636902 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebba92a-0c67-43e1-b1eb-feaeb7e43492 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:39.637179 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebba92a-0c67-43e1-b1eb-feaeb7e43492 admin admin] PATH_INFO: `/v3/projects/baa35d8034cd4459931fbdbfcc2be313/users/f9a234fbb23c42aeaa6a1fd3cbed093e/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:39.657243 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebba92a-0c67-43e1-b1eb-feaeb7e43492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baa35d8034cd4459931fbdbfcc2be313, user_id=f9a234fbb23c42aeaa6a1fd3cbed093e, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:54:39.661286 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebba92a-0c67-43e1-b1eb-feaeb7e43492 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:54:39.745333 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1194/2383] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:54:39 2022] PUT /identity/v3/projects/baa35d8034cd4459931fbdbfcc2be313/users/f9a234fbb23c42aeaa6a1fd3cbed093e/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:54:39.756382 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c993f-b19b-4176-93da-435ef6b3a695 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:39.756771 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c993f-b19b-4176-93da-435ef6b3a695 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:39.757123 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c993f-b19b-4176-93da-435ef6b3a695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:39.792449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-f73c993f-b19b-4176-93da-435ef6b3a695 None None] MFA Rules not processed for user `f9a234fbb23c42aeaa6a1fd3cbed093e`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:54:39.793685 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f73c993f-b19b-4176-93da-435ef6b3a695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:54:39.872540 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1190/2384] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:54:39 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:54:39.884072 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebba92a-0c67-43e1-b1eb-feaeb7e43492 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:54:39.886123 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-2ebba92a-0c67-43e1-b1eb-feaeb7e43492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:54:39.902949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:54:39.951734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebba92a-0c67-43e1-b1eb-feaeb7e43492 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:54:39.956869 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2be6c9-27aa-4bc7-adf7-ced4e37abb1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:54:39.957526 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2be6c9-27aa-4bc7-adf7-ced4e37abb1e service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:39.957815 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2be6c9-27aa-4bc7-adf7-ced4e37abb1e service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:39.958100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2be6c9-27aa-4bc7-adf7-ced4e37abb1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:39.967654 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2be6c9-27aa-4bc7-adf7-ced4e37abb1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:54:39.969008 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2be6c9-27aa-4bc7-adf7-ced4e37abb1e service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:54:39.978673 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1195/2385] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:54:39 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:54:40.005662 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c993f-b19b-4176-93da-435ef6b3a695 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:54:40.021644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:54:40.087886 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c993f-b19b-4176-93da-435ef6b3a695 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:54:40.092943 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667e907-eba7-4b74-b6ec-957756f67c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:54:40.093840 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667e907-eba7-4b74-b6ec-957756f67c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:40.094129 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667e907-eba7-4b74-b6ec-957756f67c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:40.094410 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667e907-eba7-4b74-b6ec-957756f67c7c admin admin] PATH_INFO: `/v3/users/f9a234fbb23c42aeaa6a1fd3cbed093e` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:40.098712 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667e907-eba7-4b74-b6ec-957756f67c7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9a234fbb23c42aeaa6a1fd3cbed093e)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:54:40.100905 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667e907-eba7-4b74-b6ec-957756f67c7c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:54:40.323531 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-0667e907-eba7-4b74-b6ec-957756f67c7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9a234fbb23c42aeaa6a1fd3cbed093e'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:54:40.324355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-0667e907-eba7-4b74-b6ec-957756f67c7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9a234fbb23c42aeaa6a1fd3cbed093e'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:54:40.336414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-0667e907-eba7-4b74-b6ec-957756f67c7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9a234fbb23c42aeaa6a1fd3cbed093e'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:54:40.340672 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-0667e907-eba7-4b74-b6ec-957756f67c7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9a234fbb23c42aeaa6a1fd3cbed093e'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:54:40.413068 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-0667e907-eba7-4b74-b6ec-957756f67c7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9a234fbb23c42aeaa6a1fd3cbed093e'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:54:40.436155 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1191/2386] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:54:40 2022] DELETE /identity/v3/users/f9a234fbb23c42aeaa6a1fd3cbed093e => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:54:40.442117 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8f974-c1c1-43f1-a2be-4ad52836d113 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:40.442951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8f974-c1c1-43f1-a2be-4ad52836d113 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:40.443234 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8f974-c1c1-43f1-a2be-4ad52836d113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:40.465592 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-77b8f974-c1c1-43f1-a2be-4ad52836d113 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:54:40.466832 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-77b8f974-c1c1-43f1-a2be-4ad52836d113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:54:40.546406 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1196/2387] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:54:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:54:40.559575 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667e907-eba7-4b74-b6ec-957756f67c7c admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:54:40.561112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0667e907-eba7-4b74-b6ec-957756f67c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:54:40.629940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667e907-eba7-4b74-b6ec-957756f67c7c admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:54:40.635412 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9eab0-7bce-40e0-a93c-b5adb8a18ed8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:54:40.636525 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9eab0-7bce-40e0-a93c-b5adb8a18ed8 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:40.637080 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9eab0-7bce-40e0-a93c-b5adb8a18ed8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:40.637558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9eab0-7bce-40e0-a93c-b5adb8a18ed8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:40.649616 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9eab0-7bce-40e0-a93c-b5adb8a18ed8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:54:40.651048 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9eab0-7bce-40e0-a93c-b5adb8a18ed8 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:54:40.661794 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1192/2388] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:54:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:54:41.524518 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8f974-c1c1-43f1-a2be-4ad52836d113 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:54:41.525815 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-77b8f974-c1c1-43f1-a2be-4ad52836d113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:54:41.539543 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8f974-c1c1-43f1-a2be-4ad52836d113 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:54:41.544261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156ef13-9d57-4919-9a0d-66717fee43dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:54:41.545130 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156ef13-9d57-4919-9a0d-66717fee43dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:41.545415 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156ef13-9d57-4919-9a0d-66717fee43dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:41.545694 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156ef13-9d57-4919-9a0d-66717fee43dd admin admin] PATH_INFO: `/v3/projects/baa35d8034cd4459931fbdbfcc2be313` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:41.546883 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156ef13-9d57-4919-9a0d-66717fee43dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=baa35d8034cd4459931fbdbfcc2be313)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:54:41.549373 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156ef13-9d57-4919-9a0d-66717fee43dd admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:54:41.663079 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-2156ef13-9d57-4919-9a0d-66717fee43dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baa35d8034cd4459931fbdbfcc2be313', 'request_id': 'req-2156ef13-9d57-4919-9a0d-66717fee43dd'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:54:41.670016 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-2156ef13-9d57-4919-9a0d-66717fee43dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baa35d8034cd4459931fbdbfcc2be313', 'request_id': 'req-2156ef13-9d57-4919-9a0d-66717fee43dd'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:54:41.678109 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-2156ef13-9d57-4919-9a0d-66717fee43dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baa35d8034cd4459931fbdbfcc2be313', 'request_id': 'req-2156ef13-9d57-4919-9a0d-66717fee43dd'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:54:41.763536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-2156ef13-9d57-4919-9a0d-66717fee43dd admin admin] The token cache is being invalidate because project baa35d8034cd4459931fbdbfcc2be313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:54:41.764031 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-2156ef13-9d57-4919-9a0d-66717fee43dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:54:41.764815 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-2156ef13-9d57-4919-9a0d-66717fee43dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:54:41.766817 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1197/2389] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:54:41 2022] DELETE /identity/v3/projects/baa35d8034cd4459931fbdbfcc2be313 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:54:41.772415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7c218-2725-466e-8b2d-6631cae72fea None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:41.772916 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7c218-2725-466e-8b2d-6631cae72fea None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:41.773329 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7c218-2725-466e-8b2d-6631cae72fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:41.794918 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-4ca7c218-2725-466e-8b2d-6631cae72fea None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:54:41.796175 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4ca7c218-2725-466e-8b2d-6631cae72fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:54:41.827736 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:54:41.858244 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1193/2390] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:54:41.867702 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3871a7-5b47-46b5-ad2d-e33b793e2346 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:41.867997 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3871a7-5b47-46b5-ad2d-e33b793e2346 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:41.868280 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3871a7-5b47-46b5-ad2d-e33b793e2346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:41.888408 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-2f3871a7-5b47-46b5-ad2d-e33b793e2346 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:54:41.889626 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-2f3871a7-5b47-46b5-ad2d-e33b793e2346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:54:41.899505 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1198/2391] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:54:41.904177 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7c218-2725-466e-8b2d-6631cae72fea None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:54:41.914900 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7c218-2725-466e-8b2d-6631cae72fea None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:54:41.920412 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a7b2c-3857-4e4f-baf9-f214bc81ad35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:54:41.921087 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a7b2c-3857-4e4f-baf9-f214bc81ad35 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:41.921376 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a7b2c-3857-4e4f-baf9-f214bc81ad35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:41.921655 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a7b2c-3857-4e4f-baf9-f214bc81ad35 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:41.922395 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a7b2c-3857-4e4f-baf9-f214bc81ad35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:54:41.923376 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a7b2c-3857-4e4f-baf9-f214bc81ad35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:54:41.925043 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a7b2c-3857-4e4f-baf9-f214bc81ad35 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:54:41.942713 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1194/2392] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:54:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:54:41.944191 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3871a7-5b47-46b5-ad2d-e33b793e2346 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:54:41.953633 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3871a7-5b47-46b5-ad2d-e33b793e2346 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:54:41.958489 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d7fe2-65b4-4bae-91a5-00c3c332f46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:54:41.959143 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d7fe2-65b4-4bae-91a5-00c3c332f46d admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:41.959427 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d7fe2-65b4-4bae-91a5-00c3c332f46d admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:41.959745 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d7fe2-65b4-4bae-91a5-00c3c332f46d admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:41.960453 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d7fe2-65b4-4bae-91a5-00c3c332f46d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:54:41.962353 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d7fe2-65b4-4bae-91a5-00c3c332f46d admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:54:42.106571 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1199/2393] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:54:41 2022] POST /identity/v3/projects => generated 375 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:54:42.111606 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a7b2c-3857-4e4f-baf9-f214bc81ad35 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:54:42.122007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a7b2c-3857-4e4f-baf9-f214bc81ad35 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:54:42.178887 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b34d9f-7a4c-4139-a003-f62ffea87d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:54:42.179514 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b34d9f-7a4c-4139-a003-f62ffea87d3d admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:42.179829 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b34d9f-7a4c-4139-a003-f62ffea87d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:42.180111 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b34d9f-7a4c-4139-a003-f62ffea87d3d admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:42.180820 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b34d9f-7a4c-4139-a003-f62ffea87d3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:54:42.182721 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b34d9f-7a4c-4139-a003-f62ffea87d3d admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:54:42.270364 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1195/2394] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:54:42 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:54:42.274402 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d7fe2-65b4-4bae-91a5-00c3c332f46d admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:54:42.285639 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d7fe2-65b4-4bae-91a5-00c3c332f46d admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:54:42.290527 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5491d-5994-4413-b66b-908a24d2173d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:54:42.291196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5491d-5994-4413-b66b-908a24d2173d admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:42.291479 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5491d-5994-4413-b66b-908a24d2173d admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:42.291786 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5491d-5994-4413-b66b-908a24d2173d admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:42.292552 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5491d-5994-4413-b66b-908a24d2173d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:54:42.294180 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5491d-5994-4413-b66b-908a24d2173d admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:54:42.300466 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:54:42.306071 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1200/2395] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:54:42.315849 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b34d9f-7a4c-4139-a003-f62ffea87d3d admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:54:42.327178 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b34d9f-7a4c-4139-a003-f62ffea87d3d admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:54:42.351334 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62d6de-40a1-4308-b59a-f7cef9546079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:54:42.351334 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62d6de-40a1-4308-b59a-f7cef9546079 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:42.351334 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62d6de-40a1-4308-b59a-f7cef9546079 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:42.351334 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62d6de-40a1-4308-b59a-f7cef9546079 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:42.351736 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62d6de-40a1-4308-b59a-f7cef9546079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:54:42.351736 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62d6de-40a1-4308-b59a-f7cef9546079 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:54:42.351736 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1196/2396] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 08:54:42.355554 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5491d-5994-4413-b66b-908a24d2173d admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:54:42.366540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5491d-5994-4413-b66b-908a24d2173d admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:54:42.371801 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0328860-cd33-4fef-9533-70ea9f26e43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:54:42.375119 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0328860-cd33-4fef-9533-70ea9f26e43a admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:42.375119 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0328860-cd33-4fef-9533-70ea9f26e43a admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:42.375119 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0328860-cd33-4fef-9533-70ea9f26e43a admin admin] PATH_INFO: `/v3/projects/022dcea6cfd14424a0a4aaa727315a50/users/e17653647f194a47aaf4c28b581c4494/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:42.390200 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0328860-cd33-4fef-9533-70ea9f26e43a admin admin] RBAC: Authorizing `identity:create_grant(project_id=022dcea6cfd14424a0a4aaa727315a50, user_id=e17653647f194a47aaf4c28b581c4494, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:54:42.393691 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0328860-cd33-4fef-9533-70ea9f26e43a admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:54:42.457416 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1201/2397] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:54:42 2022] PUT /identity/v3/projects/022dcea6cfd14424a0a4aaa727315a50/users/e17653647f194a47aaf4c28b581c4494/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 08:54:42.459979 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081f19a-35dd-46ec-9b65-9c802a064cd3 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:42.460326 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081f19a-35dd-46ec-9b65-9c802a064cd3 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:42.460571 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081f19a-35dd-46ec-9b65-9c802a064cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:42.473966 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0328860-cd33-4fef-9533-70ea9f26e43a admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:54:42.483535 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-d0328860-cd33-4fef-9533-70ea9f26e43a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:54:42.513699 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-9081f19a-35dd-46ec-9b65-9c802a064cd3 None None] MFA Rules not processed for user `e17653647f194a47aaf4c28b581c4494`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:54:42.515535 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9081f19a-35dd-46ec-9b65-9c802a064cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:54:42.593087 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0328860-cd33-4fef-9533-70ea9f26e43a admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:54:42.612877 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf68e8-5454-4af7-97dc-462844ab9ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:54:42.614791 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1197/2398] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:54:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:54:42.615047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf68e8-5454-4af7-97dc-462844ab9ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:42.615448 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf68e8-5454-4af7-97dc-462844ab9ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:42.615818 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf68e8-5454-4af7-97dc-462844ab9ef0 admin admin] PATH_INFO: `/v3/users/3b53701b3f834c6499abcf89662e7d1d` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:42.617311 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf68e8-5454-4af7-97dc-462844ab9ef0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b53701b3f834c6499abcf89662e7d1d)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:54:42.619483 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf68e8-5454-4af7-97dc-462844ab9ef0 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:54:42.626247 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9081f19a-35dd-46ec-9b65-9c802a064cd3 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:54:42.632692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9081f19a-35dd-46ec-9b65-9c802a064cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:54:42.677299 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:54:42.725412 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9081f19a-35dd-46ec-9b65-9c802a064cd3 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:54:42.729252 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55bfed-f9cf-4035-a27c-c7feb6b7992b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:54:42.729916 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55bfed-f9cf-4035-a27c-c7feb6b7992b service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:42.730199 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55bfed-f9cf-4035-a27c-c7feb6b7992b service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:42.730479 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55bfed-f9cf-4035-a27c-c7feb6b7992b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:42.744872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55bfed-f9cf-4035-a27c-c7feb6b7992b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:54:42.748943 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55bfed-f9cf-4035-a27c-c7feb6b7992b service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:54:42.759562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1198/2399] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:54:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:54:42.847366 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-86bf68e8-5454-4af7-97dc-462844ab9ef0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b53701b3f834c6499abcf89662e7d1d'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:54:42.848210 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-86bf68e8-5454-4af7-97dc-462844ab9ef0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b53701b3f834c6499abcf89662e7d1d'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:54:42.848928 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-86bf68e8-5454-4af7-97dc-462844ab9ef0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b53701b3f834c6499abcf89662e7d1d'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:54:42.857636 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-86bf68e8-5454-4af7-97dc-462844ab9ef0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b53701b3f834c6499abcf89662e7d1d'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:54:42.944711 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-86bf68e8-5454-4af7-97dc-462844ab9ef0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b53701b3f834c6499abcf89662e7d1d'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:54:42.969427 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1202/2400] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:54:42 2022] DELETE /identity/v3/users/3b53701b3f834c6499abcf89662e7d1d => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:54:42.974770 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57f55d-7562-4eaf-b0ca-23c27ad5dd81 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:42.975891 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57f55d-7562-4eaf-b0ca-23c27ad5dd81 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:42.976173 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57f55d-7562-4eaf-b0ca-23c27ad5dd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:42.997847 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-4b57f55d-7562-4eaf-b0ca-23c27ad5dd81 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:54:42.999092 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4b57f55d-7562-4eaf-b0ca-23c27ad5dd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:54:43.076794 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1199/2401] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:54:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:54:43.088256 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf68e8-5454-4af7-97dc-462844ab9ef0 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:54:43.089697 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-86bf68e8-5454-4af7-97dc-462844ab9ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:54:43.149706 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf68e8-5454-4af7-97dc-462844ab9ef0 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:54:43.153694 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958915bb-3ed7-49c3-bbe7-568c371d86ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:54:43.154425 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958915bb-3ed7-49c3-bbe7-568c371d86ca service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:43.154705 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958915bb-3ed7-49c3-bbe7-568c371d86ca service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:43.155040 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958915bb-3ed7-49c3-bbe7-568c371d86ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:43.166693 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958915bb-3ed7-49c3-bbe7-568c371d86ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:54:43.166693 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958915bb-3ed7-49c3-bbe7-568c371d86ca service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:54:43.170613 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:54:43.178174 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1203/2402] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:54:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:54:43.603944 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57f55d-7562-4eaf-b0ca-23c27ad5dd81 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:54:43.618406 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4b57f55d-7562-4eaf-b0ca-23c27ad5dd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:54:43.654276 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57f55d-7562-4eaf-b0ca-23c27ad5dd81 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:54:43.667448 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6c978-60ae-4731-b88c-d9a003d9f152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:54:43.669141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6c978-60ae-4731-b88c-d9a003d9f152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:43.669442 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6c978-60ae-4731-b88c-d9a003d9f152 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:43.672181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6c978-60ae-4731-b88c-d9a003d9f152 admin admin] PATH_INFO: `/v3/projects/ee36fffea5054d7ea32ec274068a7594` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:43.672181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd6c978-60ae-4731-b88c-d9a003d9f152 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee36fffea5054d7ea32ec274068a7594)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:54:43.675011 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd6c978-60ae-4731-b88c-d9a003d9f152 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:54:43.930091 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4bd6c978-60ae-4731-b88c-d9a003d9f152 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee36fffea5054d7ea32ec274068a7594', 'request_id': 'req-4bd6c978-60ae-4731-b88c-d9a003d9f152'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:54:43.937690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4bd6c978-60ae-4731-b88c-d9a003d9f152 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee36fffea5054d7ea32ec274068a7594', 'request_id': 'req-4bd6c978-60ae-4731-b88c-d9a003d9f152'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:54:43.945885 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4bd6c978-60ae-4731-b88c-d9a003d9f152 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee36fffea5054d7ea32ec274068a7594', 'request_id': 'req-4bd6c978-60ae-4731-b88c-d9a003d9f152'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:54:44.015199 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4bd6c978-60ae-4731-b88c-d9a003d9f152 admin admin] The token cache is being invalidate because project ee36fffea5054d7ea32ec274068a7594 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:54:44.018013 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4bd6c978-60ae-4731-b88c-d9a003d9f152 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:54:44.019018 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4bd6c978-60ae-4731-b88c-d9a003d9f152 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:54:44.021291 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1200/2403] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:54:43 2022] DELETE /identity/v3/projects/ee36fffea5054d7ea32ec274068a7594 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:54:45.583255 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5b658-75d5-4483-afad-e140c2974665 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:45.583776 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5b658-75d5-4483-afad-e140c2974665 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:45.583871 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5b658-75d5-4483-afad-e140c2974665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:45.603191 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-e4d5b658-75d5-4483-afad-e140c2974665 None None] MFA Rules not processed for user `e17653647f194a47aaf4c28b581c4494`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:54:45.604456 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-e4d5b658-75d5-4483-afad-e140c2974665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:54:45.678330 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1204/2404] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:54:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:54:50.672029 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74783c-476a-4721-9852-31ee9d538d77 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:50.672483 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74783c-476a-4721-9852-31ee9d538d77 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:50.672641 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74783c-476a-4721-9852-31ee9d538d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:50.701323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-0d74783c-476a-4721-9852-31ee9d538d77 None None] MFA Rules not processed for user `b3c1d56bc0a64411a68f97a4417b0379`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:54:50.702802 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0d74783c-476a-4721-9852-31ee9d538d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:54:50.777562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1201/2405] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Jul 25 08:54:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:54:50.790987 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5b658-75d5-4483-afad-e140c2974665 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:54:50.792434 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-e4d5b658-75d5-4483-afad-e140c2974665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:54:50.881803 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5b658-75d5-4483-afad-e140c2974665 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:54:50.888371 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da744943-220f-4535-90be-f8de953d4ce5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2763e540681547d3a6677567b3be86ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:54:50.889080 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da744943-220f-4535-90be-f8de953d4ce5 service swift] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:50.889369 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da744943-220f-4535-90be-f8de953d4ce5 service swift] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:50.889645 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da744943-220f-4535-90be-f8de953d4ce5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:50.899766 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da744943-220f-4535-90be-f8de953d4ce5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:54:50.901441 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da744943-220f-4535-90be-f8de953d4ce5 service swift] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:54:50.913833 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1205/2406] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Jul 25 08:54:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 08:54:54.448690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74783c-476a-4721-9852-31ee9d538d77 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:54:54.450713 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0d74783c-476a-4721-9852-31ee9d538d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:54:54.456573 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:54:54.518491 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74783c-476a-4721-9852-31ee9d538d77 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:54:54.523910 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e33d86-3400-4450-922b-ad810cbf06fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:54:54.524661 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e33d86-3400-4450-922b-ad810cbf06fe service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:54:54.525046 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e33d86-3400-4450-922b-ad810cbf06fe service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:54:54.525397 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e33d86-3400-4450-922b-ad810cbf06fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:54:54.528666 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-97e33d86-3400-4450-922b-ad810cbf06fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:54:54.617019 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e33d86-3400-4450-922b-ad810cbf06fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:54:54.618897 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e33d86-3400-4450-922b-ad810cbf06fe service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:54:54.633622 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1202/2407] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:54:54 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:55:00.908894 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=58 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:55:04.625211 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=49 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:55:05.831874 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da744943-220f-4535-90be-f8de953d4ce5 service swift] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:55:05.833380 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-da744943-220f-4535-90be-f8de953d4ce5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:55:05.847054 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da744943-220f-4535-90be-f8de953d4ce5 service swift] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:55:05.851094 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c4eb9-4d99-471f-a14d-59e09b56b205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:55:05.851840 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c4eb9-4d99-471f-a14d-59e09b56b205 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:55:05.852189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c4eb9-4d99-471f-a14d-59e09b56b205 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:55:05.852472 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c4eb9-4d99-471f-a14d-59e09b56b205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:55:05.854404 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-1f2c4eb9-4d99-471f-a14d-59e09b56b205 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:55:05.945794 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c4eb9-4d99-471f-a14d-59e09b56b205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:55:05.947270 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c4eb9-4d99-471f-a14d-59e09b56b205 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:55:05.958472 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1206/2408] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:55:05 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:55:08.227351 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e33d86-3400-4450-922b-ad810cbf06fe service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:55:08.236706 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e33d86-3400-4450-922b-ad810cbf06fe service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:55:08.241000 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d36a41-12b4-4404-88b0-333d9a86f2b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:55:08.241666 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d36a41-12b4-4404-88b0-333d9a86f2b2 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:55:08.241949 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d36a41-12b4-4404-88b0-333d9a86f2b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:55:08.242226 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d36a41-12b4-4404-88b0-333d9a86f2b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:55:08.244205 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-e4d36a41-12b4-4404-88b0-333d9a86f2b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:55:08.344949 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d36a41-12b4-4404-88b0-333d9a86f2b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:55:08.346819 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d36a41-12b4-4404-88b0-333d9a86f2b2 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:55:08.364157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1203/2409] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:55:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:55:09.712501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c4eb9-4d99-471f-a14d-59e09b56b205 service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:55:09.726002 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c4eb9-4d99-471f-a14d-59e09b56b205 service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:55:09.731355 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063c1fc-c414-432c-bded-b404f4d1ed53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:55:09.732129 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063c1fc-c414-432c-bded-b404f4d1ed53 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:55:09.732418 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063c1fc-c414-432c-bded-b404f4d1ed53 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:55:09.732701 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063c1fc-c414-432c-bded-b404f4d1ed53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:55:09.734631 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-8063c1fc-c414-432c-bded-b404f4d1ed53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:55:09.750060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063c1fc-c414-432c-bded-b404f4d1ed53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:55:09.751651 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063c1fc-c414-432c-bded-b404f4d1ed53 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:55:09.764443 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1207/2410] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:55:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:55:15.094489 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78df62-7464-4cc7-9d6b-7ae24249fd24 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:55:15.095019 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78df62-7464-4cc7-9d6b-7ae24249fd24 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:55:15.095105 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78df62-7464-4cc7-9d6b-7ae24249fd24 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:55:15.097101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1204/2411] 10.222.0.18 () {54 vars in 921 bytes} [Mon Jul 25 08:55:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:55:15.104790 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f460b-9375-407c-a870-24fb98cca24e None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:55:15.105323 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f460b-9375-407c-a870-24fb98cca24e None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:55:15.105323 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f460b-9375-407c-a870-24fb98cca24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:55:15.132187 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658cb59-d2c7-4a94-b453-84db650b5e16 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:55:15.133022 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658cb59-d2c7-4a94-b453-84db650b5e16 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:55:15.133519 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658cb59-d2c7-4a94-b453-84db650b5e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:55:15.137298 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-836f460b-9375-407c-a870-24fb98cca24e None None] MFA Rules not processed for user `1c1a08d3a76643a9996dc0daa8714ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:55:15.138799 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-836f460b-9375-407c-a870-24fb98cca24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:55:15.151003 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1208/2412] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Jul 25 08:55:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:55:15.165321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-9658cb59-d2c7-4a94-b453-84db650b5e16 None None] MFA Rules not processed for user `b3c1d56bc0a64411a68f97a4417b0379`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:55:15.166160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9658cb59-d2c7-4a94-b453-84db650b5e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:55:15.167669 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f460b-9375-407c-a870-24fb98cca24e None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:55:15.170588 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-836f460b-9375-407c-a870-24fb98cca24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:55:15.179377 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1205/2413] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Jul 25 08:55:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:55:15.220457 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658cb59-d2c7-4a94-b453-84db650b5e16 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:55:15.235485 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658cb59-d2c7-4a94-b453-84db650b5e16 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:55:15.243008 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1147c0-4756-4283-87b4-27f869a39a3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2763e540681547d3a6677567b3be86ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:55:15.244514 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1147c0-4756-4283-87b4-27f869a39a3e service swift] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:55:15.244800 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1147c0-4756-4283-87b4-27f869a39a3e service swift] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:55:15.245072 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1147c0-4756-4283-87b4-27f869a39a3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:55:15.257517 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1147c0-4756-4283-87b4-27f869a39a3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:55:15.259019 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f460b-9375-407c-a870-24fb98cca24e None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:55:15.259407 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1147c0-4756-4283-87b4-27f869a39a3e service swift] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:55:15.263497 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976e53d-5560-4311-8355-9ed3252afec8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd75a24363c14e86b0fbbb782b372646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:55:15.264468 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976e53d-5560-4311-8355-9ed3252afec8 service glance] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:55:15.265062 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976e53d-5560-4311-8355-9ed3252afec8 service glance] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:55:15.265528 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976e53d-5560-4311-8355-9ed3252afec8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:55:15.273493 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1206/2414] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Jul 25 08:55:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 08:55:15.280854 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976e53d-5560-4311-8355-9ed3252afec8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:55:15.282655 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976e53d-5560-4311-8355-9ed3252afec8 service glance] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:55:15.298334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1209/2415] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:55:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:55:15.580145 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a417ba6-414b-4c4e-ba6b-db9472a3396a None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:55:15.580454 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a417ba6-414b-4c4e-ba6b-db9472a3396a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:55:15.580746 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a417ba6-414b-4c4e-ba6b-db9472a3396a None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:55:15.583650 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1207/2416] 10.222.0.18 () {54 vars in 921 bytes} [Mon Jul 25 08:55:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:55:15.588366 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bf654-53a3-4164-beaf-8e9b2974cf18 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:55:15.588893 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bf654-53a3-4164-beaf-8e9b2974cf18 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:55:15.590119 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bf654-53a3-4164-beaf-8e9b2974cf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:55:15.615596 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-769bf654-53a3-4164-beaf-8e9b2974cf18 None None] MFA Rules not processed for user `a08bd52110074f11ba56b2f02397062f`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:55:15.616988 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-769bf654-53a3-4164-beaf-8e9b2974cf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:55:15.623697 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1210/2417] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Jul 25 08:55:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:55:15.635753 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a417ba6-414b-4c4e-ba6b-db9472a3396a None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:55:15.647167 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a417ba6-414b-4c4e-ba6b-db9472a3396a None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:55:15.654962 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdbb502-f094-4087-a21e-49ed803fb78b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:55:15.654962 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbb502-f094-4087-a21e-49ed803fb78b service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:55:15.654962 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbb502-f094-4087-a21e-49ed803fb78b service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:55:15.654962 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbb502-f094-4087-a21e-49ed803fb78b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:55:15.661481 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdbb502-f094-4087-a21e-49ed803fb78b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:55:15.663013 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdbb502-f094-4087-a21e-49ed803fb78b service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:55:15.671805 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1208/2418] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:55:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:55:15.758854 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e47061-b19c-4215-a6e9-edc0d497f3b4 None None] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:55:15.759115 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e47061-b19c-4215-a6e9-edc0d497f3b4 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:55:15.759422 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e47061-b19c-4215-a6e9-edc0d497f3b4 None None] PATH_INFO: `/` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:55:15.760838 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1211/2419] 10.222.0.18 () {54 vars in 921 bytes} [Mon Jul 25 08:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 08:55:15.766473 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021dc06-2ffd-4f31-ba4c-0dbdec3a4c60 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:55:15.766763 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021dc06-2ffd-4f31-ba4c-0dbdec3a4c60 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:55:15.767039 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021dc06-2ffd-4f31-ba4c-0dbdec3a4c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:55:15.789630 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-b021dc06-2ffd-4f31-ba4c-0dbdec3a4c60 None None] MFA Rules not processed for user `1c1a08d3a76643a9996dc0daa8714ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:55:15.791260 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b021dc06-2ffd-4f31-ba4c-0dbdec3a4c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:55:15.806793 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1209/2420] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Jul 25 08:55:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:55:15.818610 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e47061-b19c-4215-a6e9-edc0d497f3b4 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:55:15.831582 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e47061-b19c-4215-a6e9-edc0d497f3b4 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:55:15.837079 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38838c0-c68f-4618-84df-a2eafbf2e31e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:55:15.837724 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38838c0-c68f-4618-84df-a2eafbf2e31e service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:55:15.838005 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38838c0-c68f-4618-84df-a2eafbf2e31e service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:55:15.838285 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38838c0-c68f-4618-84df-a2eafbf2e31e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:55:15.849384 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38838c0-c68f-4618-84df-a2eafbf2e31e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:55:15.850825 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38838c0-c68f-4618-84df-a2eafbf2e31e service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:55:15.862872 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1212/2421] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:55:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:55:16.404761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c41082-ba0a-4175-bf23-efd5acce98ba None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:55:16.404761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c41082-ba0a-4175-bf23-efd5acce98ba None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:55:16.404761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c41082-ba0a-4175-bf23-efd5acce98ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:55:16.422775 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-a4c41082-ba0a-4175-bf23-efd5acce98ba None None] MFA Rules not processed for user `b3c1d56bc0a64411a68f97a4417b0379`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:55:16.424865 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a4c41082-ba0a-4175-bf23-efd5acce98ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:55:16.439330 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1210/2422] 10.222.0.18 () {58 vars in 967 bytes} [Mon Jul 25 08:55:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:55:16.452725 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38838c0-c68f-4618-84df-a2eafbf2e31e service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:55:16.465009 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38838c0-c68f-4618-84df-a2eafbf2e31e service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:55:16.470388 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc9971-6525-4838-8e71-0a1fcfd205d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2763e540681547d3a6677567b3be86ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:55:16.471675 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc9971-6525-4838-8e71-0a1fcfd205d9 service swift] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:55:16.471997 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc9971-6525-4838-8e71-0a1fcfd205d9 service swift] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:55:16.472244 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc9971-6525-4838-8e71-0a1fcfd205d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:55:16.480823 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc9971-6525-4838-8e71-0a1fcfd205d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:55:16.482417 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc9971-6525-4838-8e71-0a1fcfd205d9 service swift] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:55:16.492100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1213/2423] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Jul 25 08:55:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 08:55:17.167091 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4919f9-907c-4e22-810a-c0bf2d6f30ca None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:55:17.178382 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4919f9-907c-4e22-810a-c0bf2d6f30ca None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:55:17.178382 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4919f9-907c-4e22-810a-c0bf2d6f30ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:55:17.193021 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-9e4919f9-907c-4e22-810a-c0bf2d6f30ca None None] MFA Rules not processed for user `b3c1d56bc0a64411a68f97a4417b0379`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:55:17.194245 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9e4919f9-907c-4e22-810a-c0bf2d6f30ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:55:17.201880 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1211/2424] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Jul 25 08:55:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:55:17.250837 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc9971-6525-4838-8e71-0a1fcfd205d9 service swift] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:55:17.250837 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc9971-6525-4838-8e71-0a1fcfd205d9 service swift] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:55:17.250837 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fcdb7-630d-464d-9805-d6116612f73a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2763e540681547d3a6677567b3be86ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:55:17.250837 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fcdb7-630d-464d-9805-d6116612f73a service swift] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:55:17.251320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fcdb7-630d-464d-9805-d6116612f73a service swift] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:55:17.251320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fcdb7-630d-464d-9805-d6116612f73a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:55:17.251320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9fcdb7-630d-464d-9805-d6116612f73a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:55:17.251320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9fcdb7-630d-464d-9805-d6116612f73a service swift] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:55:17.252971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1214/2425] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Jul 25 08:55:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 08:55:17.817986 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6edb2a-c335-41c0-9e9d-ca85e0486759 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:55:17.818535 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6edb2a-c335-41c0-9e9d-ca85e0486759 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:55:17.818535 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6edb2a-c335-41c0-9e9d-ca85e0486759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:55:17.840996 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-ba6edb2a-c335-41c0-9e9d-ca85e0486759 None None] MFA Rules not processed for user `b3c1d56bc0a64411a68f97a4417b0379`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:55:17.842212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-ba6edb2a-c335-41c0-9e9d-ca85e0486759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:55:17.849757 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1212/2426] 10.222.0.18 () {58 vars in 967 bytes} [Mon Jul 25 08:55:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:55:17.867394 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fcdb7-630d-464d-9805-d6116612f73a service swift] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:55:17.879753 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fcdb7-630d-464d-9805-d6116612f73a service swift] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:55:17.885586 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9a783-1b6a-4806-9e08-d7887132e4d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2763e540681547d3a6677567b3be86ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:55:17.886251 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9a783-1b6a-4806-9e08-d7887132e4d1 service swift] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:55:17.886538 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9a783-1b6a-4806-9e08-d7887132e4d1 service swift] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:55:17.886822 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9a783-1b6a-4806-9e08-d7887132e4d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:55:17.897100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9a783-1b6a-4806-9e08-d7887132e4d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:55:17.898675 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9a783-1b6a-4806-9e08-d7887132e4d1 service swift] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:55:17.907962 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1215/2427] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Jul 25 08:55:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 08:55:19.785751 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc518c5-fdbf-4bcc-9757-de59e8f266a9 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:55:19.786249 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc518c5-fdbf-4bcc-9757-de59e8f266a9 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:55:19.786347 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc518c5-fdbf-4bcc-9757-de59e8f266a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:55:19.806251 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-dbc518c5-fdbf-4bcc-9757-de59e8f266a9 None None] MFA Rules not processed for user `b3c1d56bc0a64411a68f97a4417b0379`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:55:19.807459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-dbc518c5-fdbf-4bcc-9757-de59e8f266a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:55:19.821744 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1213/2428] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Jul 25 08:55:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:55:19.835378 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9a783-1b6a-4806-9e08-d7887132e4d1 service swift] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:55:19.848194 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9a783-1b6a-4806-9e08-d7887132e4d1 service swift] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:55:19.854226 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1367350-f1ff-4e62-bd96-0215b8511314 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2763e540681547d3a6677567b3be86ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:55:19.854925 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1367350-f1ff-4e62-bd96-0215b8511314 service swift] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:55:19.855304 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1367350-f1ff-4e62-bd96-0215b8511314 service swift] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:55:19.855702 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1367350-f1ff-4e62-bd96-0215b8511314 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:55:19.865336 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1367350-f1ff-4e62-bd96-0215b8511314 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:55:19.867070 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1367350-f1ff-4e62-bd96-0215b8511314 service swift] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:55:19.875848 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1216/2429] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Jul 25 08:55:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 08:55:20.711345 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc518c5-fdbf-4bcc-9757-de59e8f266a9 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:55:20.711345 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-dbc518c5-fdbf-4bcc-9757-de59e8f266a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:55:20.812087 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc518c5-fdbf-4bcc-9757-de59e8f266a9 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:55:20.817556 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869b973-b1df-4673-a11d-f26b63b84942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:55:20.818455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869b973-b1df-4673-a11d-f26b63b84942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:55:20.818743 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869b973-b1df-4673-a11d-f26b63b84942 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:55:20.819028 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869b973-b1df-4673-a11d-f26b63b84942 admin admin] PATH_INFO: `/v3/users/e17653647f194a47aaf4c28b581c4494` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:55:20.820290 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7869b973-b1df-4673-a11d-f26b63b84942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e17653647f194a47aaf4c28b581c4494)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:55:20.822231 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7869b973-b1df-4673-a11d-f26b63b84942 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:55:20.859347 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:55:21.014975 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7869b973-b1df-4673-a11d-f26b63b84942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e17653647f194a47aaf4c28b581c4494'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:55:21.015848 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7869b973-b1df-4673-a11d-f26b63b84942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e17653647f194a47aaf4c28b581c4494'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:55:21.024484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7869b973-b1df-4673-a11d-f26b63b84942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e17653647f194a47aaf4c28b581c4494'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:55:21.025197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7869b973-b1df-4673-a11d-f26b63b84942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e17653647f194a47aaf4c28b581c4494'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:55:21.098202 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7869b973-b1df-4673-a11d-f26b63b84942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e17653647f194a47aaf4c28b581c4494'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:55:21.123863 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1214/2430] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:55:20 2022] DELETE /identity/v3/users/e17653647f194a47aaf4c28b581c4494 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:55:21.128792 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09792019-278a-400c-ac3e-6de9c177a4be None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:55:21.129301 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09792019-278a-400c-ac3e-6de9c177a4be None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:55:21.129301 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09792019-278a-400c-ac3e-6de9c177a4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:55:21.137225 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:55:21.149071 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-09792019-278a-400c-ac3e-6de9c177a4be None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:55:21.151515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-09792019-278a-400c-ac3e-6de9c177a4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:55:21.224579 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1217/2431] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:55:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:55:21.238347 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869b973-b1df-4673-a11d-f26b63b84942 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:55:21.240044 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-7869b973-b1df-4673-a11d-f26b63b84942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:55:21.307057 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869b973-b1df-4673-a11d-f26b63b84942 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:55:21.312041 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0fc8a4-37ac-426e-a91c-7e1df30e1479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:55:21.312832 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fc8a4-37ac-426e-a91c-7e1df30e1479 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:55:21.313217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fc8a4-37ac-426e-a91c-7e1df30e1479 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:55:21.313595 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fc8a4-37ac-426e-a91c-7e1df30e1479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:55:21.353664 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0fc8a4-37ac-426e-a91c-7e1df30e1479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:55:21.355410 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0fc8a4-37ac-426e-a91c-7e1df30e1479 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:55:21.368755 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1215/2432] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:55:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:55:21.688815 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09792019-278a-400c-ac3e-6de9c177a4be None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:55:21.691013 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-09792019-278a-400c-ac3e-6de9c177a4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:55:21.704147 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09792019-278a-400c-ac3e-6de9c177a4be None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:55:21.710290 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b5983-718c-4b5b-9ce5-da547a93da47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:55:21.711337 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b5983-718c-4b5b-9ce5-da547a93da47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:55:21.711822 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b5983-718c-4b5b-9ce5-da547a93da47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:55:21.712262 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b5983-718c-4b5b-9ce5-da547a93da47 admin admin] PATH_INFO: `/v3/projects/022dcea6cfd14424a0a4aaa727315a50` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:55:21.713745 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b5983-718c-4b5b-9ce5-da547a93da47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=022dcea6cfd14424a0a4aaa727315a50)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:55:21.715961 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b5983-718c-4b5b-9ce5-da547a93da47 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:55:21.873936 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-fb0b5983-718c-4b5b-9ce5-da547a93da47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '022dcea6cfd14424a0a4aaa727315a50', 'request_id': 'req-fb0b5983-718c-4b5b-9ce5-da547a93da47'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:55:21.881388 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-fb0b5983-718c-4b5b-9ce5-da547a93da47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '022dcea6cfd14424a0a4aaa727315a50', 'request_id': 'req-fb0b5983-718c-4b5b-9ce5-da547a93da47'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:55:21.887895 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-fb0b5983-718c-4b5b-9ce5-da547a93da47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '022dcea6cfd14424a0a4aaa727315a50', 'request_id': 'req-fb0b5983-718c-4b5b-9ce5-da547a93da47'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:55:21.989938 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-fb0b5983-718c-4b5b-9ce5-da547a93da47 admin admin] The token cache is being invalidate because project 022dcea6cfd14424a0a4aaa727315a50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:55:21.990230 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-fb0b5983-718c-4b5b-9ce5-da547a93da47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:55:21.990872 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-fb0b5983-718c-4b5b-9ce5-da547a93da47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:55:21.992538 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1218/2433] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:55:21 2022] DELETE /identity/v3/projects/022dcea6cfd14424a0a4aaa727315a50 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:55:26.334726 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0fc8a4-37ac-426e-a91c-7e1df30e1479 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:55:26.336228 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-5a0fc8a4-37ac-426e-a91c-7e1df30e1479 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:55:26.430400 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0fc8a4-37ac-426e-a91c-7e1df30e1479 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:55:26.474761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:55:26.506978 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f04ba-e6ad-42b5-8267-0765d90c2d80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:55:26.507678 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f04ba-e6ad-42b5-8267-0765d90c2d80 service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:55:26.508053 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f04ba-e6ad-42b5-8267-0765d90c2d80 service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:55:26.508341 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f04ba-e6ad-42b5-8267-0765d90c2d80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:55:26.510232 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-851f04ba-e6ad-42b5-8267-0765d90c2d80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:55:26.578788 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f04ba-e6ad-42b5-8267-0765d90c2d80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:55:26.580338 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f04ba-e6ad-42b5-8267-0765d90c2d80 service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:55:26.591252 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1216/2434] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:55:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:55:30.990010 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b5983-718c-4b5b-9ce5-da547a93da47 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:55:30.991441 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-fb0b5983-718c-4b5b-9ce5-da547a93da47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:55:31.008143 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b5983-718c-4b5b-9ce5-da547a93da47 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:55:31.014398 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62dfc73-0680-4a53-8f3f-8cb3e99a6a37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:55:31.015231 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62dfc73-0680-4a53-8f3f-8cb3e99a6a37 service nova] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:55:31.015522 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62dfc73-0680-4a53-8f3f-8cb3e99a6a37 service nova] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:55:31.015825 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62dfc73-0680-4a53-8f3f-8cb3e99a6a37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:55:31.017680 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-b62dfc73-0680-4a53-8f3f-8cb3e99a6a37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:55:31.085361 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62dfc73-0680-4a53-8f3f-8cb3e99a6a37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:55:31.086947 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62dfc73-0680-4a53-8f3f-8cb3e99a6a37 service nova] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:55:31.098788 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1219/2435] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:55:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:55:36.585993 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=38 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:55:41.093380 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:55:46.743079 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f04ba-e6ad-42b5-8267-0765d90c2d80 service nova] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:55:46.744570 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-851f04ba-e6ad-42b5-8267-0765d90c2d80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:55:46.805984 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f04ba-e6ad-42b5-8267-0765d90c2d80 service nova] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:55:46.809692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707e574-1308-47c8-b00d-d39d18c31b98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:55:46.811046 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707e574-1308-47c8-b00d-d39d18c31b98 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:55:46.811046 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707e574-1308-47c8-b00d-d39d18c31b98 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:55:46.811046 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707e574-1308-47c8-b00d-d39d18c31b98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:55:46.813279 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b707e574-1308-47c8-b00d-d39d18c31b98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:55:46.825791 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b707e574-1308-47c8-b00d-d39d18c31b98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:55:46.827293 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b707e574-1308-47c8-b00d-d39d18c31b98 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:55:46.838139 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1217/2436] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:55:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:55:51.353873 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8759e-09c6-47f0-88d7-311ea5cb4c09 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:55:51.354434 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8759e-09c6-47f0-88d7-311ea5cb4c09 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:55:51.354933 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8759e-09c6-47f0-88d7-311ea5cb4c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:55:51.376823 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-1fd8759e-09c6-47f0-88d7-311ea5cb4c09 None None] MFA Rules not processed for user `b3c1d56bc0a64411a68f97a4417b0379`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:55:51.378108 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-1fd8759e-09c6-47f0-88d7-311ea5cb4c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:55:51.462298 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1220/2437] 10.222.0.18 () {58 vars in 967 bytes} [Mon Jul 25 08:55:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:55:51.476628 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707e574-1308-47c8-b00d-d39d18c31b98 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:55:51.477945 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b707e574-1308-47c8-b00d-d39d18c31b98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:55:51.552931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707e574-1308-47c8-b00d-d39d18c31b98 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:55:51.559927 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604e0b3-b4da-4765-b705-f806e456809c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2763e540681547d3a6677567b3be86ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:55:51.560579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604e0b3-b4da-4765-b705-f806e456809c service swift] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:55:51.560866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604e0b3-b4da-4765-b705-f806e456809c service swift] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:55:51.561152 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604e0b3-b4da-4765-b705-f806e456809c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:55:51.570103 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604e0b3-b4da-4765-b705-f806e456809c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:55:51.571861 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604e0b3-b4da-4765-b705-f806e456809c service swift] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:55:51.580799 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1218/2438] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Jul 25 08:55:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 08:56:01.453787 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=25 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:56:01.577298 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=58 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:56:02.110592 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9374d38-c501-4003-9926-d7951ead2021 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:56:02.110887 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9374d38-c501-4003-9926-d7951ead2021 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:56:02.111166 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9374d38-c501-4003-9926-d7951ead2021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:56:02.135224 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-e9374d38-c501-4003-9926-d7951ead2021 None None] MFA Rules not processed for user `e416de38c3354372909e3f13678e5b54`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:56:02.135749 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-e9374d38-c501-4003-9926-d7951ead2021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:56:02.145887 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1221/2439] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:56:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:56:08.695888 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604e0b3-b4da-4765-b705-f806e456809c service swift] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:56:08.711472 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604e0b3-b4da-4765-b705-f806e456809c service swift] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:56:08.718090 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e3164-0ac2-4291-995d-2524fd8040ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:56:08.718842 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e3164-0ac2-4291-995d-2524fd8040ec service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:56:08.719126 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e3164-0ac2-4291-995d-2524fd8040ec service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:56:08.719458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e3164-0ac2-4291-995d-2524fd8040ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:56:08.721335 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-007e3164-0ac2-4291-995d-2524fd8040ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:56:08.737278 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e3164-0ac2-4291-995d-2524fd8040ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:56:08.738896 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e3164-0ac2-4291-995d-2524fd8040ec service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:56:08.750889 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1219/2440] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:56:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:56:12.128389 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:56:18.574418 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9374d38-c501-4003-9926-d7951ead2021 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:56:18.589890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9374d38-c501-4003-9926-d7951ead2021 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:56:18.595808 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882e61c-e646-42ed-827d-8ca0a995bcf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:56:18.596536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882e61c-e646-42ed-827d-8ca0a995bcf0 service nova] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:56:18.596826 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882e61c-e646-42ed-827d-8ca0a995bcf0 service nova] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:56:18.597104 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882e61c-e646-42ed-827d-8ca0a995bcf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:56:18.599017 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-4882e61c-e646-42ed-827d-8ca0a995bcf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:56:18.662388 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882e61c-e646-42ed-827d-8ca0a995bcf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:56:18.664799 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882e61c-e646-42ed-827d-8ca0a995bcf0 service nova] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:56:18.674334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1222/2441] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:56:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:56:18.746630 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=6 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:56:28.669848 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=28 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:57:10.794190 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b204d-0193-4506-a626-5a43f1e73677 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:57:10.794753 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b204d-0193-4506-a626-5a43f1e73677 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:57:10.794753 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b204d-0193-4506-a626-5a43f1e73677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:57:10.815082 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-b33b204d-0193-4506-a626-5a43f1e73677 None None] MFA Rules not processed for user `c8fac29036de4afbb8c1b64862e829b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:57:10.816339 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b33b204d-0193-4506-a626-5a43f1e73677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:57:10.823465 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1220/2442] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:57:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:57:11.147230 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882e61c-e646-42ed-827d-8ca0a995bcf0 service nova] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:57:11.157377 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882e61c-e646-42ed-827d-8ca0a995bcf0 service nova] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:57:11.161860 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5ad8f-0205-4009-9746-e0672cd770c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:57:11.162515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5ad8f-0205-4009-9746-e0672cd770c9 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:57:11.162792 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5ad8f-0205-4009-9746-e0672cd770c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:57:11.163071 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5ad8f-0205-4009-9746-e0672cd770c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:57:11.164941 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-f5c5ad8f-0205-4009-9746-e0672cd770c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:57:11.175822 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5ad8f-0205-4009-9746-e0672cd770c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:57:11.177283 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5ad8f-0205-4009-9746-e0672cd770c9 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:57:11.185549 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1223/2443] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:57:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:57:11.649505 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b204d-0193-4506-a626-5a43f1e73677 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:57:11.651129 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b33b204d-0193-4506-a626-5a43f1e73677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:57:11.736878 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b204d-0193-4506-a626-5a43f1e73677 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:57:11.741897 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f375a-d81d-47d5-bfcc-7eb245cecc27 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfb4be75496444dd897b880c2ac3e67e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:57:11.742555 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f375a-d81d-47d5-bfcc-7eb245cecc27 service placement] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:57:11.742843 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f375a-d81d-47d5-bfcc-7eb245cecc27 service placement] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:57:11.743131 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f375a-d81d-47d5-bfcc-7eb245cecc27 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:57:11.744970 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-cc8f375a-d81d-47d5-bfcc-7eb245cecc27 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:57:11.757750 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f375a-d81d-47d5-bfcc-7eb245cecc27 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:57:11.759343 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f375a-d81d-47d5-bfcc-7eb245cecc27 service placement] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:57:11.770904 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1221/2444] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:57:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:57:20.112903 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5ad8f-0205-4009-9746-e0672cd770c9 service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:57:20.114682 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-f5c5ad8f-0205-4009-9746-e0672cd770c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:57:20.132343 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5ad8f-0205-4009-9746-e0672cd770c9 service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:57:20.138253 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc55244-a98c-4aa0-a73e-463774bf26de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:57:20.139169 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc55244-a98c-4aa0-a73e-463774bf26de service nova] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:57:20.139531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc55244-a98c-4aa0-a73e-463774bf26de service nova] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:57:20.139750 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc55244-a98c-4aa0-a73e-463774bf26de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:57:20.141738 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-5fc55244-a98c-4aa0-a73e-463774bf26de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:57:20.159658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc55244-a98c-4aa0-a73e-463774bf26de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:57:20.161402 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc55244-a98c-4aa0-a73e-463774bf26de service nova] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:57:20.174093 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1224/2445] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:57:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:57:21.765701 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=35 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:57:24.967992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f375a-d81d-47d5-bfcc-7eb245cecc27 service placement] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:57:24.981283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f375a-d81d-47d5-bfcc-7eb245cecc27 service placement] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:57:24.987074 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d2d86-5b5b-4437-ac88-e3c2eb85e89b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:57:24.987748 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d2d86-5b5b-4437-ac88-e3c2eb85e89b service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:57:24.988036 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d2d86-5b5b-4437-ac88-e3c2eb85e89b service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:57:24.988428 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d2d86-5b5b-4437-ac88-e3c2eb85e89b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:57:24.990821 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-641d2d86-5b5b-4437-ac88-e3c2eb85e89b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:57:25.005384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d2d86-5b5b-4437-ac88-e3c2eb85e89b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:57:25.007190 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d2d86-5b5b-4437-ac88-e3c2eb85e89b service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:57:25.020860 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1222/2446] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:57:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:57:30.169457 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=12 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:57:35.015221 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=6 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:57:36.171174 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc55244-a98c-4aa0-a73e-463774bf26de service nova] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:57:36.181066 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc55244-a98c-4aa0-a73e-463774bf26de service nova] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:57:36.185170 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d627e21-82e1-4522-99b9-64abcc3b127d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:57:36.185807 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d627e21-82e1-4522-99b9-64abcc3b127d service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:57:36.186093 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d627e21-82e1-4522-99b9-64abcc3b127d service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:57:36.186368 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d627e21-82e1-4522-99b9-64abcc3b127d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:57:36.188145 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-7d627e21-82e1-4522-99b9-64abcc3b127d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:57:36.263683 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d627e21-82e1-4522-99b9-64abcc3b127d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:57:36.273616 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d627e21-82e1-4522-99b9-64abcc3b127d service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:57:36.275568 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1225/2447] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:57:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:57:40.818524 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d2d86-5b5b-4437-ac88-e3c2eb85e89b service nova] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:57:40.830987 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d2d86-5b5b-4437-ac88-e3c2eb85e89b service nova] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:57:40.836397 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c288b6-0742-443b-8688-365edbb1314e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfb4be75496444dd897b880c2ac3e67e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:57:40.837075 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c288b6-0742-443b-8688-365edbb1314e service placement] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:57:40.837416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c288b6-0742-443b-8688-365edbb1314e service placement] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:57:40.837707 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c288b6-0742-443b-8688-365edbb1314e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:57:40.841055 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-25c288b6-0742-443b-8688-365edbb1314e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:57:40.853892 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c288b6-0742-443b-8688-365edbb1314e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:57:40.855557 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c288b6-0742-443b-8688-365edbb1314e service placement] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:57:40.866716 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1223/2448] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:57:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:57:40.975626 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d627e21-82e1-4522-99b9-64abcc3b127d service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:57:40.977174 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-7d627e21-82e1-4522-99b9-64abcc3b127d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:57:40.991149 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d627e21-82e1-4522-99b9-64abcc3b127d service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:57:40.996709 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a03eba-6fab-4330-ad77-5cfc388e64be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:57:40.997665 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a03eba-6fab-4330-ad77-5cfc388e64be admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:57:40.997944 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a03eba-6fab-4330-ad77-5cfc388e64be admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:57:40.998225 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a03eba-6fab-4330-ad77-5cfc388e64be admin admin] PATH_INFO: `/v3/users/e416de38c3354372909e3f13678e5b54` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:57:40.999449 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a03eba-6fab-4330-ad77-5cfc388e64be admin admin] RBAC: Authorizing `identity:delete_user(user_id=e416de38c3354372909e3f13678e5b54)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:57:41.001468 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a03eba-6fab-4330-ad77-5cfc388e64be admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:57:41.162682 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-f7a03eba-6fab-4330-ad77-5cfc388e64be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e416de38c3354372909e3f13678e5b54'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:57:41.163783 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-f7a03eba-6fab-4330-ad77-5cfc388e64be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e416de38c3354372909e3f13678e5b54'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:57:41.165104 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-f7a03eba-6fab-4330-ad77-5cfc388e64be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e416de38c3354372909e3f13678e5b54'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:57:41.179904 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-f7a03eba-6fab-4330-ad77-5cfc388e64be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e416de38c3354372909e3f13678e5b54'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:57:41.245234 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-f7a03eba-6fab-4330-ad77-5cfc388e64be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e416de38c3354372909e3f13678e5b54'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:57:41.267830 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1226/2449] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 08:57:40 2022] DELETE /identity/v3/users/e416de38c3354372909e3f13678e5b54 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:57:41.540655 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c288b6-0742-443b-8688-365edbb1314e service placement] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:57:41.555994 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c288b6-0742-443b-8688-365edbb1314e service placement] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:57:41.636590 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a735be-4464-479a-ae11-149428c6c3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:57:41.637680 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a735be-4464-479a-ae11-149428c6c3a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:57:41.638227 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a735be-4464-479a-ae11-149428c6c3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:57:41.638734 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a735be-4464-479a-ae11-149428c6c3a4 admin admin] PATH_INFO: `/v3/projects/1d41250ae46e46cb9cecf36596625905` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:57:41.640166 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a735be-4464-479a-ae11-149428c6c3a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d41250ae46e46cb9cecf36596625905)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:57:41.642331 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a735be-4464-479a-ae11-149428c6c3a4 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:57:41.757789 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-76a735be-4464-479a-ae11-149428c6c3a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d41250ae46e46cb9cecf36596625905', 'request_id': 'req-76a735be-4464-479a-ae11-149428c6c3a4'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:57:41.765558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-76a735be-4464-479a-ae11-149428c6c3a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d41250ae46e46cb9cecf36596625905', 'request_id': 'req-76a735be-4464-479a-ae11-149428c6c3a4'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:57:41.778904 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-76a735be-4464-479a-ae11-149428c6c3a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d41250ae46e46cb9cecf36596625905', 'request_id': 'req-76a735be-4464-479a-ae11-149428c6c3a4'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:57:41.876403 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-76a735be-4464-479a-ae11-149428c6c3a4 admin admin] The token cache is being invalidate because project 1d41250ae46e46cb9cecf36596625905 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 08:57:41.877690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-76a735be-4464-479a-ae11-149428c6c3a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:57:41.878785 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-76a735be-4464-479a-ae11-149428c6c3a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 08:57:41.880676 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1224/2450] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 08:57:41 2022] DELETE /identity/v3/projects/1d41250ae46e46cb9cecf36596625905 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:57:41.887880 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea077d96-50dd-4b72-983c-4f9a594432ee None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:57:41.888178 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea077d96-50dd-4b72-983c-4f9a594432ee None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:57:41.888732 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea077d96-50dd-4b72-983c-4f9a594432ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:57:41.919553 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-ea077d96-50dd-4b72-983c-4f9a594432ee None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:57:41.924526 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-ea077d96-50dd-4b72-983c-4f9a594432ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:57:42.005832 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1227/2451] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:57:42.020888 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507d392-d97d-40cc-9814-1d221b54c9ec None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:57:42.021209 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507d392-d97d-40cc-9814-1d221b54c9ec None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:57:42.021499 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507d392-d97d-40cc-9814-1d221b54c9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:57:42.051104 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-4507d392-d97d-40cc-9814-1d221b54c9ec None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:57:42.052640 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4507d392-d97d-40cc-9814-1d221b54c9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:57:42.074130 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1225/2452] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:57:42.078879 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea077d96-50dd-4b72-983c-4f9a594432ee None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:57:42.091104 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea077d96-50dd-4b72-983c-4f9a594432ee None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:57:42.096262 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f12b2-5909-4619-9a1c-271a5c05568d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:57:42.097031 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f12b2-5909-4619-9a1c-271a5c05568d admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:57:42.097390 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f12b2-5909-4619-9a1c-271a5c05568d admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:57:42.097736 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f12b2-5909-4619-9a1c-271a5c05568d admin admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:57:42.098553 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f12b2-5909-4619-9a1c-271a5c05568d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 08:57:42.098939 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f12b2-5909-4619-9a1c-271a5c05568d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:57:42.100715 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f12b2-5909-4619-9a1c-271a5c05568d admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:57:42.103359 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:57:42.134064 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1228/2453] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 08:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 08:57:42.137567 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507d392-d97d-40cc-9814-1d221b54c9ec None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:57:42.159150 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507d392-d97d-40cc-9814-1d221b54c9ec None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:57:42.165627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4ebba-bc04-46c2-a573-239e90b8e229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:57:42.168137 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4ebba-bc04-46c2-a573-239e90b8e229 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:57:42.168417 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4ebba-bc04-46c2-a573-239e90b8e229 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:57:42.168921 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4ebba-bc04-46c2-a573-239e90b8e229 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:57:42.169839 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4ebba-bc04-46c2-a573-239e90b8e229 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:57:42.171861 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4ebba-bc04-46c2-a573-239e90b8e229 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:57:42.336887 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1226/2454] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 08:57:42 2022] POST /identity/v3/projects => generated 383 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:57:42.340825 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f12b2-5909-4619-9a1c-271a5c05568d admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:57:42.357047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f12b2-5909-4619-9a1c-271a5c05568d admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:57:42.454635 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655754b6-af95-4ef8-a323-da5a6d6238b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:57:42.455781 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655754b6-af95-4ef8-a323-da5a6d6238b5 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:57:42.456078 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655754b6-af95-4ef8-a323-da5a6d6238b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:57:42.456367 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655754b6-af95-4ef8-a323-da5a6d6238b5 admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:57:42.457094 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655754b6-af95-4ef8-a323-da5a6d6238b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:57:42.459106 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655754b6-af95-4ef8-a323-da5a6d6238b5 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:57:42.559086 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1229/2455] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 08:57:42 2022] POST /identity/v3/users => generated 292 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 08:57:42.560619 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4ebba-bc04-46c2-a573-239e90b8e229 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:57:42.578213 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4ebba-bc04-46c2-a573-239e90b8e229 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:57:42.594532 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf7e12-b0f3-4ac2-9d59-8407e2f2a53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:57:42.595516 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf7e12-b0f3-4ac2-9d59-8407e2f2a53d admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:57:42.596164 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf7e12-b0f3-4ac2-9d59-8407e2f2a53d admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:57:42.597844 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf7e12-b0f3-4ac2-9d59-8407e2f2a53d admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:57:42.601060 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf7e12-b0f3-4ac2-9d59-8407e2f2a53d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:57:42.603138 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf7e12-b0f3-4ac2-9d59-8407e2f2a53d admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:57:42.615660 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1227/2456] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:57:42.622999 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655754b6-af95-4ef8-a323-da5a6d6238b5 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:57:42.636541 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655754b6-af95-4ef8-a323-da5a6d6238b5 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:57:42.646697 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e39b47-ef82-4014-8b08-d4db7e32bb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:57:42.647851 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e39b47-ef82-4014-8b08-d4db7e32bb83 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:57:42.648495 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e39b47-ef82-4014-8b08-d4db7e32bb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:57:42.648863 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e39b47-ef82-4014-8b08-d4db7e32bb83 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:57:42.651631 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e39b47-ef82-4014-8b08-d4db7e32bb83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:57:42.654452 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e39b47-ef82-4014-8b08-d4db7e32bb83 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:57:42.670622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1230/2457] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 08:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 08:57:42.675664 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf7e12-b0f3-4ac2-9d59-8407e2f2a53d admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:57:42.689668 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf7e12-b0f3-4ac2-9d59-8407e2f2a53d admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:57:42.705613 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e000351-63d0-4e14-9985-f2c69ed39e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:57:42.715655 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e000351-63d0-4e14-9985-f2c69ed39e00 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:57:42.715655 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e000351-63d0-4e14-9985-f2c69ed39e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:57:42.715655 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e000351-63d0-4e14-9985-f2c69ed39e00 admin admin] PATH_INFO: `/v3/projects/2c27c41d18654e1587d7056f17868afc/users/fa467b0890784cabbd6bcad011ee1c91/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:57:42.735768 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e000351-63d0-4e14-9985-f2c69ed39e00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c27c41d18654e1587d7056f17868afc, user_id=fa467b0890784cabbd6bcad011ee1c91, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:57:42.739778 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e000351-63d0-4e14-9985-f2c69ed39e00 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:57:42.846929 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1228/2458] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 08:57:42 2022] PUT /identity/v3/projects/2c27c41d18654e1587d7056f17868afc/users/fa467b0890784cabbd6bcad011ee1c91/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 08:57:42.849233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981dcd88-b174-4a6f-bb7d-d4746ccb2e3b None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:57:42.849737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981dcd88-b174-4a6f-bb7d-d4746ccb2e3b None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:57:42.850188 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981dcd88-b174-4a6f-bb7d-d4746ccb2e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:57:42.900213 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-981dcd88-b174-4a6f-bb7d-d4746ccb2e3b None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:57:42.904523 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-981dcd88-b174-4a6f-bb7d-d4746ccb2e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:57:43.064009 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1231/2459] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:57:43.091879 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e000351-63d0-4e14-9985-f2c69ed39e00 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:57:43.095878 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-3e000351-63d0-4e14-9985-f2c69ed39e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:57:43.174886 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:57:43.317272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e000351-63d0-4e14-9985-f2c69ed39e00 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:57:43.336398 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1c563-a0ff-4fd8-b556-0b61b5e3b359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:57:43.336398 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1c563-a0ff-4fd8-b556-0b61b5e3b359 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:57:43.336398 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1c563-a0ff-4fd8-b556-0b61b5e3b359 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:57:43.336398 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1c563-a0ff-4fd8-b556-0b61b5e3b359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:57:43.370571 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1c563-a0ff-4fd8-b556-0b61b5e3b359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:57:43.373930 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981dcd88-b174-4a6f-bb7d-d4746ccb2e3b None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:57:43.379804 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1c563-a0ff-4fd8-b556-0b61b5e3b359 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:57:43.385529 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981dcd88-b174-4a6f-bb7d-d4746ccb2e3b None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:57:43.390061 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f798e9-ce5f-4f27-b2d6-eedd8ff0a202 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:57:43.393602 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f798e9-ce5f-4f27-b2d6-eedd8ff0a202 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:57:43.394544 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f798e9-ce5f-4f27-b2d6-eedd8ff0a202 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:57:43.394719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f798e9-ce5f-4f27-b2d6-eedd8ff0a202 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:57:43.397415 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-07f798e9-ce5f-4f27-b2d6-eedd8ff0a202 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:57:43.411179 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f798e9-ce5f-4f27-b2d6-eedd8ff0a202 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:57:43.413279 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f798e9-ce5f-4f27-b2d6-eedd8ff0a202 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:57:43.420455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1229/2460] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:57:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:57:43.425367 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1232/2461] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:57:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:57:45.537808 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfa4d6-1ba0-40c3-b14b-1fa4cd7fc51a None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:57:45.537808 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfa4d6-1ba0-40c3-b14b-1fa4cd7fc51a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:57:45.537808 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfa4d6-1ba0-40c3-b14b-1fa4cd7fc51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:57:45.559702 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-f5cfa4d6-1ba0-40c3-b14b-1fa4cd7fc51a None None] MFA Rules not processed for user `a68b8d62ceb940469ef66df571f9a7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:57:45.561519 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f5cfa4d6-1ba0-40c3-b14b-1fa4cd7fc51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:57:45.640090 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1230/2462] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:57:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:57:50.334195 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42fba6-77a7-4ebb-b290-7b2b217a5250 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:57:50.340299 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42fba6-77a7-4ebb-b290-7b2b217a5250 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:57:50.340299 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42fba6-77a7-4ebb-b290-7b2b217a5250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:57:50.380751 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-5e42fba6-77a7-4ebb-b290-7b2b217a5250 None None] MFA Rules not processed for user `f67af2f4a93543c5bbd1703a6764867b`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:57:50.382829 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-5e42fba6-77a7-4ebb-b290-7b2b217a5250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:57:50.477050 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1233/2463] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:57:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:57:51.941775 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c526f33-168f-4a59-975f-e322b7d73624 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:57:51.942344 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c526f33-168f-4a59-975f-e322b7d73624 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:57:51.942986 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c526f33-168f-4a59-975f-e322b7d73624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:57:51.978305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-0c526f33-168f-4a59-975f-e322b7d73624 None None] MFA Rules not processed for user `fa467b0890784cabbd6bcad011ee1c91`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:57:51.981031 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0c526f33-168f-4a59-975f-e322b7d73624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:57:52.075549 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1231/2464] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:57:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:57:52.091058 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42fba6-77a7-4ebb-b290-7b2b217a5250 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:57:52.093012 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-5e42fba6-77a7-4ebb-b290-7b2b217a5250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:57:52.101126 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:57:52.205290 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42fba6-77a7-4ebb-b290-7b2b217a5250 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:57:52.212173 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf89e0-67e1-49bf-a3b2-4b30a7a10a58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:57:52.213893 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf89e0-67e1-49bf-a3b2-4b30a7a10a58 service nova] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:57:52.213893 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf89e0-67e1-49bf-a3b2-4b30a7a10a58 service nova] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:57:52.214078 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf89e0-67e1-49bf-a3b2-4b30a7a10a58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:57:52.223947 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf89e0-67e1-49bf-a3b2-4b30a7a10a58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:57:52.226530 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf89e0-67e1-49bf-a3b2-4b30a7a10a58 service nova] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:57:52.239965 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1234/2465] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:57:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:57:55.753731 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7dc4b-c81d-451e-98ce-f1588fdeb7c7 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:57:55.754313 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7dc4b-c81d-451e-98ce-f1588fdeb7c7 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:57:55.754313 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7dc4b-c81d-451e-98ce-f1588fdeb7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:57:55.783326 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-fdb7dc4b-c81d-451e-98ce-f1588fdeb7c7 None None] MFA Rules not processed for user `fa467b0890784cabbd6bcad011ee1c91`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:57:55.785059 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-fdb7dc4b-c81d-451e-98ce-f1588fdeb7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:57:55.795313 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1232/2466] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 08:57:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:58:02.330061 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=32 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:58:05.771702 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=80 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:59:11.314381 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689b649-9fae-4963-aac8-06ff9df0cd43 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:59:11.314910 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689b649-9fae-4963-aac8-06ff9df0cd43 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:59:11.315030 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689b649-9fae-4963-aac8-06ff9df0cd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:59:11.356575 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-a689b649-9fae-4963-aac8-06ff9df0cd43 None None] MFA Rules not processed for user `b3c1d56bc0a64411a68f97a4417b0379`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:59:11.358953 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-a689b649-9fae-4963-aac8-06ff9df0cd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:59:11.450014 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1235/2467] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Jul 25 08:59:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:59:11.629053 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7dc4b-c81d-451e-98ce-f1588fdeb7c7 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:59:11.638749 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-fdb7dc4b-c81d-451e-98ce-f1588fdeb7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:59:11.748718 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7dc4b-c81d-451e-98ce-f1588fdeb7c7 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:59:11.754159 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5e670-c35b-462a-ac8c-65e9ed0e66c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2763e540681547d3a6677567b3be86ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:59:11.754821 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5e670-c35b-462a-ac8c-65e9ed0e66c7 service swift] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:59:11.755109 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5e670-c35b-462a-ac8c-65e9ed0e66c7 service swift] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:59:11.755387 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5e670-c35b-462a-ac8c-65e9ed0e66c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:59:11.765061 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e5e670-c35b-462a-ac8c-65e9ed0e66c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:59:11.766718 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e5e670-c35b-462a-ac8c-65e9ed0e66c7 service swift] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:59:11.775640 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1233/2468] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Jul 25 08:59:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 08:59:20.598369 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689b649-9fae-4963-aac8-06ff9df0cd43 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:59:20.602435 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-a689b649-9fae-4963-aac8-06ff9df0cd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:59:20.760324 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689b649-9fae-4963-aac8-06ff9df0cd43 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:59:20.765936 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148a5c8-56a2-4e93-bdd9-3a7f55fb97f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfb4be75496444dd897b880c2ac3e67e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:59:20.766840 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148a5c8-56a2-4e93-bdd9-3a7f55fb97f4 service placement] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:59:20.767318 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148a5c8-56a2-4e93-bdd9-3a7f55fb97f4 service placement] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:59:20.767801 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148a5c8-56a2-4e93-bdd9-3a7f55fb97f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:59:20.769922 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-3148a5c8-56a2-4e93-bdd9-3a7f55fb97f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:59:20.784913 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3148a5c8-56a2-4e93-bdd9-3a7f55fb97f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:59:20.786979 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3148a5c8-56a2-4e93-bdd9-3a7f55fb97f4 service placement] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:59:20.801622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1236/2469] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:59:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:59:21.772016 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=47 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:59:30.736357 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10034df-62cb-48c7-bc73-a30fa17bd38a None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:59:30.736945 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10034df-62cb-48c7-bc73-a30fa17bd38a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:59:30.736945 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10034df-62cb-48c7-bc73-a30fa17bd38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:59:30.756741 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-c10034df-62cb-48c7-bc73-a30fa17bd38a None None] MFA Rules not processed for user `b3c1d56bc0a64411a68f97a4417b0379`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:59:30.757974 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c10034df-62cb-48c7-bc73-a30fa17bd38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:59:30.766483 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1234/2470] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Jul 25 08:59:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 08:59:30.778870 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148a5c8-56a2-4e93-bdd9-3a7f55fb97f4 service placement] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:59:30.790316 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148a5c8-56a2-4e93-bdd9-3a7f55fb97f4 service placement] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:59:30.796192 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcadd79-a13a-49c1-8888-bdbd185fdcab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2763e540681547d3a6677567b3be86ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:59:30.803085 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcadd79-a13a-49c1-8888-bdbd185fdcab service swift] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:59:30.803085 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcadd79-a13a-49c1-8888-bdbd185fdcab service swift] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:59:30.803085 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcadd79-a13a-49c1-8888-bdbd185fdcab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:59:30.806176 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcadd79-a13a-49c1-8888-bdbd185fdcab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:59:30.807823 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcadd79-a13a-49c1-8888-bdbd185fdcab service swift] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:59:30.818154 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1237/2471] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Jul 25 08:59:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 08:59:40.751557 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:59:40.814674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=92 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 08:59:45.006225 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10034df-62cb-48c7-bc73-a30fa17bd38a None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:59:45.029841 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10034df-62cb-48c7-bc73-a30fa17bd38a None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:59:45.033787 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04c154-36e7-479f-9b8a-3f8150fa454f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:59:45.034426 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04c154-36e7-479f-9b8a-3f8150fa454f service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:59:45.034712 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04c154-36e7-479f-9b8a-3f8150fa454f service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:59:45.034988 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04c154-36e7-479f-9b8a-3f8150fa454f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:59:45.036916 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-ca04c154-36e7-479f-9b8a-3f8150fa454f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:59:45.103377 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04c154-36e7-479f-9b8a-3f8150fa454f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:59:45.105256 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04c154-36e7-479f-9b8a-3f8150fa454f service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:59:45.115315 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1235/2472] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:59:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 08:59:51.838102 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bc346-498e-4960-9ec1-77447962c706 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:59:51.841432 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bc346-498e-4960-9ec1-77447962c706 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:59:51.841432 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bc346-498e-4960-9ec1-77447962c706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:59:51.867150 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-212bc346-498e-4960-9ec1-77447962c706 None None] MFA Rules not processed for user `b3c1d56bc0a64411a68f97a4417b0379`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 08:59:51.869243 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-212bc346-498e-4960-9ec1-77447962c706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:59:51.878482 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1238/2473] 10.222.0.18 () {58 vars in 967 bytes} [Mon Jul 25 08:59:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 08:59:51.892599 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04c154-36e7-479f-9b8a-3f8150fa454f service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:59:51.906090 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04c154-36e7-479f-9b8a-3f8150fa454f service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:59:51.911229 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985ce51-9a7c-4b3c-80c2-b6d89332ea9b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2763e540681547d3a6677567b3be86ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:59:51.912133 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985ce51-9a7c-4b3c-80c2-b6d89332ea9b service swift] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:59:51.912417 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985ce51-9a7c-4b3c-80c2-b6d89332ea9b service swift] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:59:51.912692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985ce51-9a7c-4b3c-80c2-b6d89332ea9b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:59:51.921740 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985ce51-9a7c-4b3c-80c2-b6d89332ea9b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:59:51.923237 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985ce51-9a7c-4b3c-80c2-b6d89332ea9b service swift] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:59:51.931387 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1236/2474] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Jul 25 08:59:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 08:59:53.301469 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212bc346-498e-4960-9ec1-77447962c706 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:59:53.311568 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212bc346-498e-4960-9ec1-77447962c706 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:59:53.315142 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7436ed-a89c-48f5-b59f-8a45d4dbec3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:59:53.315896 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7436ed-a89c-48f5-b59f-8a45d4dbec3d service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:59:53.316182 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7436ed-a89c-48f5-b59f-8a45d4dbec3d service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:59:53.316456 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7436ed-a89c-48f5-b59f-8a45d4dbec3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:59:53.318214 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-2a7436ed-a89c-48f5-b59f-8a45d4dbec3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:59:53.352563 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7436ed-a89c-48f5-b59f-8a45d4dbec3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:59:53.354013 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7436ed-a89c-48f5-b59f-8a45d4dbec3d service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:59:53.378683 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1239/2475] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:59:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 08:59:56.898935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985ce51-9a7c-4b3c-80c2-b6d89332ea9b service swift] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 08:59:56.900811 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a985ce51-9a7c-4b3c-80c2-b6d89332ea9b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:59:56.915988 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985ce51-9a7c-4b3c-80c2-b6d89332ea9b service swift] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 08:59:56.922084 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae8a1b-feaf-4143-8945-cd36de4c633f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfb4be75496444dd897b880c2ac3e67e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 08:59:56.922799 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae8a1b-feaf-4143-8945-cd36de4c633f service placement] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 08:59:56.923994 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae8a1b-feaf-4143-8945-cd36de4c633f service placement] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 08:59:56.923994 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae8a1b-feaf-4143-8945-cd36de4c633f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 08:59:56.925845 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9eae8a1b-feaf-4143-8945-cd36de4c633f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 08:59:56.938133 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae8a1b-feaf-4143-8945-cd36de4c633f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 08:59:56.939804 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae8a1b-feaf-4143-8945-cd36de4c633f service placement] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 08:59:56.951025 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1237/2476] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 08:59:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:00:01.231261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7436ed-a89c-48f5-b59f-8a45d4dbec3d service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:01.232855 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-2a7436ed-a89c-48f5-b59f-8a45d4dbec3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:00:01.245096 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7436ed-a89c-48f5-b59f-8a45d4dbec3d service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:01.250173 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7232e-e93f-4db8-afb8-2760d1a92b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:01.251065 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7232e-e93f-4db8-afb8-2760d1a92b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:01.251346 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7232e-e93f-4db8-afb8-2760d1a92b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:01.251641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7232e-e93f-4db8-afb8-2760d1a92b72 admin admin] PATH_INFO: `/v3/users/35719ec6e5634328aebc7ff6acdf1a0f` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:01.252858 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d7232e-e93f-4db8-afb8-2760d1a92b72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35719ec6e5634328aebc7ff6acdf1a0f)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:01.254788 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d7232e-e93f-4db8-afb8-2760d1a92b72 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:01.427154 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-50d7232e-e93f-4db8-afb8-2760d1a92b72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35719ec6e5634328aebc7ff6acdf1a0f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:01.427765 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-50d7232e-e93f-4db8-afb8-2760d1a92b72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35719ec6e5634328aebc7ff6acdf1a0f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:01.428377 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-50d7232e-e93f-4db8-afb8-2760d1a92b72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35719ec6e5634328aebc7ff6acdf1a0f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:01.435491 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-50d7232e-e93f-4db8-afb8-2760d1a92b72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35719ec6e5634328aebc7ff6acdf1a0f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:01.520661 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-50d7232e-e93f-4db8-afb8-2760d1a92b72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35719ec6e5634328aebc7ff6acdf1a0f'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:01.540838 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1240/2477] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:00:01 2022] DELETE /identity/v3/users/35719ec6e5634328aebc7ff6acdf1a0f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 09:00:01.808463 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae8a1b-feaf-4143-8945-cd36de4c633f service placement] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:01.828071 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae8a1b-feaf-4143-8945-cd36de4c633f service placement] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:01.883110 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7feee9-6770-4a6b-9d00-80523b0b986c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:01.884043 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7feee9-6770-4a6b-9d00-80523b0b986c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:01.884329 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7feee9-6770-4a6b-9d00-80523b0b986c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:01.884609 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7feee9-6770-4a6b-9d00-80523b0b986c admin admin] PATH_INFO: `/v3/projects/c2d403fe7404423681030b892a42a722` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:01.885817 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7feee9-6770-4a6b-9d00-80523b0b986c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2d403fe7404423681030b892a42a722)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:01.888394 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7feee9-6770-4a6b-9d00-80523b0b986c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:01.980059 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-5f7feee9-6770-4a6b-9d00-80523b0b986c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2d403fe7404423681030b892a42a722', 'request_id': 'req-5f7feee9-6770-4a6b-9d00-80523b0b986c'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:01.986982 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-5f7feee9-6770-4a6b-9d00-80523b0b986c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2d403fe7404423681030b892a42a722', 'request_id': 'req-5f7feee9-6770-4a6b-9d00-80523b0b986c'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:01.992596 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-5f7feee9-6770-4a6b-9d00-80523b0b986c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2d403fe7404423681030b892a42a722', 'request_id': 'req-5f7feee9-6770-4a6b-9d00-80523b0b986c'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:01.995201 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:00:02.063589 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-5f7feee9-6770-4a6b-9d00-80523b0b986c admin admin] The token cache is being invalidate because project c2d403fe7404423681030b892a42a722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:00:02.063905 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-5f7feee9-6770-4a6b-9d00-80523b0b986c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:02.064555 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-5f7feee9-6770-4a6b-9d00-80523b0b986c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:02.066805 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1238/2478] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:00:01 2022] DELETE /identity/v3/projects/c2d403fe7404423681030b892a42a722 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:00:02.070977 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7232e-e93f-4db8-afb8-2760d1a92b72 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:02.072459 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-50d7232e-e93f-4db8-afb8-2760d1a92b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:00:02.085608 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7232e-e93f-4db8-afb8-2760d1a92b72 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:02.143592 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d7b69-61f3-4196-9754-10dec1435e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:02.144495 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d7b69-61f3-4196-9754-10dec1435e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:02.144775 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d7b69-61f3-4196-9754-10dec1435e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:02.145046 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d7b69-61f3-4196-9754-10dec1435e4d admin admin] PATH_INFO: `/v3/users/623828dbdad3464c812d26e2cd26b1e1` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:02.146246 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d7b69-61f3-4196-9754-10dec1435e4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=623828dbdad3464c812d26e2cd26b1e1)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:02.148232 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d7b69-61f3-4196-9754-10dec1435e4d admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:02.253404 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:00:02.370536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-2a1d7b69-61f3-4196-9754-10dec1435e4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '623828dbdad3464c812d26e2cd26b1e1'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:02.371213 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-2a1d7b69-61f3-4196-9754-10dec1435e4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '623828dbdad3464c812d26e2cd26b1e1'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:02.371836 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-2a1d7b69-61f3-4196-9754-10dec1435e4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '623828dbdad3464c812d26e2cd26b1e1'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:02.384649 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-2a1d7b69-61f3-4196-9754-10dec1435e4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '623828dbdad3464c812d26e2cd26b1e1'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:02.464287 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-2a1d7b69-61f3-4196-9754-10dec1435e4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '623828dbdad3464c812d26e2cd26b1e1'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:02.482741 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1241/2479] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:00:02 2022] DELETE /identity/v3/users/623828dbdad3464c812d26e2cd26b1e1 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 09:00:02.734110 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7feee9-6770-4a6b-9d00-80523b0b986c admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:02.735948 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-5f7feee9-6770-4a6b-9d00-80523b0b986c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:00:02.752031 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7feee9-6770-4a6b-9d00-80523b0b986c admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:02.829918 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823b421-a729-4b46-b9e6-b65aca5fe51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:02.830914 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823b421-a729-4b46-b9e6-b65aca5fe51b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:02.831450 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823b421-a729-4b46-b9e6-b65aca5fe51b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:02.831837 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823b421-a729-4b46-b9e6-b65aca5fe51b admin admin] PATH_INFO: `/v3/projects/b9739d044fc2425d9a0bcdc4640d8cf7` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:02.833276 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2823b421-a729-4b46-b9e6-b65aca5fe51b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9739d044fc2425d9a0bcdc4640d8cf7)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:02.835553 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2823b421-a729-4b46-b9e6-b65aca5fe51b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:02.939094 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2823b421-a729-4b46-b9e6-b65aca5fe51b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9739d044fc2425d9a0bcdc4640d8cf7', 'request_id': 'req-2823b421-a729-4b46-b9e6-b65aca5fe51b'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:02.947078 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2823b421-a729-4b46-b9e6-b65aca5fe51b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9739d044fc2425d9a0bcdc4640d8cf7', 'request_id': 'req-2823b421-a729-4b46-b9e6-b65aca5fe51b'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:02.956139 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2823b421-a729-4b46-b9e6-b65aca5fe51b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9739d044fc2425d9a0bcdc4640d8cf7', 'request_id': 'req-2823b421-a729-4b46-b9e6-b65aca5fe51b'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:03.018201 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2823b421-a729-4b46-b9e6-b65aca5fe51b admin admin] The token cache is being invalidate because project b9739d044fc2425d9a0bcdc4640d8cf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:00:03.018548 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2823b421-a729-4b46-b9e6-b65aca5fe51b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:03.019390 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2823b421-a729-4b46-b9e6-b65aca5fe51b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:03.021297 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1239/2480] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:00:02 2022] DELETE /identity/v3/projects/b9739d044fc2425d9a0bcdc4640d8cf7 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:00:05.867135 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bc95b-5186-4afb-92c9-ea3732437e6d None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:05.867842 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bc95b-5186-4afb-92c9-ea3732437e6d None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:05.867842 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bc95b-5186-4afb-92c9-ea3732437e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:05.888234 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-901bc95b-5186-4afb-92c9-ea3732437e6d None None] MFA Rules not processed for user `fa467b0890784cabbd6bcad011ee1c91`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:00:05.889561 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-901bc95b-5186-4afb-92c9-ea3732437e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:00:05.945851 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1242/2481] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:00:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:00:10.025112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823b421-a729-4b46-b9e6-b65aca5fe51b admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:10.028548 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-2823b421-a729-4b46-b9e6-b65aca5fe51b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:00:10.126790 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823b421-a729-4b46-b9e6-b65aca5fe51b admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:10.130399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e5745-6076-4482-b43c-c5312144a479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:10.131047 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e5745-6076-4482-b43c-c5312144a479 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:10.131330 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e5745-6076-4482-b43c-c5312144a479 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:10.131606 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e5745-6076-4482-b43c-c5312144a479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:10.133497 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-ec2e5745-6076-4482-b43c-c5312144a479 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:00:10.163115 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:00:10.243913 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e5745-6076-4482-b43c-c5312144a479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:10.250930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e5745-6076-4482-b43c-c5312144a479 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:10.291118 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1240/2482] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:00:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:00:12.674644 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bc95b-5186-4afb-92c9-ea3732437e6d None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:12.676184 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-901bc95b-5186-4afb-92c9-ea3732437e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:00:12.688441 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bc95b-5186-4afb-92c9-ea3732437e6d None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:12.692180 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8c706-63b0-45fb-b39c-88b4159295c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:12.692827 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8c706-63b0-45fb-b39c-88b4159295c6 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:12.693108 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8c706-63b0-45fb-b39c-88b4159295c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:12.693409 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8c706-63b0-45fb-b39c-88b4159295c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:12.695200 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-27c8c706-63b0-45fb-b39c-88b4159295c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:00:12.711383 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8c706-63b0-45fb-b39c-88b4159295c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:12.712884 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8c706-63b0-45fb-b39c-88b4159295c6 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:12.726111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1243/2483] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:00:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:00:20.469095 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=30 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:00:22.720380 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:DELETE=6,keystone:SELECT=50,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:00:28.370207 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e5745-6076-4482-b43c-c5312144a479 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:28.380510 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e5745-6076-4482-b43c-c5312144a479 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:28.386054 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9c34f-c454-4344-bd5f-cb0fc1b69a62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:28.386724 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9c34f-c454-4344-bd5f-cb0fc1b69a62 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:28.387018 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9c34f-c454-4344-bd5f-cb0fc1b69a62 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:28.387301 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9c34f-c454-4344-bd5f-cb0fc1b69a62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:28.389916 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-26b9c34f-c454-4344-bd5f-cb0fc1b69a62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:00:28.458450 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9c34f-c454-4344-bd5f-cb0fc1b69a62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:28.459946 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9c34f-c454-4344-bd5f-cb0fc1b69a62 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:28.471563 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1241/2484] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:00:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:00:31.973459 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8c706-63b0-45fb-b39c-88b4159295c6 service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:31.975505 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-27c8c706-63b0-45fb-b39c-88b4159295c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:00:31.993711 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8c706-63b0-45fb-b39c-88b4159295c6 service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:31.999162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e2e1d-10e0-422b-8077-6819d0661ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:32.000249 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e2e1d-10e0-422b-8077-6819d0661ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:32.000530 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e2e1d-10e0-422b-8077-6819d0661ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:32.000804 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e2e1d-10e0-422b-8077-6819d0661ba4 admin admin] PATH_INFO: `/v3/users/f67af2f4a93543c5bbd1703a6764867b` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:32.015636 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e2e1d-10e0-422b-8077-6819d0661ba4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f67af2f4a93543c5bbd1703a6764867b)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:32.017595 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e2e1d-10e0-422b-8077-6819d0661ba4 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:32.248764 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-439e2e1d-10e0-422b-8077-6819d0661ba4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f67af2f4a93543c5bbd1703a6764867b'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:32.249587 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-439e2e1d-10e0-422b-8077-6819d0661ba4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f67af2f4a93543c5bbd1703a6764867b'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:32.250188 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-439e2e1d-10e0-422b-8077-6819d0661ba4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f67af2f4a93543c5bbd1703a6764867b'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:32.257536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-439e2e1d-10e0-422b-8077-6819d0661ba4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f67af2f4a93543c5bbd1703a6764867b'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:32.325834 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-439e2e1d-10e0-422b-8077-6819d0661ba4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f67af2f4a93543c5bbd1703a6764867b'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:32.346881 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1244/2485] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:00:31 2022] DELETE /identity/v3/users/f67af2f4a93543c5bbd1703a6764867b => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:00:32.600791 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9c34f-c454-4344-bd5f-cb0fc1b69a62 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:32.614854 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9c34f-c454-4344-bd5f-cb0fc1b69a62 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:32.641007 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e2e1d-10e0-422b-8077-6819d0661ba4 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:32.642643 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-439e2e1d-10e0-422b-8077-6819d0661ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:00:32.676174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0723fb-4995-4118-8724-836084e7f90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:32.677048 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0723fb-4995-4118-8724-836084e7f90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:32.677339 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0723fb-4995-4118-8724-836084e7f90f admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:32.677619 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0723fb-4995-4118-8724-836084e7f90f admin admin] PATH_INFO: `/v3/projects/6c602df7be1e424189aecfb781248815` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:32.688954 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0723fb-4995-4118-8724-836084e7f90f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c602df7be1e424189aecfb781248815)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:32.690884 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0723fb-4995-4118-8724-836084e7f90f admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:32.725127 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e2e1d-10e0-422b-8077-6819d0661ba4 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:32.729123 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda49e53-5e2b-4045-8e1a-f06b66384742 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:32.729805 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda49e53-5e2b-4045-8e1a-f06b66384742 service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:32.730094 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda49e53-5e2b-4045-8e1a-f06b66384742 service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:32.730957 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda49e53-5e2b-4045-8e1a-f06b66384742 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:32.732973 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-fda49e53-5e2b-4045-8e1a-f06b66384742 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:00:32.794821 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:00:32.797038 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3e0723fb-4995-4118-8724-836084e7f90f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c602df7be1e424189aecfb781248815', 'request_id': 'req-3e0723fb-4995-4118-8724-836084e7f90f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:32.798269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda49e53-5e2b-4045-8e1a-f06b66384742 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:32.799823 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda49e53-5e2b-4045-8e1a-f06b66384742 service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:32.804646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3e0723fb-4995-4118-8724-836084e7f90f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c602df7be1e424189aecfb781248815', 'request_id': 'req-3e0723fb-4995-4118-8724-836084e7f90f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:32.809840 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1245/2486] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:00:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 09:00:32.812206 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3e0723fb-4995-4118-8724-836084e7f90f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c602df7be1e424189aecfb781248815', 'request_id': 'req-3e0723fb-4995-4118-8724-836084e7f90f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:32.877627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3e0723fb-4995-4118-8724-836084e7f90f admin admin] The token cache is being invalidate because project 6c602df7be1e424189aecfb781248815 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:00:32.878105 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3e0723fb-4995-4118-8724-836084e7f90f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:32.879056 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3e0723fb-4995-4118-8724-836084e7f90f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:32.880826 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1242/2487] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:00:32 2022] DELETE /identity/v3/projects/6c602df7be1e424189aecfb781248815 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:00:32.886323 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a1e4e-40b4-4d5f-8bec-50e7c9d7d9c4 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:32.886616 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a1e4e-40b4-4d5f-8bec-50e7c9d7d9c4 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:32.886897 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a1e4e-40b4-4d5f-8bec-50e7c9d7d9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:32.953288 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-586a1e4e-40b4-4d5f-8bec-50e7c9d7d9c4 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:00:32.954526 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-586a1e4e-40b4-4d5f-8bec-50e7c9d7d9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:00:33.020700 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1246/2488] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:00:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:00:33.034481 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642e44f-2b4a-4d92-8380-363d03176659 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:33.034962 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642e44f-2b4a-4d92-8380-363d03176659 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:33.035302 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642e44f-2b4a-4d92-8380-363d03176659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:33.061058 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-f642e44f-2b4a-4d92-8380-363d03176659 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:00:33.062411 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f642e44f-2b4a-4d92-8380-363d03176659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:00:33.070648 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1243/2489] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:00:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:00:33.075043 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a1e4e-40b4-4d5f-8bec-50e7c9d7d9c4 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:33.085354 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a1e4e-40b4-4d5f-8bec-50e7c9d7d9c4 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:33.090586 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00024aa1-1a42-499e-83b8-3d965b2e1f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:33.091235 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00024aa1-1a42-499e-83b8-3d965b2e1f85 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:33.091520 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00024aa1-1a42-499e-83b8-3d965b2e1f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:33.092444 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00024aa1-1a42-499e-83b8-3d965b2e1f85 admin admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:33.093440 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00024aa1-1a42-499e-83b8-3d965b2e1f85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:00:33.093750 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00024aa1-1a42-499e-83b8-3d965b2e1f85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:33.095410 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00024aa1-1a42-499e-83b8-3d965b2e1f85 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:33.108886 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1247/2490] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 09:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:00:33.113454 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642e44f-2b4a-4d92-8380-363d03176659 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:33.123647 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642e44f-2b4a-4d92-8380-363d03176659 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:33.128494 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2973779-ee1d-4ce4-b97c-ad5b7a447fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:33.129188 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2973779-ee1d-4ce4-b97c-ad5b7a447fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:33.129478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2973779-ee1d-4ce4-b97c-ad5b7a447fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:33.129925 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2973779-ee1d-4ce4-b97c-ad5b7a447fe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:33.130608 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2973779-ee1d-4ce4-b97c-ad5b7a447fe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:33.132628 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2973779-ee1d-4ce4-b97c-ad5b7a447fe7 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:33.138279 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:00:33.248449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1244/2491] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 09:00:33 2022] POST /identity/v3/projects => generated 367 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:00:33.252631 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00024aa1-1a42-499e-83b8-3d965b2e1f85 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:33.263044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00024aa1-1a42-499e-83b8-3d965b2e1f85 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:33.346246 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0078fe-6481-4cdb-8919-61b533dd5760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:33.346866 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0078fe-6481-4cdb-8919-61b533dd5760 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:33.347136 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0078fe-6481-4cdb-8919-61b533dd5760 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:33.347479 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0078fe-6481-4cdb-8919-61b533dd5760 admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:33.348213 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0078fe-6481-4cdb-8919-61b533dd5760 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:33.350174 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0078fe-6481-4cdb-8919-61b533dd5760 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:33.434949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1248/2492] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 09:00:33 2022] POST /identity/v3/users => generated 284 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:00:33.439211 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2973779-ee1d-4ce4-b97c-ad5b7a447fe7 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:33.449861 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2973779-ee1d-4ce4-b97c-ad5b7a447fe7 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:33.455389 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3d7af-cc70-405f-946d-73b0308b252f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:33.458807 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3d7af-cc70-405f-946d-73b0308b252f admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:33.458807 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3d7af-cc70-405f-946d-73b0308b252f admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:33.458807 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3d7af-cc70-405f-946d-73b0308b252f admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:33.458807 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3d7af-cc70-405f-946d-73b0308b252f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:33.459181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3d7af-cc70-405f-946d-73b0308b252f admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:33.469902 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1245/2493] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:00:33.474202 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0078fe-6481-4cdb-8919-61b533dd5760 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:33.484931 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0078fe-6481-4cdb-8919-61b533dd5760 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:33.490361 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da000fe4-dd2d-458e-818c-b87564d9e642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:33.495668 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da000fe4-dd2d-458e-818c-b87564d9e642 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:33.495668 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da000fe4-dd2d-458e-818c-b87564d9e642 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:33.495668 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da000fe4-dd2d-458e-818c-b87564d9e642 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:33.495668 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da000fe4-dd2d-458e-818c-b87564d9e642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:33.495668 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da000fe4-dd2d-458e-818c-b87564d9e642 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:33.505769 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1249/2494] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:00:33.510193 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3d7af-cc70-405f-946d-73b0308b252f admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:33.522107 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3d7af-cc70-405f-946d-73b0308b252f admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:33.527278 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59158da9-0faa-4734-b34b-8dcfc2370a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:33.528214 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59158da9-0faa-4734-b34b-8dcfc2370a6b admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:33.528510 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59158da9-0faa-4734-b34b-8dcfc2370a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:33.528791 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59158da9-0faa-4734-b34b-8dcfc2370a6b admin admin] PATH_INFO: `/v3/projects/a799d017208749109e7ab19a61017c87/users/14573710e6a44ba7b38169a294547601/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:33.546235 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59158da9-0faa-4734-b34b-8dcfc2370a6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a799d017208749109e7ab19a61017c87, user_id=14573710e6a44ba7b38169a294547601, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:33.548980 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59158da9-0faa-4734-b34b-8dcfc2370a6b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:33.640616 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1246/2495] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:00:33 2022] PUT /identity/v3/projects/a799d017208749109e7ab19a61017c87/users/14573710e6a44ba7b38169a294547601/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:00:33.652223 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f28725-286e-4117-86c4-e75d0056c3aa None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:33.652515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f28725-286e-4117-86c4-e75d0056c3aa None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:33.653645 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f28725-286e-4117-86c4-e75d0056c3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:33.680827 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-87f28725-286e-4117-86c4-e75d0056c3aa None None] MFA Rules not processed for user `14573710e6a44ba7b38169a294547601`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:00:33.682040 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-87f28725-286e-4117-86c4-e75d0056c3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:00:33.701403 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:00:33.748325 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1250/2496] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:00:33 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:00:33.759591 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59158da9-0faa-4734-b34b-8dcfc2370a6b admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:33.761369 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-59158da9-0faa-4734-b34b-8dcfc2370a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:00:33.824138 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59158da9-0faa-4734-b34b-8dcfc2370a6b admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:33.827963 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbacfa58-29f7-455c-8d65-b1ee4683df43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:33.828622 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacfa58-29f7-455c-8d65-b1ee4683df43 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:33.828915 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacfa58-29f7-455c-8d65-b1ee4683df43 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:33.829196 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacfa58-29f7-455c-8d65-b1ee4683df43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:33.838131 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbacfa58-29f7-455c-8d65-b1ee4683df43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:33.839568 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbacfa58-29f7-455c-8d65-b1ee4683df43 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:33.849090 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1247/2497] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:00:33 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:00:43.783419 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=18 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:00:43.845039 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=50,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:00:45.744227 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2ea56-80b0-408f-bc16-50102c96077a None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:45.745092 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2ea56-80b0-408f-bc16-50102c96077a None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:45.745092 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2ea56-80b0-408f-bc16-50102c96077a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:45.766582 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-dcf2ea56-80b0-408f-bc16-50102c96077a None None] MFA Rules not processed for user `a68b8d62ceb940469ef66df571f9a7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:00:45.767947 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-dcf2ea56-80b0-408f-bc16-50102c96077a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:00:45.846961 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1251/2498] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:00:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:00:50.010229 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbacfa58-29f7-455c-8d65-b1ee4683df43 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:50.011762 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-dbacfa58-29f7-455c-8d65-b1ee4683df43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:00:50.079911 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbacfa58-29f7-455c-8d65-b1ee4683df43 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:50.083738 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78be3b8-69c0-4f24-8583-19633d6522d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:50.084544 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78be3b8-69c0-4f24-8583-19633d6522d9 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:50.084851 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78be3b8-69c0-4f24-8583-19633d6522d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:50.085193 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78be3b8-69c0-4f24-8583-19633d6522d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:50.089047 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c78be3b8-69c0-4f24-8583-19633d6522d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:00:50.100364 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78be3b8-69c0-4f24-8583-19633d6522d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:50.101843 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78be3b8-69c0-4f24-8583-19633d6522d9 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:50.110859 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1248/2499] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:00:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:00:52.321262 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2ea56-80b0-408f-bc16-50102c96077a None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:52.391688 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2ea56-80b0-408f-bc16-50102c96077a None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:52.396377 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60700e-918d-4563-8d28-089c92ba5609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:52.397261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60700e-918d-4563-8d28-089c92ba5609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:52.397551 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60700e-918d-4563-8d28-089c92ba5609 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:52.397831 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60700e-918d-4563-8d28-089c92ba5609 admin admin] PATH_INFO: `/v3/users/14573710e6a44ba7b38169a294547601` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:52.399364 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60700e-918d-4563-8d28-089c92ba5609 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14573710e6a44ba7b38169a294547601)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:52.401353 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60700e-918d-4563-8d28-089c92ba5609 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:52.604660 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5d60700e-918d-4563-8d28-089c92ba5609 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14573710e6a44ba7b38169a294547601'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:52.605415 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5d60700e-918d-4563-8d28-089c92ba5609 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14573710e6a44ba7b38169a294547601'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:52.606072 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5d60700e-918d-4563-8d28-089c92ba5609 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14573710e6a44ba7b38169a294547601'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:52.615766 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5d60700e-918d-4563-8d28-089c92ba5609 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14573710e6a44ba7b38169a294547601'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:52.685924 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-5d60700e-918d-4563-8d28-089c92ba5609 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14573710e6a44ba7b38169a294547601'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:52.709844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1252/2500] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:00:52 2022] DELETE /identity/v3/users/14573710e6a44ba7b38169a294547601 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:00:52.711449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9056b2-af67-4281-a8c4-4212909260db None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:52.711947 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9056b2-af67-4281-a8c4-4212909260db None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:52.712056 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9056b2-af67-4281-a8c4-4212909260db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:52.734264 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-fc9056b2-af67-4281-a8c4-4212909260db None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:00:52.735603 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-fc9056b2-af67-4281-a8c4-4212909260db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:00:52.801543 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1249/2501] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:00:52.812316 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60700e-918d-4563-8d28-089c92ba5609 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:52.813813 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-5d60700e-918d-4563-8d28-089c92ba5609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:00:52.843434 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:00:52.872614 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60700e-918d-4563-8d28-089c92ba5609 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:52.876153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ae89e-90fc-49ab-9c59-1340d52fbd2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:52.876829 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ae89e-90fc-49ab-9c59-1340d52fbd2b service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:52.877112 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ae89e-90fc-49ab-9c59-1340d52fbd2b service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:52.877385 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ae89e-90fc-49ab-9c59-1340d52fbd2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:52.887296 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ae89e-90fc-49ab-9c59-1340d52fbd2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:52.889384 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ae89e-90fc-49ab-9c59-1340d52fbd2b service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:52.899935 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1253/2502] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:00:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:00:53.460776 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9056b2-af67-4281-a8c4-4212909260db None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:53.462219 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-fc9056b2-af67-4281-a8c4-4212909260db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:00:53.476149 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9056b2-af67-4281-a8c4-4212909260db None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:53.481300 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf3369-62b2-477f-9aad-601fb2e5d3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:53.482938 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf3369-62b2-477f-9aad-601fb2e5d3f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:53.483231 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf3369-62b2-477f-9aad-601fb2e5d3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:53.483505 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf3369-62b2-477f-9aad-601fb2e5d3f1 admin admin] PATH_INFO: `/v3/projects/a799d017208749109e7ab19a61017c87` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:53.484911 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf3369-62b2-477f-9aad-601fb2e5d3f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a799d017208749109e7ab19a61017c87)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:53.487036 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf3369-62b2-477f-9aad-601fb2e5d3f1 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:53.611764 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-37bf3369-62b2-477f-9aad-601fb2e5d3f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a799d017208749109e7ab19a61017c87', 'request_id': 'req-37bf3369-62b2-477f-9aad-601fb2e5d3f1'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:53.619649 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-37bf3369-62b2-477f-9aad-601fb2e5d3f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a799d017208749109e7ab19a61017c87', 'request_id': 'req-37bf3369-62b2-477f-9aad-601fb2e5d3f1'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:53.626050 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-37bf3369-62b2-477f-9aad-601fb2e5d3f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a799d017208749109e7ab19a61017c87', 'request_id': 'req-37bf3369-62b2-477f-9aad-601fb2e5d3f1'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:53.713801 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-37bf3369-62b2-477f-9aad-601fb2e5d3f1 admin admin] The token cache is being invalidate because project a799d017208749109e7ab19a61017c87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:00:53.714345 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-37bf3369-62b2-477f-9aad-601fb2e5d3f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:53.714936 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-37bf3369-62b2-477f-9aad-601fb2e5d3f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:00:53.717502 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1250/2503] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:00:53 2022] DELETE /identity/v3/projects/a799d017208749109e7ab19a61017c87 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:00:53.722416 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922f32f-e928-41b6-aef5-607797b444af None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:53.722848 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922f32f-e928-41b6-aef5-607797b444af None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:53.722962 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922f32f-e928-41b6-aef5-607797b444af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:53.743114 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-d922f32f-e928-41b6-aef5-607797b444af None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:00:53.746151 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-d922f32f-e928-41b6-aef5-607797b444af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:00:53.806470 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1254/2504] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:00:53.815840 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9eaa5-f145-4776-91ef-a523d6e7d294 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:53.816132 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9eaa5-f145-4776-91ef-a523d6e7d294 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:53.816415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9eaa5-f145-4776-91ef-a523d6e7d294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:53.837185 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-a3c9eaa5-f145-4776-91ef-a523d6e7d294 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:00:53.838501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a3c9eaa5-f145-4776-91ef-a523d6e7d294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:00:53.847653 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1251/2505] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:00:53.851816 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922f32f-e928-41b6-aef5-607797b444af None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:53.862704 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922f32f-e928-41b6-aef5-607797b444af None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:53.867408 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c35b0a-feaa-43ae-8d5a-e448af3fbe54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:53.868236 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c35b0a-feaa-43ae-8d5a-e448af3fbe54 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:53.868386 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c35b0a-feaa-43ae-8d5a-e448af3fbe54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:53.868656 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c35b0a-feaa-43ae-8d5a-e448af3fbe54 admin admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:53.869387 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c35b0a-feaa-43ae-8d5a-e448af3fbe54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:00:53.869692 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c35b0a-feaa-43ae-8d5a-e448af3fbe54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:53.871332 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c35b0a-feaa-43ae-8d5a-e448af3fbe54 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:53.884048 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1255/2506] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 09:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:00:53.889008 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9eaa5-f145-4776-91ef-a523d6e7d294 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:53.898708 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9eaa5-f145-4776-91ef-a523d6e7d294 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:53.903684 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872b4eb-d008-46e7-b016-7e46757921e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:53.905254 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872b4eb-d008-46e7-b016-7e46757921e7 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:53.905548 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872b4eb-d008-46e7-b016-7e46757921e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:53.906301 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872b4eb-d008-46e7-b016-7e46757921e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:53.906526 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4872b4eb-d008-46e7-b016-7e46757921e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:53.908515 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4872b4eb-d008-46e7-b016-7e46757921e7 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:53.994636 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:00:54.003650 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1252/2507] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 09:00:53 2022] POST /identity/v3/projects => generated 355 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:00:54.006389 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c35b0a-feaa-43ae-8d5a-e448af3fbe54 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:54.017147 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c35b0a-feaa-43ae-8d5a-e448af3fbe54 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:54.076830 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcbf4a-1368-4b08-ba35-d2ac3692d604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:54.077529 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcbf4a-1368-4b08-ba35-d2ac3692d604 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:54.077813 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcbf4a-1368-4b08-ba35-d2ac3692d604 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:54.078083 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcbf4a-1368-4b08-ba35-d2ac3692d604 admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:54.078794 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdcbf4a-1368-4b08-ba35-d2ac3692d604 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:54.080756 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdcbf4a-1368-4b08-ba35-d2ac3692d604 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:54.155819 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1256/2508] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 09:00:54 2022] POST /identity/v3/users => generated 278 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:00:54.160157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872b4eb-d008-46e7-b016-7e46757921e7 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:54.171415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872b4eb-d008-46e7-b016-7e46757921e7 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:54.176139 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955067c7-87ab-4170-8c44-d77626bda777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:54.176800 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955067c7-87ab-4170-8c44-d77626bda777 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:54.177110 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955067c7-87ab-4170-8c44-d77626bda777 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:54.177388 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955067c7-87ab-4170-8c44-d77626bda777 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:54.178121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955067c7-87ab-4170-8c44-d77626bda777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:54.179804 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955067c7-87ab-4170-8c44-d77626bda777 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:54.190416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1253/2509] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:00:54.194489 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcbf4a-1368-4b08-ba35-d2ac3692d604 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:54.205883 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcbf4a-1368-4b08-ba35-d2ac3692d604 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:54.210489 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc52fee3-6b33-4279-a871-ef9164c7b039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:54.211148 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52fee3-6b33-4279-a871-ef9164c7b039 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:54.211428 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52fee3-6b33-4279-a871-ef9164c7b039 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:54.211736 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52fee3-6b33-4279-a871-ef9164c7b039 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:54.212463 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc52fee3-6b33-4279-a871-ef9164c7b039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:54.214057 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc52fee3-6b33-4279-a871-ef9164c7b039 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:54.225304 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1257/2510] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:00:54.229575 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955067c7-87ab-4170-8c44-d77626bda777 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:54.240011 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955067c7-87ab-4170-8c44-d77626bda777 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:54.244806 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079676f1-928b-4f35-80e2-565396230f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:54.245612 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079676f1-928b-4f35-80e2-565396230f9e admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:54.245896 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079676f1-928b-4f35-80e2-565396230f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:54.246176 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079676f1-928b-4f35-80e2-565396230f9e admin admin] PATH_INFO: `/v3/projects/1b733583dad343ccb93974441eb56cf7/users/502cf4a1c0cf41219454efa5637f0a24/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:54.262126 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079676f1-928b-4f35-80e2-565396230f9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b733583dad343ccb93974441eb56cf7, user_id=502cf4a1c0cf41219454efa5637f0a24, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:54.265602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079676f1-928b-4f35-80e2-565396230f9e admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:54.331873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1254/2511] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:00:54 2022] PUT /identity/v3/projects/1b733583dad343ccb93974441eb56cf7/users/502cf4a1c0cf41219454efa5637f0a24/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:00:54.344380 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f830efb-8a7d-4d93-9b18-5c262ce18fef None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:54.344681 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f830efb-8a7d-4d93-9b18-5c262ce18fef None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:54.344987 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f830efb-8a7d-4d93-9b18-5c262ce18fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:54.375058 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-0f830efb-8a7d-4d93-9b18-5c262ce18fef None None] MFA Rules not processed for user `502cf4a1c0cf41219454efa5637f0a24`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:00:54.376348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-0f830efb-8a7d-4d93-9b18-5c262ce18fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:00:54.400073 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:00:54.450530 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1258/2512] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:00:54 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:00:54.455149 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079676f1-928b-4f35-80e2-565396230f9e admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:54.520108 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079676f1-928b-4f35-80e2-565396230f9e admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:54.525119 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09ca57-e961-4e11-bdfc-788d3851b110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:54.525801 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09ca57-e961-4e11-bdfc-788d3851b110 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:54.526072 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09ca57-e961-4e11-bdfc-788d3851b110 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:54.526350 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09ca57-e961-4e11-bdfc-788d3851b110 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:54.527057 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09ca57-e961-4e11-bdfc-788d3851b110 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:54.529573 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09ca57-e961-4e11-bdfc-788d3851b110 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:54.639216 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1255/2513] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 09:00:54 2022] POST /identity/v3/projects => generated 357 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:00:54.643484 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f830efb-8a7d-4d93-9b18-5c262ce18fef None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:54.656146 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f830efb-8a7d-4d93-9b18-5c262ce18fef None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:54.719796 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede79efc-5111-4b46-b1a2-23a25b8dc613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:54.721003 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede79efc-5111-4b46-b1a2-23a25b8dc613 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:54.721509 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede79efc-5111-4b46-b1a2-23a25b8dc613 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:54.722010 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede79efc-5111-4b46-b1a2-23a25b8dc613 admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:54.723241 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede79efc-5111-4b46-b1a2-23a25b8dc613 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:54.725225 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede79efc-5111-4b46-b1a2-23a25b8dc613 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:54.806130 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1259/2514] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 09:00:54 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:00:54.809869 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09ca57-e961-4e11-bdfc-788d3851b110 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:54.821270 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09ca57-e961-4e11-bdfc-788d3851b110 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:54.826736 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969c345-66e8-43e0-ac91-a9b461dc4f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:54.827585 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969c345-66e8-43e0-ac91-a9b461dc4f8e admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:54.827903 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969c345-66e8-43e0-ac91-a9b461dc4f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:54.828186 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969c345-66e8-43e0-ac91-a9b461dc4f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:54.828933 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969c345-66e8-43e0-ac91-a9b461dc4f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:54.830575 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969c345-66e8-43e0-ac91-a9b461dc4f8e admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:54.842101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1256/2515] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:00:54.846740 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede79efc-5111-4b46-b1a2-23a25b8dc613 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:54.857941 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede79efc-5111-4b46-b1a2-23a25b8dc613 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:54.862836 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60f946-cb61-476d-bcb4-764af8acc3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:54.863777 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60f946-cb61-476d-bcb4-764af8acc3c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:54.864068 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60f946-cb61-476d-bcb4-764af8acc3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:54.864351 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60f946-cb61-476d-bcb4-764af8acc3c4 admin admin] PATH_INFO: `/v3/projects/47af538213e8425582376fb1f2be54dc/users/1c398a63d60f40d4bf6fe95420bf75ea/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:54.880647 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60f946-cb61-476d-bcb4-764af8acc3c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47af538213e8425582376fb1f2be54dc, user_id=1c398a63d60f40d4bf6fe95420bf75ea, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:54.883330 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60f946-cb61-476d-bcb4-764af8acc3c4 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:54.985192 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1260/2516] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:00:54 2022] PUT /identity/v3/projects/47af538213e8425582376fb1f2be54dc/users/1c398a63d60f40d4bf6fe95420bf75ea/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:00:54.989416 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969c345-66e8-43e0-ac91-a9b461dc4f8e admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:55.000625 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969c345-66e8-43e0-ac91-a9b461dc4f8e admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:55.068111 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37681767-b721-44b7-b936-a788823af972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:55.068728 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37681767-b721-44b7-b936-a788823af972 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:55.069018 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37681767-b721-44b7-b936-a788823af972 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:55.069302 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37681767-b721-44b7-b936-a788823af972 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:55.070053 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37681767-b721-44b7-b936-a788823af972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:55.071788 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37681767-b721-44b7-b936-a788823af972 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:55.086292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1257/2517] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 09:00:55.087695 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60f946-cb61-476d-bcb4-764af8acc3c4 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:55.099145 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60f946-cb61-476d-bcb4-764af8acc3c4 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:55.104122 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15868aa-4364-4059-904e-5b1ca869a140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:55.105019 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15868aa-4364-4059-904e-5b1ca869a140 admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:55.105298 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15868aa-4364-4059-904e-5b1ca869a140 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:55.105571 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15868aa-4364-4059-904e-5b1ca869a140 admin admin] PATH_INFO: `/v3/projects/47af538213e8425582376fb1f2be54dc/users/1c398a63d60f40d4bf6fe95420bf75ea/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:55.108398 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15868aa-4364-4059-904e-5b1ca869a140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47af538213e8425582376fb1f2be54dc, user_id=1c398a63d60f40d4bf6fe95420bf75ea, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:55.112301 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15868aa-4364-4059-904e-5b1ca869a140 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:55.126885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1261/2518] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:00:55 2022] PUT /identity/v3/projects/47af538213e8425582376fb1f2be54dc/users/1c398a63d60f40d4bf6fe95420bf75ea/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:00:55.139239 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb29c9-6280-4e9a-a6e2-8f91ab8b0207 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:55.139540 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb29c9-6280-4e9a-a6e2-8f91ab8b0207 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:55.139922 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb29c9-6280-4e9a-a6e2-8f91ab8b0207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:55.170601 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-e4cb29c9-6280-4e9a-a6e2-8f91ab8b0207 None None] MFA Rules not processed for user `1c398a63d60f40d4bf6fe95420bf75ea`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:00:55.171921 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-e4cb29c9-6280-4e9a-a6e2-8f91ab8b0207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:00:55.192686 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:00:55.243906 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1258/2519] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:00:55 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:00:55.255816 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15868aa-4364-4059-904e-5b1ca869a140 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:55.257695 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-a15868aa-4364-4059-904e-5b1ca869a140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:00:55.320494 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15868aa-4364-4059-904e-5b1ca869a140 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:55.324052 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d30d80-7d0b-4fdd-8e33-1c45e185ba7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:55.324717 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d30d80-7d0b-4fdd-8e33-1c45e185ba7e service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:55.325040 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d30d80-7d0b-4fdd-8e33-1c45e185ba7e service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:55.325320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d30d80-7d0b-4fdd-8e33-1c45e185ba7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:55.335975 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d30d80-7d0b-4fdd-8e33-1c45e185ba7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:55.337421 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d30d80-7d0b-4fdd-8e33-1c45e185ba7e service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:55.348301 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1262/2520] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:00:55 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 09:00:55.536708 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb29c9-6280-4e9a-a6e2-8f91ab8b0207 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:00:55.547227 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb29c9-6280-4e9a-a6e2-8f91ab8b0207 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:00:55.550904 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea325c-ed79-4e3c-9ed7-aca9ee1d6cd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:00:55.551558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea325c-ed79-4e3c-9ed7-aca9ee1d6cd3 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:00:55.551887 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea325c-ed79-4e3c-9ed7-aca9ee1d6cd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:00:55.552710 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea325c-ed79-4e3c-9ed7-aca9ee1d6cd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:00:55.613130 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea325c-ed79-4e3c-9ed7-aca9ee1d6cd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:00:55.614493 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea325c-ed79-4e3c-9ed7-aca9ee1d6cd3 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:00:55.623872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1259/2521] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:00:55 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:01:05.342646 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=87,keystone:INSERT=5 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:05.619558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=47 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:07.161569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d30d80-7d0b-4fdd-8e33-1c45e185ba7e service cinder] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:07.163129 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-59d30d80-7d0b-4fdd-8e33-1c45e185ba7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:07.228523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea325c-ed79-4e3c-9ed7-aca9ee1d6cd3 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:07.229281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d30d80-7d0b-4fdd-8e33-1c45e185ba7e service cinder] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:07.235941 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a50ef-16fd-48ec-bad4-ba6020bea1e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:07.236453 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a50ef-16fd-48ec-bad4-ba6020bea1e2 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:07.236740 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a50ef-16fd-48ec-bad4-ba6020bea1e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:07.237022 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a50ef-16fd-48ec-bad4-ba6020bea1e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:07.237937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea325c-ed79-4e3c-9ed7-aca9ee1d6cd3 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:07.238865 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-734a50ef-16fd-48ec-bad4-ba6020bea1e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:07.243134 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff23b8-6b3a-44a5-a29a-0f3250f5d93c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:07.243831 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff23b8-6b3a-44a5-a29a-0f3250f5d93c service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:07.244455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff23b8-6b3a-44a5-a29a-0f3250f5d93c service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:07.247766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff23b8-6b3a-44a5-a29a-0f3250f5d93c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:07.247766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-83ff23b8-6b3a-44a5-a29a-0f3250f5d93c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:07.321768 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a50ef-16fd-48ec-bad4-ba6020bea1e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:07.323351 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a50ef-16fd-48ec-bad4-ba6020bea1e2 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:07.335640 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1263/2522] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:01:07 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:01:07.406433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff23b8-6b3a-44a5-a29a-0f3250f5d93c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:07.408122 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff23b8-6b3a-44a5-a29a-0f3250f5d93c service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:07.433889 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1260/2523] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:01:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 09:01:09.510257 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a50ef-16fd-48ec-bad4-ba6020bea1e2 service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:09.511878 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-734a50ef-16fd-48ec-bad4-ba6020bea1e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:09.605546 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a50ef-16fd-48ec-bad4-ba6020bea1e2 service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:09.611079 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da32b59-bdae-47ce-8f03-1f9f01a8aa39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:09.611770 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da32b59-bdae-47ce-8f03-1f9f01a8aa39 service nova] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:09.612116 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da32b59-bdae-47ce-8f03-1f9f01a8aa39 service nova] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:09.612399 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da32b59-bdae-47ce-8f03-1f9f01a8aa39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:09.614995 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-7da32b59-bdae-47ce-8f03-1f9f01a8aa39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:09.627922 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da32b59-bdae-47ce-8f03-1f9f01a8aa39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:09.629830 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da32b59-bdae-47ce-8f03-1f9f01a8aa39 service nova] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:09.641934 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1264/2524] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:01:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:01:14.347070 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff23b8-6b3a-44a5-a29a-0f3250f5d93c service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:14.431249 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff23b8-6b3a-44a5-a29a-0f3250f5d93c service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:14.436137 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50856b2d-ab82-428d-9042-803112d4295f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:14.437016 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50856b2d-ab82-428d-9042-803112d4295f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:14.437296 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50856b2d-ab82-428d-9042-803112d4295f admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:14.437571 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50856b2d-ab82-428d-9042-803112d4295f admin admin] PATH_INFO: `/v3/users/502cf4a1c0cf41219454efa5637f0a24` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:14.438947 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50856b2d-ab82-428d-9042-803112d4295f admin admin] RBAC: Authorizing `identity:delete_user(user_id=502cf4a1c0cf41219454efa5637f0a24)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:14.441004 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50856b2d-ab82-428d-9042-803112d4295f admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:14.615527 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-50856b2d-ab82-428d-9042-803112d4295f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '502cf4a1c0cf41219454efa5637f0a24'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:14.616258 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-50856b2d-ab82-428d-9042-803112d4295f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '502cf4a1c0cf41219454efa5637f0a24'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:14.623505 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-50856b2d-ab82-428d-9042-803112d4295f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '502cf4a1c0cf41219454efa5637f0a24'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:14.624239 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-50856b2d-ab82-428d-9042-803112d4295f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '502cf4a1c0cf41219454efa5637f0a24'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:14.692635 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-50856b2d-ab82-428d-9042-803112d4295f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '502cf4a1c0cf41219454efa5637f0a24'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:14.701603 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:14.716082 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1261/2525] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:01:14 2022] DELETE /identity/v3/users/502cf4a1c0cf41219454efa5637f0a24 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:14.725386 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba984c-cacc-45d0-855b-80def99603fd None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:14.725897 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba984c-cacc-45d0-855b-80def99603fd None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:14.726033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba984c-cacc-45d0-855b-80def99603fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:14.746876 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-ecba984c-cacc-45d0-855b-80def99603fd None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:14.750434 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-ecba984c-cacc-45d0-855b-80def99603fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:14.780239 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:14.810105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1265/2526] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:01:14.820399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50856b2d-ab82-428d-9042-803112d4295f admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:14.822672 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-50856b2d-ab82-428d-9042-803112d4295f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:14.884946 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50856b2d-ab82-428d-9042-803112d4295f admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:14.888324 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247dc94f-8050-4310-879e-8ab49a22664a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:14.889131 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dc94f-8050-4310-879e-8ab49a22664a service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:14.889427 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dc94f-8050-4310-879e-8ab49a22664a service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:14.889762 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dc94f-8050-4310-879e-8ab49a22664a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:14.900598 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247dc94f-8050-4310-879e-8ab49a22664a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:14.902027 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247dc94f-8050-4310-879e-8ab49a22664a service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:14.912774 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1262/2527] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:01:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:01:15.296362 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba984c-cacc-45d0-855b-80def99603fd None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:15.298702 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-ecba984c-cacc-45d0-855b-80def99603fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:15.318759 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba984c-cacc-45d0-855b-80def99603fd None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:15.323836 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163899a-b036-4e9f-b511-8a9d25eee631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:15.328547 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163899a-b036-4e9f-b511-8a9d25eee631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:15.328547 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163899a-b036-4e9f-b511-8a9d25eee631 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:15.328547 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163899a-b036-4e9f-b511-8a9d25eee631 admin admin] PATH_INFO: `/v3/projects/1b733583dad343ccb93974441eb56cf7` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:15.328547 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163899a-b036-4e9f-b511-8a9d25eee631 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b733583dad343ccb93974441eb56cf7)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:15.328547 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163899a-b036-4e9f-b511-8a9d25eee631 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:15.466665 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-6163899a-b036-4e9f-b511-8a9d25eee631 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b733583dad343ccb93974441eb56cf7', 'request_id': 'req-6163899a-b036-4e9f-b511-8a9d25eee631'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:15.473306 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-6163899a-b036-4e9f-b511-8a9d25eee631 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b733583dad343ccb93974441eb56cf7', 'request_id': 'req-6163899a-b036-4e9f-b511-8a9d25eee631'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:15.487484 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-6163899a-b036-4e9f-b511-8a9d25eee631 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b733583dad343ccb93974441eb56cf7', 'request_id': 'req-6163899a-b036-4e9f-b511-8a9d25eee631'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:15.566391 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-6163899a-b036-4e9f-b511-8a9d25eee631 admin admin] The token cache is being invalidate because project 1b733583dad343ccb93974441eb56cf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:01:15.566391 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-6163899a-b036-4e9f-b511-8a9d25eee631 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:15.566391 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-6163899a-b036-4e9f-b511-8a9d25eee631 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:15.566391 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1266/2528] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:01:15 2022] DELETE /identity/v3/projects/1b733583dad343ccb93974441eb56cf7 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:15.569068 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247dc94f-8050-4310-879e-8ab49a22664a service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:15.578667 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247dc94f-8050-4310-879e-8ab49a22664a service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:15.641328 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b46a5-195b-45e5-ae68-4df816d5aa7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:15.642209 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b46a5-195b-45e5-ae68-4df816d5aa7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:15.642492 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b46a5-195b-45e5-ae68-4df816d5aa7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:15.642767 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b46a5-195b-45e5-ae68-4df816d5aa7b admin admin] PATH_INFO: `/v3/users/1c398a63d60f40d4bf6fe95420bf75ea` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:15.645450 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b46a5-195b-45e5-ae68-4df816d5aa7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c398a63d60f40d4bf6fe95420bf75ea)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:15.648184 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b46a5-195b-45e5-ae68-4df816d5aa7b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:15.809246 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-d74b46a5-195b-45e5-ae68-4df816d5aa7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c398a63d60f40d4bf6fe95420bf75ea'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:15.809872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-d74b46a5-195b-45e5-ae68-4df816d5aa7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c398a63d60f40d4bf6fe95420bf75ea'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:15.818344 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-d74b46a5-195b-45e5-ae68-4df816d5aa7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c398a63d60f40d4bf6fe95420bf75ea'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:15.819015 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-d74b46a5-195b-45e5-ae68-4df816d5aa7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c398a63d60f40d4bf6fe95420bf75ea'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:15.908513 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-d74b46a5-195b-45e5-ae68-4df816d5aa7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c398a63d60f40d4bf6fe95420bf75ea'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:15.929076 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1263/2529] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:01:15 2022] DELETE /identity/v3/users/1c398a63d60f40d4bf6fe95420bf75ea => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:16.336192 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163899a-b036-4e9f-b511-8a9d25eee631 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:16.336192 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-6163899a-b036-4e9f-b511-8a9d25eee631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:16.347942 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163899a-b036-4e9f-b511-8a9d25eee631 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:16.421512 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fac46-f11a-4bcc-9d5e-046b621b2587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:16.422405 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fac46-f11a-4bcc-9d5e-046b621b2587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:16.422688 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fac46-f11a-4bcc-9d5e-046b621b2587 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:16.422961 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fac46-f11a-4bcc-9d5e-046b621b2587 admin admin] PATH_INFO: `/v3/projects/47af538213e8425582376fb1f2be54dc` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:16.424180 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3fac46-f11a-4bcc-9d5e-046b621b2587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47af538213e8425582376fb1f2be54dc)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:16.426896 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3fac46-f11a-4bcc-9d5e-046b621b2587 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:16.527677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-6e3fac46-f11a-4bcc-9d5e-046b621b2587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47af538213e8425582376fb1f2be54dc', 'request_id': 'req-6e3fac46-f11a-4bcc-9d5e-046b621b2587'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:16.533880 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-6e3fac46-f11a-4bcc-9d5e-046b621b2587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47af538213e8425582376fb1f2be54dc', 'request_id': 'req-6e3fac46-f11a-4bcc-9d5e-046b621b2587'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:16.539920 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:16.541343 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-6e3fac46-f11a-4bcc-9d5e-046b621b2587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47af538213e8425582376fb1f2be54dc', 'request_id': 'req-6e3fac46-f11a-4bcc-9d5e-046b621b2587'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:16.605377 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-6e3fac46-f11a-4bcc-9d5e-046b621b2587 admin admin] The token cache is being invalidate because project 47af538213e8425582376fb1f2be54dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:01:16.605623 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-6e3fac46-f11a-4bcc-9d5e-046b621b2587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:16.606240 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-6e3fac46-f11a-4bcc-9d5e-046b621b2587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:16.607862 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1267/2530] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:01:16 2022] DELETE /identity/v3/projects/47af538213e8425582376fb1f2be54dc => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:16.613680 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14260a-c2d7-4455-9709-4b9690822091 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:16.614177 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14260a-c2d7-4455-9709-4b9690822091 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:16.614291 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14260a-c2d7-4455-9709-4b9690822091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:16.636239 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-7f14260a-c2d7-4455-9709-4b9690822091 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:16.637488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-7f14260a-c2d7-4455-9709-4b9690822091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:16.645843 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:16.711778 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1264/2531] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:01:16.726906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238f67f-6d1b-4d41-ab05-68397c071d15 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:16.727286 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238f67f-6d1b-4d41-ab05-68397c071d15 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:16.727667 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238f67f-6d1b-4d41-ab05-68397c071d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:16.748849 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-f238f67f-6d1b-4d41-ab05-68397c071d15 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:16.750063 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-f238f67f-6d1b-4d41-ab05-68397c071d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:16.758902 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1268/2532] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:01:16.763518 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14260a-c2d7-4455-9709-4b9690822091 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:16.774303 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14260a-c2d7-4455-9709-4b9690822091 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:16.778958 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1685be9-2844-4120-9ac7-0eaffd4f3547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:16.779704 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1685be9-2844-4120-9ac7-0eaffd4f3547 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:16.779944 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1685be9-2844-4120-9ac7-0eaffd4f3547 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:16.780222 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1685be9-2844-4120-9ac7-0eaffd4f3547 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:16.780992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1685be9-2844-4120-9ac7-0eaffd4f3547 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:01:16.781304 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1685be9-2844-4120-9ac7-0eaffd4f3547 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:16.782914 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1685be9-2844-4120-9ac7-0eaffd4f3547 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:16.796188 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1265/2533] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 09:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:01:16.800951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238f67f-6d1b-4d41-ab05-68397c071d15 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:16.810687 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238f67f-6d1b-4d41-ab05-68397c071d15 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:16.815426 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e43fc5-f396-4fcd-b235-b973dab49c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:16.816742 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e43fc5-f396-4fcd-b235-b973dab49c2b admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:16.817716 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e43fc5-f396-4fcd-b235-b973dab49c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:16.817998 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e43fc5-f396-4fcd-b235-b973dab49c2b admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:16.818721 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e43fc5-f396-4fcd-b235-b973dab49c2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:16.820668 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e43fc5-f396-4fcd-b235-b973dab49c2b admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:16.890377 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1685be9-2844-4120-9ac7-0eaffd4f3547 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:16.892133 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b1685be9-2844-4120-9ac7-0eaffd4f3547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:16.899661 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1269/2534] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 09:01:16 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:01:16.905347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e43fc5-f396-4fcd-b235-b973dab49c2b admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:16.956190 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1685be9-2844-4120-9ac7-0eaffd4f3547 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:16.975591 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e43fc5-f396-4fcd-b235-b973dab49c2b admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:16.980943 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdb168-1338-44a1-be82-4cc72687e43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:16.981626 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdb168-1338-44a1-be82-4cc72687e43c admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:16.981905 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdb168-1338-44a1-be82-4cc72687e43c admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:16.982182 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdb168-1338-44a1-be82-4cc72687e43c admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:16.982881 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cdb168-1338-44a1-be82-4cc72687e43c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:16.984896 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cdb168-1338-44a1-be82-4cc72687e43c admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:17.009671 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394d325-89f2-41a9-918e-5dfb80305172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:17.010331 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394d325-89f2-41a9-918e-5dfb80305172 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:17.010618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394d325-89f2-41a9-918e-5dfb80305172 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:17.010900 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394d325-89f2-41a9-918e-5dfb80305172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:17.012727 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a394d325-89f2-41a9-918e-5dfb80305172 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:17.026532 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394d325-89f2-41a9-918e-5dfb80305172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:17.029155 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394d325-89f2-41a9-918e-5dfb80305172 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:17.039213 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1266/2535] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:01:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:01:17.081253 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1270/2536] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 09:01:16 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:01:17.086478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394d325-89f2-41a9-918e-5dfb80305172 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:17.096918 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394d325-89f2-41a9-918e-5dfb80305172 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:17.101830 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce7052-0a08-4936-968b-14370c08b9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:17.103623 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce7052-0a08-4936-968b-14370c08b9ad admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:17.103623 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce7052-0a08-4936-968b-14370c08b9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:17.103623 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce7052-0a08-4936-968b-14370c08b9ad admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:17.103895 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce7052-0a08-4936-968b-14370c08b9ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:17.105422 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce7052-0a08-4936-968b-14370c08b9ad admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:17.124777 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1267/2537] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 09:01:17.126134 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdb168-1338-44a1-be82-4cc72687e43c admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:17.138597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdb168-1338-44a1-be82-4cc72687e43c admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:17.143597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d6d0c-319a-4704-914a-7c57d47283d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:17.144952 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d6d0c-319a-4704-914a-7c57d47283d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:17.145445 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d6d0c-319a-4704-914a-7c57d47283d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:17.145731 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d6d0c-319a-4704-914a-7c57d47283d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:17.146479 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d6d0c-319a-4704-914a-7c57d47283d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:17.148162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d6d0c-319a-4704-914a-7c57d47283d3 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:17.162764 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1271/2538] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:01:17.164109 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce7052-0a08-4936-968b-14370c08b9ad admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:17.174669 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce7052-0a08-4936-968b-14370c08b9ad admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:17.179391 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c7256-1a95-4453-895b-49a3295571b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:17.180331 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c7256-1a95-4453-895b-49a3295571b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:17.180618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c7256-1a95-4453-895b-49a3295571b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:17.180904 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c7256-1a95-4453-895b-49a3295571b3 admin admin] PATH_INFO: `/v3/projects/271cf43041054ca8981704c7244f55d6/users/bc1e238eed0a47829006310e5349abf2/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:17.202064 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c7256-1a95-4453-895b-49a3295571b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=271cf43041054ca8981704c7244f55d6, user_id=bc1e238eed0a47829006310e5349abf2, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:17.206593 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c7256-1a95-4453-895b-49a3295571b3 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:17.286936 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1268/2539] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:01:17 2022] PUT /identity/v3/projects/271cf43041054ca8981704c7244f55d6/users/bc1e238eed0a47829006310e5349abf2/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:17.297774 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329f491-29f8-435c-ba9e-8a24f489e51d None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:17.298340 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329f491-29f8-435c-ba9e-8a24f489e51d None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:17.298740 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329f491-29f8-435c-ba9e-8a24f489e51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:17.330766 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-6329f491-29f8-435c-ba9e-8a24f489e51d None None] MFA Rules not processed for user `bc1e238eed0a47829006310e5349abf2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:17.332221 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-6329f491-29f8-435c-ba9e-8a24f489e51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:17.407455 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1272/2540] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:01:17.412647 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c7256-1a95-4453-895b-49a3295571b3 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:17.440087 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:17.480895 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c7256-1a95-4453-895b-49a3295571b3 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:17.485641 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20342b-54d4-48bf-8239-35e15b5cb25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:17.486342 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20342b-54d4-48bf-8239-35e15b5cb25f admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:17.486622 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20342b-54d4-48bf-8239-35e15b5cb25f admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:17.486901 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20342b-54d4-48bf-8239-35e15b5cb25f admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:17.487648 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20342b-54d4-48bf-8239-35e15b5cb25f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:17.490477 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20342b-54d4-48bf-8239-35e15b5cb25f admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:17.568211 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1269/2541] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 09:01:17 2022] POST /identity/v3/projects => generated 381 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:01:17.572247 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329f491-29f8-435c-ba9e-8a24f489e51d None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:17.583696 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329f491-29f8-435c-ba9e-8a24f489e51d None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:17.613840 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:17.650481 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07914b-0df7-4158-96bd-554eaa3ab92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:17.651140 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07914b-0df7-4158-96bd-554eaa3ab92d admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:17.651500 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07914b-0df7-4158-96bd-554eaa3ab92d admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:17.651813 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07914b-0df7-4158-96bd-554eaa3ab92d admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:17.652529 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb07914b-0df7-4158-96bd-554eaa3ab92d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:17.654484 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb07914b-0df7-4158-96bd-554eaa3ab92d admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:17.731420 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1273/2542] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 09:01:17 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:01:17.737151 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20342b-54d4-48bf-8239-35e15b5cb25f admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:17.747286 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20342b-54d4-48bf-8239-35e15b5cb25f admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:17.754931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704695d-b2b5-4157-8e80-83205cef9c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:17.755659 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704695d-b2b5-4157-8e80-83205cef9c8b admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:17.755944 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704695d-b2b5-4157-8e80-83205cef9c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:17.756226 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704695d-b2b5-4157-8e80-83205cef9c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:17.759289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d704695d-b2b5-4157-8e80-83205cef9c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:17.759289 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d704695d-b2b5-4157-8e80-83205cef9c8b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:17.771092 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1270/2543] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:01:17.775862 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07914b-0df7-4158-96bd-554eaa3ab92d admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:17.792542 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07914b-0df7-4158-96bd-554eaa3ab92d admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:17.799592 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea6a7d-004a-4f01-bb82-f484dfd0f39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:17.801845 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea6a7d-004a-4f01-bb82-f484dfd0f39a admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:17.802205 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea6a7d-004a-4f01-bb82-f484dfd0f39a admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:17.802547 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea6a7d-004a-4f01-bb82-f484dfd0f39a admin admin] PATH_INFO: `/v3/projects/2732ac0d05fc4e7fa8a574aa2778cfe7/users/3feb2f3b813747508ac96a093431152f/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:17.821166 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dea6a7d-004a-4f01-bb82-f484dfd0f39a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2732ac0d05fc4e7fa8a574aa2778cfe7, user_id=3feb2f3b813747508ac96a093431152f, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:17.823970 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dea6a7d-004a-4f01-bb82-f484dfd0f39a admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:17.891315 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1274/2544] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:01:17 2022] PUT /identity/v3/projects/2732ac0d05fc4e7fa8a574aa2778cfe7/users/3feb2f3b813747508ac96a093431152f/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 09:01:17.895501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704695d-b2b5-4157-8e80-83205cef9c8b admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:17.906412 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704695d-b2b5-4157-8e80-83205cef9c8b admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:17.967380 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282eaddf-dff5-4af2-ba6a-9ab75c2b3b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:17.968083 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282eaddf-dff5-4af2-ba6a-9ab75c2b3b9a admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:17.968366 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282eaddf-dff5-4af2-ba6a-9ab75c2b3b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:17.968668 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282eaddf-dff5-4af2-ba6a-9ab75c2b3b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:17.969437 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282eaddf-dff5-4af2-ba6a-9ab75c2b3b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:17.971014 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282eaddf-dff5-4af2-ba6a-9ab75c2b3b9a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:17.981690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1271/2545] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 09:01:17.986119 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea6a7d-004a-4f01-bb82-f484dfd0f39a admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:17.997515 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea6a7d-004a-4f01-bb82-f484dfd0f39a admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:18.002414 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48536b-5d8d-4dae-a723-ba9c0958464c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:18.003302 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48536b-5d8d-4dae-a723-ba9c0958464c admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:18.003634 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48536b-5d8d-4dae-a723-ba9c0958464c admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:18.003913 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48536b-5d8d-4dae-a723-ba9c0958464c admin admin] PATH_INFO: `/v3/projects/2732ac0d05fc4e7fa8a574aa2778cfe7/users/3feb2f3b813747508ac96a093431152f/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:18.006074 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48536b-5d8d-4dae-a723-ba9c0958464c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2732ac0d05fc4e7fa8a574aa2778cfe7, user_id=3feb2f3b813747508ac96a093431152f, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:18.008737 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48536b-5d8d-4dae-a723-ba9c0958464c admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:18.019473 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1275/2546] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:01:17 2022] PUT /identity/v3/projects/2732ac0d05fc4e7fa8a574aa2778cfe7/users/3feb2f3b813747508ac96a093431152f/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:18.030155 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc80c2e-f27b-4be5-8f90-860ab242b2e7 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:18.030444 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc80c2e-f27b-4be5-8f90-860ab242b2e7 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:18.030727 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc80c2e-f27b-4be5-8f90-860ab242b2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:18.064401 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-5fc80c2e-f27b-4be5-8f90-860ab242b2e7 None None] MFA Rules not processed for user `3feb2f3b813747508ac96a093431152f`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:18.065653 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-5fc80c2e-f27b-4be5-8f90-860ab242b2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:18.154866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1272/2547] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:01:18.167702 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48536b-5d8d-4dae-a723-ba9c0958464c admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:18.169882 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-8a48536b-5d8d-4dae-a723-ba9c0958464c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:18.248650 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48536b-5d8d-4dae-a723-ba9c0958464c admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:18.252859 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067c625-3e8d-4e7a-800d-c88fecff18fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:18.253592 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067c625-3e8d-4e7a-800d-c88fecff18fa service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:18.254402 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067c625-3e8d-4e7a-800d-c88fecff18fa service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:18.254816 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067c625-3e8d-4e7a-800d-c88fecff18fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:18.271745 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b067c625-3e8d-4e7a-800d-c88fecff18fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:18.273753 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b067c625-3e8d-4e7a-800d-c88fecff18fa service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:18.284363 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1276/2548] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:01:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:01:18.844404 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc80c2e-f27b-4be5-8f90-860ab242b2e7 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:18.870260 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:18.919045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc80c2e-f27b-4be5-8f90-860ab242b2e7 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:18.923897 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bfda52-2d40-43d7-b83c-7322c9b0ea17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:18.924867 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bfda52-2d40-43d7-b83c-7322c9b0ea17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:18.925088 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bfda52-2d40-43d7-b83c-7322c9b0ea17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:18.925900 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bfda52-2d40-43d7-b83c-7322c9b0ea17 admin admin] PATH_INFO: `/v3/users/bc1e238eed0a47829006310e5349abf2` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:18.927258 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bfda52-2d40-43d7-b83c-7322c9b0ea17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc1e238eed0a47829006310e5349abf2)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:18.929297 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bfda52-2d40-43d7-b83c-7322c9b0ea17 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:19.080145 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-30bfda52-2d40-43d7-b83c-7322c9b0ea17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc1e238eed0a47829006310e5349abf2'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:19.081158 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-30bfda52-2d40-43d7-b83c-7322c9b0ea17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc1e238eed0a47829006310e5349abf2'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:19.090309 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-30bfda52-2d40-43d7-b83c-7322c9b0ea17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc1e238eed0a47829006310e5349abf2'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:19.091093 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-30bfda52-2d40-43d7-b83c-7322c9b0ea17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc1e238eed0a47829006310e5349abf2'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:19.188177 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-30bfda52-2d40-43d7-b83c-7322c9b0ea17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc1e238eed0a47829006310e5349abf2'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:19.212567 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1273/2549] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:01:18 2022] DELETE /identity/v3/users/bc1e238eed0a47829006310e5349abf2 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:19.217155 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e057b-3069-4cd6-b291-d8ac6354c61b None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:19.217694 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e057b-3069-4cd6-b291-d8ac6354c61b None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:19.217694 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e057b-3069-4cd6-b291-d8ac6354c61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:19.236877 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-d02e057b-3069-4cd6-b291-d8ac6354c61b None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:19.238925 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-d02e057b-3069-4cd6-b291-d8ac6354c61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:19.304210 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1277/2550] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:01:19.314090 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bfda52-2d40-43d7-b83c-7322c9b0ea17 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:19.315603 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-30bfda52-2d40-43d7-b83c-7322c9b0ea17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:19.383039 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bfda52-2d40-43d7-b83c-7322c9b0ea17 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:19.387157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150f7e7-905d-4eef-b6ce-352c114da160 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:19.388182 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150f7e7-905d-4eef-b6ce-352c114da160 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:19.388654 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150f7e7-905d-4eef-b6ce-352c114da160 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:19.389119 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150f7e7-905d-4eef-b6ce-352c114da160 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:19.401162 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150f7e7-905d-4eef-b6ce-352c114da160 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:19.402986 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150f7e7-905d-4eef-b6ce-352c114da160 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:19.416457 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1274/2551] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:01:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:01:19.904088 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e057b-3069-4cd6-b291-d8ac6354c61b None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:19.906271 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-d02e057b-3069-4cd6-b291-d8ac6354c61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:19.924809 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e057b-3069-4cd6-b291-d8ac6354c61b None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:19.930341 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248a38b-e070-476c-9b1d-4ab37f98e5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:19.931224 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248a38b-e070-476c-9b1d-4ab37f98e5f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:19.931511 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248a38b-e070-476c-9b1d-4ab37f98e5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:19.931838 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248a38b-e070-476c-9b1d-4ab37f98e5f1 admin admin] PATH_INFO: `/v3/projects/271cf43041054ca8981704c7244f55d6` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:19.933183 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248a38b-e070-476c-9b1d-4ab37f98e5f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=271cf43041054ca8981704c7244f55d6)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:19.935124 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248a38b-e070-476c-9b1d-4ab37f98e5f1 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:19.965841 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:20.075058 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-9248a38b-e070-476c-9b1d-4ab37f98e5f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '271cf43041054ca8981704c7244f55d6', 'request_id': 'req-9248a38b-e070-476c-9b1d-4ab37f98e5f1'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:20.085636 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-9248a38b-e070-476c-9b1d-4ab37f98e5f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '271cf43041054ca8981704c7244f55d6', 'request_id': 'req-9248a38b-e070-476c-9b1d-4ab37f98e5f1'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:20.103313 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-9248a38b-e070-476c-9b1d-4ab37f98e5f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '271cf43041054ca8981704c7244f55d6', 'request_id': 'req-9248a38b-e070-476c-9b1d-4ab37f98e5f1'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:20.208576 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-9248a38b-e070-476c-9b1d-4ab37f98e5f1 admin admin] The token cache is being invalidate because project 271cf43041054ca8981704c7244f55d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:01:20.208576 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-9248a38b-e070-476c-9b1d-4ab37f98e5f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:20.209346 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-9248a38b-e070-476c-9b1d-4ab37f98e5f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:20.211405 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1278/2552] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:01:19 2022] DELETE /identity/v3/projects/271cf43041054ca8981704c7244f55d6 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:20.215264 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150f7e7-905d-4eef-b6ce-352c114da160 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:20.229163 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150f7e7-905d-4eef-b6ce-352c114da160 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:20.278653 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:20.310338 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4d857-151e-40b5-861b-3390751092f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:20.311254 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4d857-151e-40b5-861b-3390751092f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:20.311541 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4d857-151e-40b5-861b-3390751092f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:20.312203 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4d857-151e-40b5-861b-3390751092f5 admin admin] PATH_INFO: `/v3/users/3feb2f3b813747508ac96a093431152f` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:20.316917 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4d857-151e-40b5-861b-3390751092f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3feb2f3b813747508ac96a093431152f)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:20.319673 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4d857-151e-40b5-861b-3390751092f5 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:20.493899 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-94e4d857-151e-40b5-861b-3390751092f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3feb2f3b813747508ac96a093431152f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:20.495820 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-94e4d857-151e-40b5-861b-3390751092f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3feb2f3b813747508ac96a093431152f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:20.515154 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-94e4d857-151e-40b5-861b-3390751092f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3feb2f3b813747508ac96a093431152f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:20.516695 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-94e4d857-151e-40b5-861b-3390751092f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3feb2f3b813747508ac96a093431152f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:20.598257 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-94e4d857-151e-40b5-861b-3390751092f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3feb2f3b813747508ac96a093431152f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:20.625514 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1275/2553] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:01:20 2022] DELETE /identity/v3/users/3feb2f3b813747508ac96a093431152f => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:20.818277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248a38b-e070-476c-9b1d-4ab37f98e5f1 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:20.819746 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-9248a38b-e070-476c-9b1d-4ab37f98e5f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:20.833469 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248a38b-e070-476c-9b1d-4ab37f98e5f1 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:20.901730 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05921757-a534-4399-b83d-ef24ee0b1343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:20.902618 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05921757-a534-4399-b83d-ef24ee0b1343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:20.903182 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05921757-a534-4399-b83d-ef24ee0b1343 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:20.903182 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05921757-a534-4399-b83d-ef24ee0b1343 admin admin] PATH_INFO: `/v3/users/c8fac29036de4afbb8c1b64862e829b9` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:20.904455 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05921757-a534-4399-b83d-ef24ee0b1343 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8fac29036de4afbb8c1b64862e829b9)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:20.906418 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05921757-a534-4399-b83d-ef24ee0b1343 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:21.100063 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-05921757-a534-4399-b83d-ef24ee0b1343 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8fac29036de4afbb8c1b64862e829b9'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:21.100755 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-05921757-a534-4399-b83d-ef24ee0b1343 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8fac29036de4afbb8c1b64862e829b9'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:21.101419 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-05921757-a534-4399-b83d-ef24ee0b1343 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8fac29036de4afbb8c1b64862e829b9'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:21.108995 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-05921757-a534-4399-b83d-ef24ee0b1343 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8fac29036de4afbb8c1b64862e829b9'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:21.126525 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4d857-151e-40b5-861b-3390751092f5 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:21.132049 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-94e4d857-151e-40b5-861b-3390751092f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:21.143058 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4d857-151e-40b5-861b-3390751092f5 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:21.149171 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbd84e-6b6d-40cc-a8f1-dd72740290d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:21.150096 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbd84e-6b6d-40cc-a8f1-dd72740290d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:21.150394 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbd84e-6b6d-40cc-a8f1-dd72740290d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:21.150679 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbd84e-6b6d-40cc-a8f1-dd72740290d5 admin admin] PATH_INFO: `/v3/projects/2732ac0d05fc4e7fa8a574aa2778cfe7` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:21.151973 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbd84e-6b6d-40cc-a8f1-dd72740290d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2732ac0d05fc4e7fa8a574aa2778cfe7)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:21.153974 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbd84e-6b6d-40cc-a8f1-dd72740290d5 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:21.177352 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-05921757-a534-4399-b83d-ef24ee0b1343 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8fac29036de4afbb8c1b64862e829b9'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:21.197129 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1279/2554] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:01:20 2022] DELETE /identity/v3/users/c8fac29036de4afbb8c1b64862e829b9 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:21.252823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-83cbd84e-6b6d-40cc-a8f1-dd72740290d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2732ac0d05fc4e7fa8a574aa2778cfe7', 'request_id': 'req-83cbd84e-6b6d-40cc-a8f1-dd72740290d5'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:21.261007 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-83cbd84e-6b6d-40cc-a8f1-dd72740290d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2732ac0d05fc4e7fa8a574aa2778cfe7', 'request_id': 'req-83cbd84e-6b6d-40cc-a8f1-dd72740290d5'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:21.267045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-83cbd84e-6b6d-40cc-a8f1-dd72740290d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2732ac0d05fc4e7fa8a574aa2778cfe7', 'request_id': 'req-83cbd84e-6b6d-40cc-a8f1-dd72740290d5'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:21.313561 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-83cbd84e-6b6d-40cc-a8f1-dd72740290d5 admin admin] The token cache is being invalidate because project 2732ac0d05fc4e7fa8a574aa2778cfe7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:01:21.315852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-83cbd84e-6b6d-40cc-a8f1-dd72740290d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:21.315852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-83cbd84e-6b6d-40cc-a8f1-dd72740290d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:21.317043 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1276/2555] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:01:21 2022] DELETE /identity/v3/projects/2732ac0d05fc4e7fa8a574aa2778cfe7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:21.323655 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd147b2-db9f-4f4e-b682-d1d0a780277f None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:21.323958 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd147b2-db9f-4f4e-b682-d1d0a780277f None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:21.324246 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd147b2-db9f-4f4e-b682-d1d0a780277f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:21.345448 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-6bd147b2-db9f-4f4e-b682-d1d0a780277f None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:21.350554 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-6bd147b2-db9f-4f4e-b682-d1d0a780277f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:21.369821 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:21.411496 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1280/2556] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:01:21.419174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46653f36-0957-4137-b77e-9cbecd9acecc None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:21.419479 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46653f36-0957-4137-b77e-9cbecd9acecc None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:21.419800 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46653f36-0957-4137-b77e-9cbecd9acecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:21.436395 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd147b2-db9f-4f4e-b682-d1d0a780277f None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:21.438972 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-6bd147b2-db9f-4f4e-b682-d1d0a780277f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:21.443670 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-46653f36-0957-4137-b77e-9cbecd9acecc None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:21.445267 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-46653f36-0957-4137-b77e-9cbecd9acecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:21.454169 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd147b2-db9f-4f4e-b682-d1d0a780277f None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:21.461058 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c432e2-f0b6-41b8-8b6e-e6daca0e3692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:21.462365 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c432e2-f0b6-41b8-8b6e-e6daca0e3692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:21.462771 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c432e2-f0b6-41b8-8b6e-e6daca0e3692 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:21.463252 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c432e2-f0b6-41b8-8b6e-e6daca0e3692 admin admin] PATH_INFO: `/v3/projects/734a3bd889ad4c3388428a2e4ac321f2` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:21.465065 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c432e2-f0b6-41b8-8b6e-e6daca0e3692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=734a3bd889ad4c3388428a2e4ac321f2)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:21.465856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1277/2557] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:01:21.468445 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c432e2-f0b6-41b8-8b6e-e6daca0e3692 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:21.470046 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46653f36-0957-4137-b77e-9cbecd9acecc None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:21.480853 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46653f36-0957-4137-b77e-9cbecd9acecc None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:21.485940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34467ed3-d159-48c3-8877-38e5e13430df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:21.486738 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34467ed3-d159-48c3-8877-38e5e13430df admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:21.487022 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34467ed3-d159-48c3-8877-38e5e13430df admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:21.487301 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34467ed3-d159-48c3-8877-38e5e13430df admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:21.488144 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34467ed3-d159-48c3-8877-38e5e13430df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:01:21.488447 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34467ed3-d159-48c3-8877-38e5e13430df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:21.490095 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34467ed3-d159-48c3-8877-38e5e13430df admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:21.502947 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1278/2558] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 09:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:01:21.507534 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34467ed3-d159-48c3-8877-38e5e13430df admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:21.517749 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34467ed3-d159-48c3-8877-38e5e13430df admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:21.523321 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccad6b2-13e2-46aa-a37b-2124aff45ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:21.524265 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccad6b2-13e2-46aa-a37b-2124aff45ddb admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:21.524556 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccad6b2-13e2-46aa-a37b-2124aff45ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:21.524840 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccad6b2-13e2-46aa-a37b-2124aff45ddb admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:21.525536 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccad6b2-13e2-46aa-a37b-2124aff45ddb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:21.527448 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccad6b2-13e2-46aa-a37b-2124aff45ddb admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:21.571216 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-d3c432e2-f0b6-41b8-8b6e-e6daca0e3692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '734a3bd889ad4c3388428a2e4ac321f2', 'request_id': 'req-d3c432e2-f0b6-41b8-8b6e-e6daca0e3692'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:21.577381 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-d3c432e2-f0b6-41b8-8b6e-e6daca0e3692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '734a3bd889ad4c3388428a2e4ac321f2', 'request_id': 'req-d3c432e2-f0b6-41b8-8b6e-e6daca0e3692'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:21.583623 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-d3c432e2-f0b6-41b8-8b6e-e6daca0e3692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '734a3bd889ad4c3388428a2e4ac321f2', 'request_id': 'req-d3c432e2-f0b6-41b8-8b6e-e6daca0e3692'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:21.617656 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:21.624090 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1279/2559] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 09:01:21 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:01:21.628316 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccad6b2-13e2-46aa-a37b-2124aff45ddb admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:21.638953 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-d3c432e2-f0b6-41b8-8b6e-e6daca0e3692 admin admin] The token cache is being invalidate because project 734a3bd889ad4c3388428a2e4ac321f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:01:21.639249 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-d3c432e2-f0b6-41b8-8b6e-e6daca0e3692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:21.640081 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-d3c432e2-f0b6-41b8-8b6e-e6daca0e3692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:21.641741 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1281/2560] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:01:21 2022] DELETE /identity/v3/projects/734a3bd889ad4c3388428a2e4ac321f2 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 09:01:21.647693 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b325b03-f9f8-48ea-b4a1-45b8d2bd87e0 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:21.647989 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b325b03-f9f8-48ea-b4a1-45b8d2bd87e0 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:21.648273 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b325b03-f9f8-48ea-b4a1-45b8d2bd87e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:21.669668 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-8b325b03-f9f8-48ea-b4a1-45b8d2bd87e0 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:21.670924 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-8b325b03-f9f8-48ea-b4a1-45b8d2bd87e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:21.700216 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccad6b2-13e2-46aa-a37b-2124aff45ddb admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:21.705857 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b303f4-2d5f-4da7-845f-d772c533d50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:21.706811 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b303f4-2d5f-4da7-845f-d772c533d50e admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:21.707261 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b303f4-2d5f-4da7-845f-d772c533d50e admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:21.708733 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b303f4-2d5f-4da7-845f-d772c533d50e admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:21.709064 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b303f4-2d5f-4da7-845f-d772c533d50e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:21.711434 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b303f4-2d5f-4da7-845f-d772c533d50e admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:21.735811 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1282/2561] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:01:21.749261 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fe06f-641f-4246-b9d4-69fd48b770e8 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:21.749547 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fe06f-641f-4246-b9d4-69fd48b770e8 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:21.749828 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fe06f-641f-4246-b9d4-69fd48b770e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:21.776406 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-d55fe06f-641f-4246-b9d4-69fd48b770e8 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:21.777614 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-d55fe06f-641f-4246-b9d4-69fd48b770e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:21.785572 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1283/2562] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:01:21.789821 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55fe06f-641f-4246-b9d4-69fd48b770e8 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:21.795703 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1280/2563] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 09:01:21 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:01:21.800822 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55fe06f-641f-4246-b9d4-69fd48b770e8 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:21.804489 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b303f4-2d5f-4da7-845f-d772c533d50e admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:21.804726 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e453b-f658-4e2e-9849-5faa254923af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:21.805396 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e453b-f658-4e2e-9849-5faa254923af admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:21.805672 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e453b-f658-4e2e-9849-5faa254923af admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:21.805971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e453b-f658-4e2e-9849-5faa254923af admin admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:21.806498 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-22b303f4-2d5f-4da7-845f-d772c533d50e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:21.806764 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e453b-f658-4e2e-9849-5faa254923af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:01:21.807067 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e453b-f658-4e2e-9849-5faa254923af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:21.808703 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e453b-f658-4e2e-9849-5faa254923af admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:21.819591 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b303f4-2d5f-4da7-845f-d772c533d50e admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:21.824950 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1284/2564] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 09:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:01:21.825479 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56fae3-0e69-4577-8e9c-0371a68a3184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:21.825598 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56fae3-0e69-4577-8e9c-0371a68a3184 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:21.825844 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56fae3-0e69-4577-8e9c-0371a68a3184 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:21.826132 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56fae3-0e69-4577-8e9c-0371a68a3184 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:21.826791 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e453b-f658-4e2e-9849-5faa254923af admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:21.826907 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56fae3-0e69-4577-8e9c-0371a68a3184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:21.828504 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56fae3-0e69-4577-8e9c-0371a68a3184 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:21.837594 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e453b-f658-4e2e-9849-5faa254923af admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:21.843488 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1281/2565] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:01:21.844670 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56fae3-0e69-4577-8e9c-0371a68a3184 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:21.845934 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2553ae1-508e-46e6-851b-3c35de06adfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:21.846606 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2553ae1-508e-46e6-851b-3c35de06adfa admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:21.846892 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2553ae1-508e-46e6-851b-3c35de06adfa admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:21.847191 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2553ae1-508e-46e6-851b-3c35de06adfa admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:21.848557 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2553ae1-508e-46e6-851b-3c35de06adfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:21.850470 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2553ae1-508e-46e6-851b-3c35de06adfa admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:21.855200 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56fae3-0e69-4577-8e9c-0371a68a3184 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:21.859891 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b41e7-5ee8-4c23-8c05-114e377dd451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:21.860560 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b41e7-5ee8-4c23-8c05-114e377dd451 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:21.860856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b41e7-5ee8-4c23-8c05-114e377dd451 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:21.861142 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b41e7-5ee8-4c23-8c05-114e377dd451 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:21.864874 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b41e7-5ee8-4c23-8c05-114e377dd451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:21.864874 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b41e7-5ee8-4c23-8c05-114e377dd451 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:21.886573 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1282/2566] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:01:21.889724 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b41e7-5ee8-4c23-8c05-114e377dd451 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:21.901033 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b41e7-5ee8-4c23-8c05-114e377dd451 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:21.905870 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a695be-7a67-486a-bdd8-2611548556ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:21.906749 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a695be-7a67-486a-bdd8-2611548556ec admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:21.907033 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a695be-7a67-486a-bdd8-2611548556ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:21.907310 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a695be-7a67-486a-bdd8-2611548556ec admin admin] PATH_INFO: `/v3/projects/5dababcd6d9b41dc8ea98e41acde0b69/users/4916e7790d7d4b9dac6ca11f7f1a3754/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:21.922449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a695be-7a67-486a-bdd8-2611548556ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dababcd6d9b41dc8ea98e41acde0b69, user_id=4916e7790d7d4b9dac6ca11f7f1a3754, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:21.925155 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a695be-7a67-486a-bdd8-2611548556ec admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:21.972581 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1285/2567] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 09:01:21 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:01:21.977532 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2553ae1-508e-46e6-851b-3c35de06adfa admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:21.992933 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:22.047284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2553ae1-508e-46e6-851b-3c35de06adfa admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:22.052831 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d7c5b-55f0-405e-9047-d1bfe3aa1241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:22.053562 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d7c5b-55f0-405e-9047-d1bfe3aa1241 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:22.053922 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d7c5b-55f0-405e-9047-d1bfe3aa1241 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:22.054288 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d7c5b-55f0-405e-9047-d1bfe3aa1241 admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:22.055286 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d7c5b-55f0-405e-9047-d1bfe3aa1241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:22.057371 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d7c5b-55f0-405e-9047-d1bfe3aa1241 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:22.062884 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1283/2568] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:01:21 2022] PUT /identity/v3/projects/5dababcd6d9b41dc8ea98e41acde0b69/users/4916e7790d7d4b9dac6ca11f7f1a3754/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:22.074186 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3325381-92b1-4821-8c24-7a3e9409f66f None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:22.074486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3325381-92b1-4821-8c24-7a3e9409f66f None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:22.074767 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3325381-92b1-4821-8c24-7a3e9409f66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:22.103898 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-e3325381-92b1-4821-8c24-7a3e9409f66f None None] MFA Rules not processed for user `4916e7790d7d4b9dac6ca11f7f1a3754`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:22.105136 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-e3325381-92b1-4821-8c24-7a3e9409f66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:22.155013 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1286/2569] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 09:01:21 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:01:22.158873 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d7c5b-55f0-405e-9047-d1bfe3aa1241 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:22.170330 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d7c5b-55f0-405e-9047-d1bfe3aa1241 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:22.173333 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1284/2570] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:01:22.186474 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3325381-92b1-4821-8c24-7a3e9409f66f None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:22.187908 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-e3325381-92b1-4821-8c24-7a3e9409f66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:22.230204 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:22.237629 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51ec29-c607-4141-917d-b199fb41903e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:22.247062 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51ec29-c607-4141-917d-b199fb41903e admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:22.247062 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51ec29-c607-4141-917d-b199fb41903e admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:22.247062 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51ec29-c607-4141-917d-b199fb41903e admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:22.247062 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51ec29-c607-4141-917d-b199fb41903e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:22.247062 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51ec29-c607-4141-917d-b199fb41903e admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:22.254523 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1287/2571] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:01:22.258337 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3325381-92b1-4821-8c24-7a3e9409f66f None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:22.259238 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51ec29-c607-4141-917d-b199fb41903e admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:22.263423 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4a323-62ab-4259-aec8-d7572002b611 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:22.264806 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4a323-62ab-4259-aec8-d7572002b611 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:22.265012 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4a323-62ab-4259-aec8-d7572002b611 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:22.265507 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4a323-62ab-4259-aec8-d7572002b611 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:22.270588 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51ec29-c607-4141-917d-b199fb41903e admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:22.276065 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4a323-62ab-4259-aec8-d7572002b611 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:22.276222 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e88cf-1f67-4846-bcd3-1cf009aebe75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:22.277310 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e88cf-1f67-4846-bcd3-1cf009aebe75 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:22.277310 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e88cf-1f67-4846-bcd3-1cf009aebe75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:22.277310 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e88cf-1f67-4846-bcd3-1cf009aebe75 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:22.277579 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4a323-62ab-4259-aec8-d7572002b611 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:22.278056 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e88cf-1f67-4846-bcd3-1cf009aebe75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:22.279700 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e88cf-1f67-4846-bcd3-1cf009aebe75 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:22.289330 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1285/2572] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:01:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 09:01:22.292173 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1288/2573] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 09:01:22.296210 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4a323-62ab-4259-aec8-d7572002b611 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:22.313004 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4a323-62ab-4259-aec8-d7572002b611 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:22.313400 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e88cf-1f67-4846-bcd3-1cf009aebe75 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:22.318337 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c8fa8-ee77-4a9c-b35f-e53c6df2297a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:22.319344 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c8fa8-ee77-4a9c-b35f-e53c6df2297a admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:22.319746 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c8fa8-ee77-4a9c-b35f-e53c6df2297a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:22.320099 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c8fa8-ee77-4a9c-b35f-e53c6df2297a admin admin] PATH_INFO: `/v3/projects/f3c989f47a6846ce8e06d6487183df63/users/2da94f55eab542e9bb586ad13f23db9f/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:22.324244 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e88cf-1f67-4846-bcd3-1cf009aebe75 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:22.329439 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03daf0d-7df8-40aa-996e-e2e9df973b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:22.330558 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03daf0d-7df8-40aa-996e-e2e9df973b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:22.330878 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03daf0d-7df8-40aa-996e-e2e9df973b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:22.331209 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03daf0d-7df8-40aa-996e-e2e9df973b95 admin admin] PATH_INFO: `/v3/users/4916e7790d7d4b9dac6ca11f7f1a3754` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:22.332954 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03daf0d-7df8-40aa-996e-e2e9df973b95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4916e7790d7d4b9dac6ca11f7f1a3754)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:22.334911 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03daf0d-7df8-40aa-996e-e2e9df973b95 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:22.341599 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c8fa8-ee77-4a9c-b35f-e53c6df2297a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3c989f47a6846ce8e06d6487183df63, user_id=2da94f55eab542e9bb586ad13f23db9f, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:22.344344 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c8fa8-ee77-4a9c-b35f-e53c6df2297a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:22.394188 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1286/2574] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:01:22 2022] PUT /identity/v3/projects/f3c989f47a6846ce8e06d6487183df63/users/2da94f55eab542e9bb586ad13f23db9f/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 09:01:22.406968 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247589d6-b0b0-4430-ba46-fb7a5af04fca None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:22.407205 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247589d6-b0b0-4430-ba46-fb7a5af04fca None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:22.407490 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247589d6-b0b0-4430-ba46-fb7a5af04fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:22.438484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-247589d6-b0b0-4430-ba46-fb7a5af04fca None None] MFA Rules not processed for user `2da94f55eab542e9bb586ad13f23db9f`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:22.439752 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-247589d6-b0b0-4430-ba46-fb7a5af04fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:22.497327 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-a03daf0d-7df8-40aa-996e-e2e9df973b95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4916e7790d7d4b9dac6ca11f7f1a3754'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:22.498025 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-a03daf0d-7df8-40aa-996e-e2e9df973b95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4916e7790d7d4b9dac6ca11f7f1a3754'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:22.498660 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-a03daf0d-7df8-40aa-996e-e2e9df973b95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4916e7790d7d4b9dac6ca11f7f1a3754'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:22.506232 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-a03daf0d-7df8-40aa-996e-e2e9df973b95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4916e7790d7d4b9dac6ca11f7f1a3754'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:22.526281 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1287/2575] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:01:22.530757 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247589d6-b0b0-4430-ba46-fb7a5af04fca None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:22.532244 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-247589d6-b0b0-4430-ba46-fb7a5af04fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:22.570841 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-a03daf0d-7df8-40aa-996e-e2e9df973b95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4916e7790d7d4b9dac6ca11f7f1a3754'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:22.583666 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:22.601064 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1289/2576] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:01:22 2022] DELETE /identity/v3/users/4916e7790d7d4b9dac6ca11f7f1a3754 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 09:01:22.605620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fcbfc-ef36-4543-a979-6e666ed5ec0f None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:22.606034 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fcbfc-ef36-4543-a979-6e666ed5ec0f None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:22.606492 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fcbfc-ef36-4543-a979-6e666ed5ec0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:22.607789 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247589d6-b0b0-4430-ba46-fb7a5af04fca None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:22.635445 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-a18fcbfc-ef36-4543-a979-6e666ed5ec0f None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:22.636724 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-a18fcbfc-ef36-4543-a979-6e666ed5ec0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:22.668274 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:22.687260 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff135db-3029-4194-9589-c4deb2328ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:22.688195 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff135db-3029-4194-9589-c4deb2328ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:22.688498 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff135db-3029-4194-9589-c4deb2328ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:22.688814 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff135db-3029-4194-9589-c4deb2328ea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:22.689655 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff135db-3029-4194-9589-c4deb2328ea0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:22.692513 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff135db-3029-4194-9589-c4deb2328ea0 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:22.716914 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1290/2577] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:01:22.727640 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18fcbfc-ef36-4543-a979-6e666ed5ec0f None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:22.735394 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-a18fcbfc-ef36-4543-a979-6e666ed5ec0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:22.797131 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18fcbfc-ef36-4543-a979-6e666ed5ec0f None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:22.801612 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2503408-3372-420e-a97b-c84c41f37818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:22.802279 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2503408-3372-420e-a97b-c84c41f37818 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:22.802569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2503408-3372-420e-a97b-c84c41f37818 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:22.802844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2503408-3372-420e-a97b-c84c41f37818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:22.817176 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1288/2578] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 09:01:22 2022] POST /identity/v3/projects => generated 387 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:01:22.817395 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2503408-3372-420e-a97b-c84c41f37818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:22.817395 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2503408-3372-420e-a97b-c84c41f37818 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:22.818834 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff135db-3029-4194-9589-c4deb2328ea0 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:22.830734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1291/2579] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:01:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 09:01:22.901873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff135db-3029-4194-9589-c4deb2328ea0 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:22.908346 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f7283-21ae-4296-ba61-a71939efa969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:22.909109 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f7283-21ae-4296-ba61-a71939efa969 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:22.910314 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f7283-21ae-4296-ba61-a71939efa969 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:22.910485 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f7283-21ae-4296-ba61-a71939efa969 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:22.911604 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f7283-21ae-4296-ba61-a71939efa969 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:22.913762 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f7283-21ae-4296-ba61-a71939efa969 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:23.006022 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1289/2580] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 09:01:22 2022] POST /identity/v3/users => generated 300 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:01:23.010094 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2503408-3372-420e-a97b-c84c41f37818 service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:23.022710 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2503408-3372-420e-a97b-c84c41f37818 service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:23.029056 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb9fa3-33c7-400f-8293-2db27e794a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:23.029877 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb9fa3-33c7-400f-8293-2db27e794a0e admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:23.030251 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb9fa3-33c7-400f-8293-2db27e794a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:23.030621 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb9fa3-33c7-400f-8293-2db27e794a0e admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:23.033696 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb9fa3-33c7-400f-8293-2db27e794a0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:23.033696 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb9fa3-33c7-400f-8293-2db27e794a0e admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:23.045816 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1292/2581] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:01:23.050142 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f7283-21ae-4296-ba61-a71939efa969 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:23.061965 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f7283-21ae-4296-ba61-a71939efa969 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:23.068752 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5468e8-9389-4202-a9de-5991e5e38fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:23.074944 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5468e8-9389-4202-a9de-5991e5e38fb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:23.074944 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5468e8-9389-4202-a9de-5991e5e38fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:23.074944 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5468e8-9389-4202-a9de-5991e5e38fb2 admin admin] PATH_INFO: `/v3/projects/9f12494bcdf64d2285ea79d17a477d00/users/67d2e7db35994c2f8b0c3cf656e80e7d/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:23.090429 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5468e8-9389-4202-a9de-5991e5e38fb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f12494bcdf64d2285ea79d17a477d00, user_id=67d2e7db35994c2f8b0c3cf656e80e7d, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:23.093145 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5468e8-9389-4202-a9de-5991e5e38fb2 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:23.154311 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1290/2582] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:01:23 2022] PUT /identity/v3/projects/9f12494bcdf64d2285ea79d17a477d00/users/67d2e7db35994c2f8b0c3cf656e80e7d/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 09:01:23.158388 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb9fa3-33c7-400f-8293-2db27e794a0e admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:23.168989 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb9fa3-33c7-400f-8293-2db27e794a0e admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:23.231205 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e907400-bb1b-4995-9305-f3e97f4f43ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:23.231913 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e907400-bb1b-4995-9305-f3e97f4f43ac admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:23.232201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e907400-bb1b-4995-9305-f3e97f4f43ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:23.232513 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e907400-bb1b-4995-9305-f3e97f4f43ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:23.233241 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e907400-bb1b-4995-9305-f3e97f4f43ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:23.234891 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e907400-bb1b-4995-9305-f3e97f4f43ac admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:23.247059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1293/2583] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 09:01:23.251218 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5468e8-9389-4202-a9de-5991e5e38fb2 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:23.262230 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5468e8-9389-4202-a9de-5991e5e38fb2 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:23.267066 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcde373-afc7-4b6b-95a9-1cbabc7ee593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:23.268146 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcde373-afc7-4b6b-95a9-1cbabc7ee593 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:23.268429 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcde373-afc7-4b6b-95a9-1cbabc7ee593 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:23.268706 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcde373-afc7-4b6b-95a9-1cbabc7ee593 admin admin] PATH_INFO: `/v3/projects/9f12494bcdf64d2285ea79d17a477d00/users/67d2e7db35994c2f8b0c3cf656e80e7d/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:23.270773 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcde373-afc7-4b6b-95a9-1cbabc7ee593 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f12494bcdf64d2285ea79d17a477d00, user_id=67d2e7db35994c2f8b0c3cf656e80e7d, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:23.276811 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcde373-afc7-4b6b-95a9-1cbabc7ee593 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:23.280776 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e907400-bb1b-4995-9305-f3e97f4f43ac admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:23.283259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-6e907400-bb1b-4995-9305-f3e97f4f43ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:23.285820 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1291/2584] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:01:23 2022] PUT /identity/v3/projects/9f12494bcdf64d2285ea79d17a477d00/users/67d2e7db35994c2f8b0c3cf656e80e7d/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:23.296435 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d7f91-a392-4a61-975c-97f40a9b45f8 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:23.296756 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d7f91-a392-4a61-975c-97f40a9b45f8 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:23.297008 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d7f91-a392-4a61-975c-97f40a9b45f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:23.305244 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e907400-bb1b-4995-9305-f3e97f4f43ac admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:23.328293 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=100 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:23.336226 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-c32d7f91-a392-4a61-975c-97f40a9b45f8 None None] MFA Rules not processed for user `67d2e7db35994c2f8b0c3cf656e80e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:23.337494 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c32d7f91-a392-4a61-975c-97f40a9b45f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:23.375952 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103e871-ea95-4fa9-96b7-691087747c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:23.376829 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103e871-ea95-4fa9-96b7-691087747c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:23.377119 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103e871-ea95-4fa9-96b7-691087747c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:23.377395 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103e871-ea95-4fa9-96b7-691087747c7c admin admin] PATH_INFO: `/v3/projects/5dababcd6d9b41dc8ea98e41acde0b69` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:23.378683 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103e871-ea95-4fa9-96b7-691087747c7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dababcd6d9b41dc8ea98e41acde0b69)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:23.380681 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103e871-ea95-4fa9-96b7-691087747c7c admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:23.420561 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1292/2585] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:01:23.433746 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d7f91-a392-4a61-975c-97f40a9b45f8 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:23.435110 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c32d7f91-a392-4a61-975c-97f40a9b45f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:23.449971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:23.484506 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-3103e871-ea95-4fa9-96b7-691087747c7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dababcd6d9b41dc8ea98e41acde0b69', 'request_id': 'req-3103e871-ea95-4fa9-96b7-691087747c7c'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:23.492189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-3103e871-ea95-4fa9-96b7-691087747c7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dababcd6d9b41dc8ea98e41acde0b69', 'request_id': 'req-3103e871-ea95-4fa9-96b7-691087747c7c'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:23.499753 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-3103e871-ea95-4fa9-96b7-691087747c7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dababcd6d9b41dc8ea98e41acde0b69', 'request_id': 'req-3103e871-ea95-4fa9-96b7-691087747c7c'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:23.501867 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d7f91-a392-4a61-975c-97f40a9b45f8 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:23.557571 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d2f68-21b7-4e59-9d77-bfc390f4115c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:23.558295 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d2f68-21b7-4e59-9d77-bfc390f4115c service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:23.558613 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d2f68-21b7-4e59-9d77-bfc390f4115c service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:23.558889 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d2f68-21b7-4e59-9d77-bfc390f4115c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:23.575975 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-3103e871-ea95-4fa9-96b7-691087747c7c admin admin] The token cache is being invalidate because project 5dababcd6d9b41dc8ea98e41acde0b69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:01:23.576267 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-3103e871-ea95-4fa9-96b7-691087747c7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:23.576916 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-3103e871-ea95-4fa9-96b7-691087747c7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:23.583362 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1294/2586] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:01:23 2022] DELETE /identity/v3/projects/5dababcd6d9b41dc8ea98e41acde0b69 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:23.584901 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880a5b7-b1a9-4ece-8d0c-b52aff42a96e None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:23.585196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880a5b7-b1a9-4ece-8d0c-b52aff42a96e None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:23.585483 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880a5b7-b1a9-4ece-8d0c-b52aff42a96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:23.608556 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-a880a5b7-b1a9-4ece-8d0c-b52aff42a96e None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:23.609812 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-a880a5b7-b1a9-4ece-8d0c-b52aff42a96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:23.630507 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d2f68-21b7-4e59-9d77-bfc390f4115c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:23.632080 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d2f68-21b7-4e59-9d77-bfc390f4115c service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:23.642596 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1293/2587] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:01:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 09:01:23.674278 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d2f68-21b7-4e59-9d77-bfc390f4115c service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:23.680859 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1295/2588] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:01:23.685496 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d2f68-21b7-4e59-9d77-bfc390f4115c service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:23.692552 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fab043-a115-467d-beb7-2580541e9641 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:23.692846 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fab043-a115-467d-beb7-2580541e9641 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:23.693132 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fab043-a115-467d-beb7-2580541e9641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:23.693571 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd8bca-94cb-4bf4-8685-e8f8fc1ccf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:23.694455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd8bca-94cb-4bf4-8685-e8f8fc1ccf95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:23.694737 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd8bca-94cb-4bf4-8685-e8f8fc1ccf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:23.695012 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd8bca-94cb-4bf4-8685-e8f8fc1ccf95 admin admin] PATH_INFO: `/v3/users/2da94f55eab542e9bb586ad13f23db9f` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:23.701823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd8bca-94cb-4bf4-8685-e8f8fc1ccf95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2da94f55eab542e9bb586ad13f23db9f)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:23.703986 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd8bca-94cb-4bf4-8685-e8f8fc1ccf95 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:23.716126 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-30fab043-a115-467d-beb7-2580541e9641 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:23.717376 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-30fab043-a115-467d-beb7-2580541e9641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:23.730334 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1296/2589] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:01:23.734743 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fab043-a115-467d-beb7-2580541e9641 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:23.744486 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fab043-a115-467d-beb7-2580541e9641 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:23.753015 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ace57-d7a7-4a67-addf-648a3e1b9100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:23.753015 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ace57-d7a7-4a67-addf-648a3e1b9100 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:23.753015 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ace57-d7a7-4a67-addf-648a3e1b9100 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:23.753015 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ace57-d7a7-4a67-addf-648a3e1b9100 admin admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:23.753532 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ace57-d7a7-4a67-addf-648a3e1b9100 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:01:23.753532 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ace57-d7a7-4a67-addf-648a3e1b9100 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:23.753532 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ace57-d7a7-4a67-addf-648a3e1b9100 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:23.766256 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1297/2590] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 09:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:01:23.770710 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ace57-d7a7-4a67-addf-648a3e1b9100 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:23.781322 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ace57-d7a7-4a67-addf-648a3e1b9100 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:23.787577 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b56cb7-ffb8-4eca-a707-7c353426d4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:23.788289 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b56cb7-ffb8-4eca-a707-7c353426d4cf admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:23.788573 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b56cb7-ffb8-4eca-a707-7c353426d4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:23.788851 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b56cb7-ffb8-4eca-a707-7c353426d4cf admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:23.789546 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b56cb7-ffb8-4eca-a707-7c353426d4cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:23.791461 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b56cb7-ffb8-4eca-a707-7c353426d4cf admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:23.875098 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1298/2591] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 09:01:23 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:01:23.879965 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b56cb7-ffb8-4eca-a707-7c353426d4cf admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:23.896220 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:23.905206 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-dabd8bca-94cb-4bf4-8685-e8f8fc1ccf95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2da94f55eab542e9bb586ad13f23db9f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:23.905867 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-dabd8bca-94cb-4bf4-8685-e8f8fc1ccf95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2da94f55eab542e9bb586ad13f23db9f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:23.918511 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-dabd8bca-94cb-4bf4-8685-e8f8fc1ccf95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2da94f55eab542e9bb586ad13f23db9f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:23.919335 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-dabd8bca-94cb-4bf4-8685-e8f8fc1ccf95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2da94f55eab542e9bb586ad13f23db9f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:23.951783 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b56cb7-ffb8-4eca-a707-7c353426d4cf admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:23.959142 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab52e69-ce38-4018-a4ca-c285a2c6d9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:23.959869 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab52e69-ce38-4018-a4ca-c285a2c6d9d7 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:23.960152 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab52e69-ce38-4018-a4ca-c285a2c6d9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:23.960428 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab52e69-ce38-4018-a4ca-c285a2c6d9d7 admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:23.961165 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab52e69-ce38-4018-a4ca-c285a2c6d9d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:23.963087 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab52e69-ce38-4018-a4ca-c285a2c6d9d7 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:23.965094 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-dabd8bca-94cb-4bf4-8685-e8f8fc1ccf95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2da94f55eab542e9bb586ad13f23db9f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:23.974194 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:23.986294 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1294/2592] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:01:23 2022] DELETE /identity/v3/users/2da94f55eab542e9bb586ad13f23db9f => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 09:01:23.992465 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a5a4d-c179-4b80-b747-318035f187fe None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:23.992764 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a5a4d-c179-4b80-b747-318035f187fe None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:23.993054 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a5a4d-c179-4b80-b747-318035f187fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:24.014410 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-b93a5a4d-c179-4b80-b747-318035f187fe None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:24.015660 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b93a5a4d-c179-4b80-b747-318035f187fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:24.084073 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1299/2593] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 09:01:23 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:01:24.084284 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1295/2594] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:01:24.085625 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab52e69-ce38-4018-a4ca-c285a2c6d9d7 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:24.087327 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-dab52e69-ce38-4018-a4ca-c285a2c6d9d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:24.092273 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a5a4d-c179-4b80-b747-318035f187fe None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:24.093890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b93a5a4d-c179-4b80-b747-318035f187fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:24.103058 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab52e69-ce38-4018-a4ca-c285a2c6d9d7 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:24.108833 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba4564-87c7-4483-841b-ace8ea2e7f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:24.109704 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba4564-87c7-4483-841b-ace8ea2e7f88 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:24.109974 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba4564-87c7-4483-841b-ace8ea2e7f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:24.110331 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba4564-87c7-4483-841b-ace8ea2e7f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:24.111147 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba4564-87c7-4483-841b-ace8ea2e7f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:24.113032 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba4564-87c7-4483-841b-ace8ea2e7f88 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:24.124310 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1300/2595] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:01:24.128941 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba4564-87c7-4483-841b-ace8ea2e7f88 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:24.142339 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba4564-87c7-4483-841b-ace8ea2e7f88 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:24.149061 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2cc9d-bfe8-45a0-8c83-9b878be541a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:24.149731 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2cc9d-bfe8-45a0-8c83-9b878be541a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:24.150013 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2cc9d-bfe8-45a0-8c83-9b878be541a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:24.150284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2cc9d-bfe8-45a0-8c83-9b878be541a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:24.151011 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2cc9d-bfe8-45a0-8c83-9b878be541a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:24.152696 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2cc9d-bfe8-45a0-8c83-9b878be541a3 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:24.163920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a5a4d-c179-4b80-b747-318035f187fe None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:24.166294 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1301/2596] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:01:24.170499 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f40fd8-06eb-4b22-a907-6cda67e08570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:24.170724 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2cc9d-bfe8-45a0-8c83-9b878be541a3 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:24.171169 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f40fd8-06eb-4b22-a907-6cda67e08570 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:24.171458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f40fd8-06eb-4b22-a907-6cda67e08570 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:24.171802 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f40fd8-06eb-4b22-a907-6cda67e08570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:24.181801 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2cc9d-bfe8-45a0-8c83-9b878be541a3 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:24.182026 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f40fd8-06eb-4b22-a907-6cda67e08570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:24.183463 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f40fd8-06eb-4b22-a907-6cda67e08570 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:24.186495 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f6a99e-7821-43e9-b933-48387c2a75d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:24.187365 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6a99e-7821-43e9-b933-48387c2a75d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:24.187687 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6a99e-7821-43e9-b933-48387c2a75d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:24.187988 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6a99e-7821-43e9-b933-48387c2a75d7 admin admin] PATH_INFO: `/v3/projects/a3d020d514eb42a78878aa3255da9fa8/users/c5a1a156008a43908ad3e3e2ac8445a1/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:24.194425 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1296/2597] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:01:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 09:01:24.205061 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f6a99e-7821-43e9-b933-48387c2a75d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3d020d514eb42a78878aa3255da9fa8, user_id=c5a1a156008a43908ad3e3e2ac8445a1, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:24.208316 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f6a99e-7821-43e9-b933-48387c2a75d7 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:24.292361 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1302/2598] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:01:24 2022] PUT /identity/v3/projects/a3d020d514eb42a78878aa3255da9fa8/users/c5a1a156008a43908ad3e3e2ac8445a1/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 09:01:24.303788 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ea567-de05-4dc1-b4c2-c60cd604f263 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:24.304344 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ea567-de05-4dc1-b4c2-c60cd604f263 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:24.304453 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ea567-de05-4dc1-b4c2-c60cd604f263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:24.336720 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-f83ea567-de05-4dc1-b4c2-c60cd604f263 None None] MFA Rules not processed for user `c5a1a156008a43908ad3e3e2ac8445a1`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:24.337990 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f83ea567-de05-4dc1-b4c2-c60cd604f263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:24.413979 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1297/2599] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:01:24.426270 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f6a99e-7821-43e9-b933-48387c2a75d7 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:24.428119 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-c7f6a99e-7821-43e9-b933-48387c2a75d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:24.489962 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f6a99e-7821-43e9-b933-48387c2a75d7 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:24.493797 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee2ca0-e389-48fc-b2c7-ac6cb248af10 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd75a24363c14e86b0fbbb782b372646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:24.494443 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee2ca0-e389-48fc-b2c7-ac6cb248af10 service glance] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:24.494723 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee2ca0-e389-48fc-b2c7-ac6cb248af10 service glance] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:24.495002 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee2ca0-e389-48fc-b2c7-ac6cb248af10 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:24.507171 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee2ca0-e389-48fc-b2c7-ac6cb248af10 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:24.508714 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee2ca0-e389-48fc-b2c7-ac6cb248af10 service glance] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:24.526838 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1303/2600] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:01:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:01:24.623927 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ea567-de05-4dc1-b4c2-c60cd604f263 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:24.623927 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f83ea567-de05-4dc1-b4c2-c60cd604f263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:24.653522 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:24.708700 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ea567-de05-4dc1-b4c2-c60cd604f263 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:24.714327 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c754a-2dc8-4f49-b436-95082bbaa4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:24.714776 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c754a-2dc8-4f49-b436-95082bbaa4e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:24.715059 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c754a-2dc8-4f49-b436-95082bbaa4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:24.715334 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c754a-2dc8-4f49-b436-95082bbaa4e4 admin admin] PATH_INFO: `/v3/projects/f3c989f47a6846ce8e06d6487183df63` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:24.716564 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c754a-2dc8-4f49-b436-95082bbaa4e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3c989f47a6846ce8e06d6487183df63)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:24.718691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c754a-2dc8-4f49-b436-95082bbaa4e4 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:24.836176 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a16c754a-2dc8-4f49-b436-95082bbaa4e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3c989f47a6846ce8e06d6487183df63', 'request_id': 'req-a16c754a-2dc8-4f49-b436-95082bbaa4e4'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:24.842564 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a16c754a-2dc8-4f49-b436-95082bbaa4e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3c989f47a6846ce8e06d6487183df63', 'request_id': 'req-a16c754a-2dc8-4f49-b436-95082bbaa4e4'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:24.848325 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a16c754a-2dc8-4f49-b436-95082bbaa4e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3c989f47a6846ce8e06d6487183df63', 'request_id': 'req-a16c754a-2dc8-4f49-b436-95082bbaa4e4'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:24.936011 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a16c754a-2dc8-4f49-b436-95082bbaa4e4 admin admin] The token cache is being invalidate because project f3c989f47a6846ce8e06d6487183df63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:01:24.936304 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a16c754a-2dc8-4f49-b436-95082bbaa4e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:24.936985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a16c754a-2dc8-4f49-b436-95082bbaa4e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:24.938576 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1298/2601] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:01:24 2022] DELETE /identity/v3/projects/f3c989f47a6846ce8e06d6487183df63 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:24.943719 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee2ca0-e389-48fc-b2c7-ac6cb248af10 service glance] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:24.954691 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee2ca0-e389-48fc-b2c7-ac6cb248af10 service glance] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:25.013473 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677fcfac-decb-4aed-9032-0a55f308c62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:25.014355 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fcfac-decb-4aed-9032-0a55f308c62d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:25.014641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fcfac-decb-4aed-9032-0a55f308c62d admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:25.014951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fcfac-decb-4aed-9032-0a55f308c62d admin admin] PATH_INFO: `/v3/users/67d2e7db35994c2f8b0c3cf656e80e7d` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:25.016218 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677fcfac-decb-4aed-9032-0a55f308c62d admin admin] RBAC: Authorizing `identity:delete_user(user_id=67d2e7db35994c2f8b0c3cf656e80e7d)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:25.018163 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677fcfac-decb-4aed-9032-0a55f308c62d admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:25.020617 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:25.245713 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-677fcfac-decb-4aed-9032-0a55f308c62d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67d2e7db35994c2f8b0c3cf656e80e7d'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:25.246383 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-677fcfac-decb-4aed-9032-0a55f308c62d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67d2e7db35994c2f8b0c3cf656e80e7d'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:25.247009 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-677fcfac-decb-4aed-9032-0a55f308c62d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67d2e7db35994c2f8b0c3cf656e80e7d'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:25.256279 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-677fcfac-decb-4aed-9032-0a55f308c62d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67d2e7db35994c2f8b0c3cf656e80e7d'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:25.324787 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-677fcfac-decb-4aed-9032-0a55f308c62d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67d2e7db35994c2f8b0c3cf656e80e7d'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:25.350561 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1304/2602] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:01:24 2022] DELETE /identity/v3/users/67d2e7db35994c2f8b0c3cf656e80e7d => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:25.759956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c754a-2dc8-4f49-b436-95082bbaa4e4 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:25.761625 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a16c754a-2dc8-4f49-b436-95082bbaa4e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:25.776179 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c754a-2dc8-4f49-b436-95082bbaa4e4 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:25.850440 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371e85f-f278-42e4-95a5-1e7f263aa2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:25.851343 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371e85f-f278-42e4-95a5-1e7f263aa2b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:25.851665 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371e85f-f278-42e4-95a5-1e7f263aa2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:25.851948 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371e85f-f278-42e4-95a5-1e7f263aa2b2 admin admin] PATH_INFO: `/v3/projects/9f12494bcdf64d2285ea79d17a477d00` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:25.853162 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c371e85f-f278-42e4-95a5-1e7f263aa2b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f12494bcdf64d2285ea79d17a477d00)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:25.855082 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c371e85f-f278-42e4-95a5-1e7f263aa2b2 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:25.983542 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-c371e85f-f278-42e4-95a5-1e7f263aa2b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f12494bcdf64d2285ea79d17a477d00', 'request_id': 'req-c371e85f-f278-42e4-95a5-1e7f263aa2b2'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:25.993590 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-c371e85f-f278-42e4-95a5-1e7f263aa2b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f12494bcdf64d2285ea79d17a477d00', 'request_id': 'req-c371e85f-f278-42e4-95a5-1e7f263aa2b2'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:25.995008 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:26.000095 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-c371e85f-f278-42e4-95a5-1e7f263aa2b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f12494bcdf64d2285ea79d17a477d00', 'request_id': 'req-c371e85f-f278-42e4-95a5-1e7f263aa2b2'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:26.093109 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-c371e85f-f278-42e4-95a5-1e7f263aa2b2 admin admin] The token cache is being invalidate because project 9f12494bcdf64d2285ea79d17a477d00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:01:26.093465 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-c371e85f-f278-42e4-95a5-1e7f263aa2b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:26.094079 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-c371e85f-f278-42e4-95a5-1e7f263aa2b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:26.095752 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1299/2603] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:01:25 2022] DELETE /identity/v3/projects/9f12494bcdf64d2285ea79d17a477d00 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:26.102045 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a8a6c-a778-4cb8-b60d-77d2ad921762 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:26.102553 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a8a6c-a778-4cb8-b60d-77d2ad921762 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:26.102913 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a8a6c-a778-4cb8-b60d-77d2ad921762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:26.124713 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-589a8a6c-a778-4cb8-b60d-77d2ad921762 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:26.125951 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-589a8a6c-a778-4cb8-b60d-77d2ad921762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:26.193353 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1305/2604] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:01:26.201269 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62886b0c-bf55-4e8b-ad7c-19e80bd7828d None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:26.201559 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62886b0c-bf55-4e8b-ad7c-19e80bd7828d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:26.201842 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62886b0c-bf55-4e8b-ad7c-19e80bd7828d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:26.223623 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-62886b0c-bf55-4e8b-ad7c-19e80bd7828d None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:26.224883 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-62886b0c-bf55-4e8b-ad7c-19e80bd7828d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:26.233197 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1300/2605] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:01:26.237537 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a8a6c-a778-4cb8-b60d-77d2ad921762 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:26.248056 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a8a6c-a778-4cb8-b60d-77d2ad921762 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:26.252841 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1cbc8-d09f-4b7d-b710-3ed0ba76373f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:26.254117 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1cbc8-d09f-4b7d-b710-3ed0ba76373f admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:26.254336 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1cbc8-d09f-4b7d-b710-3ed0ba76373f admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:26.254616 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1cbc8-d09f-4b7d-b710-3ed0ba76373f admin admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:26.255352 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1cbc8-d09f-4b7d-b710-3ed0ba76373f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:01:26.255699 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1cbc8-d09f-4b7d-b710-3ed0ba76373f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:26.257323 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1cbc8-d09f-4b7d-b710-3ed0ba76373f admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:26.270638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1306/2606] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 09:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:01:26.275847 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62886b0c-bf55-4e8b-ad7c-19e80bd7828d None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:26.286313 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62886b0c-bf55-4e8b-ad7c-19e80bd7828d None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:26.291135 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87992c6d-2f13-4fec-adc3-9512c0dce05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:26.291879 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87992c6d-2f13-4fec-adc3-9512c0dce05d admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:26.292165 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87992c6d-2f13-4fec-adc3-9512c0dce05d admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:26.292443 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87992c6d-2f13-4fec-adc3-9512c0dce05d admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:26.293140 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87992c6d-2f13-4fec-adc3-9512c0dce05d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:26.295072 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87992c6d-2f13-4fec-adc3-9512c0dce05d admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:26.382997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1301/2607] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 09:01:26 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:01:26.383910 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1cbc8-d09f-4b7d-b710-3ed0ba76373f admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:26.401984 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1cbc8-d09f-4b7d-b710-3ed0ba76373f admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:26.462066 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09112c29-1499-43ea-a09a-dab470584b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:26.462736 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09112c29-1499-43ea-a09a-dab470584b76 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:26.463022 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09112c29-1499-43ea-a09a-dab470584b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:26.463294 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09112c29-1499-43ea-a09a-dab470584b76 admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:26.464014 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09112c29-1499-43ea-a09a-dab470584b76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:26.465941 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09112c29-1499-43ea-a09a-dab470584b76 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:26.477206 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:26.537275 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1307/2608] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 09:01:26 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:01:26.541389 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87992c6d-2f13-4fec-adc3-9512c0dce05d admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:26.552479 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87992c6d-2f13-4fec-adc3-9512c0dce05d admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:26.557376 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec27dcd-6cfd-4d38-98d7-6da320570880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:26.558071 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec27dcd-6cfd-4d38-98d7-6da320570880 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:26.558362 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec27dcd-6cfd-4d38-98d7-6da320570880 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:26.558649 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec27dcd-6cfd-4d38-98d7-6da320570880 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:26.559573 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec27dcd-6cfd-4d38-98d7-6da320570880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:26.561155 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec27dcd-6cfd-4d38-98d7-6da320570880 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:26.572827 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1302/2609] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:01:26.576975 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09112c29-1499-43ea-a09a-dab470584b76 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:26.589041 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09112c29-1499-43ea-a09a-dab470584b76 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:26.594785 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d330f-8c1e-4297-9772-24d5d69cf2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:26.595477 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d330f-8c1e-4297-9772-24d5d69cf2bc admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:26.595801 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d330f-8c1e-4297-9772-24d5d69cf2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:26.596109 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d330f-8c1e-4297-9772-24d5d69cf2bc admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:26.596813 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d330f-8c1e-4297-9772-24d5d69cf2bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:26.599338 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d330f-8c1e-4297-9772-24d5d69cf2bc admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:26.611035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1308/2610] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:01:26.617027 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec27dcd-6cfd-4d38-98d7-6da320570880 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:26.631237 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec27dcd-6cfd-4d38-98d7-6da320570880 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:26.636584 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59b270-ec6b-4e34-a039-066b05feeea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:26.637540 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59b270-ec6b-4e34-a039-066b05feeea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:26.637824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59b270-ec6b-4e34-a039-066b05feeea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:26.638101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59b270-ec6b-4e34-a039-066b05feeea8 admin admin] PATH_INFO: `/v3/projects/e81d70958f9343f78bf1476debe61e8a/users/b3ddde50a06a4895a11c9dbef410b97d/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:26.656186 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e59b270-ec6b-4e34-a039-066b05feeea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e81d70958f9343f78bf1476debe61e8a, user_id=b3ddde50a06a4895a11c9dbef410b97d, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:26.662615 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e59b270-ec6b-4e34-a039-066b05feeea8 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:26.756615 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1303/2611] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:01:26 2022] PUT /identity/v3/projects/e81d70958f9343f78bf1476debe61e8a/users/b3ddde50a06a4895a11c9dbef410b97d/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:26.768098 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d4a6f-851d-45c5-8ca3-cb3b1bbaff9a None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:26.768389 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d4a6f-851d-45c5-8ca3-cb3b1bbaff9a None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:26.768695 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d4a6f-851d-45c5-8ca3-cb3b1bbaff9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:26.805396 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-988d4a6f-851d-45c5-8ca3-cb3b1bbaff9a None None] MFA Rules not processed for user `b3ddde50a06a4895a11c9dbef410b97d`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:26.806569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-988d4a6f-851d-45c5-8ca3-cb3b1bbaff9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:26.879447 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1309/2612] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:01:26.884473 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59b270-ec6b-4e34-a039-066b05feeea8 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:26.955104 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59b270-ec6b-4e34-a039-066b05feeea8 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:26.960790 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59d365-15d1-4fff-9ad5-d2acac7b5e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:26.961466 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59d365-15d1-4fff-9ad5-d2acac7b5e92 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:26.961752 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59d365-15d1-4fff-9ad5-d2acac7b5e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:26.962081 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59d365-15d1-4fff-9ad5-d2acac7b5e92 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:26.962818 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59d365-15d1-4fff-9ad5-d2acac7b5e92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:26.964803 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59d365-15d1-4fff-9ad5-d2acac7b5e92 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:27.041457 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1304/2613] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 09:01:26 2022] POST /identity/v3/projects => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:01:27.045511 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d4a6f-851d-45c5-8ca3-cb3b1bbaff9a None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:27.057751 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d4a6f-851d-45c5-8ca3-cb3b1bbaff9a None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:27.119778 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1cc241-bd5c-4a6a-ba51-02ec715a3ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:27.120455 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cc241-bd5c-4a6a-ba51-02ec715a3ede admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:27.120746 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cc241-bd5c-4a6a-ba51-02ec715a3ede admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:27.121026 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cc241-bd5c-4a6a-ba51-02ec715a3ede admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:27.121752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1cc241-bd5c-4a6a-ba51-02ec715a3ede admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:27.123728 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1cc241-bd5c-4a6a-ba51-02ec715a3ede admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:27.193731 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1310/2614] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 09:01:27 2022] POST /identity/v3/users => generated 297 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:01:27.195185 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59d365-15d1-4fff-9ad5-d2acac7b5e92 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:27.206210 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59d365-15d1-4fff-9ad5-d2acac7b5e92 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:27.211091 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a64b8f-1375-4f62-b147-0b6162cc2b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:27.211792 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a64b8f-1375-4f62-b147-0b6162cc2b3d admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:27.212081 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a64b8f-1375-4f62-b147-0b6162cc2b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:27.212362 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a64b8f-1375-4f62-b147-0b6162cc2b3d admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:27.213146 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a64b8f-1375-4f62-b147-0b6162cc2b3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:27.214760 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a64b8f-1375-4f62-b147-0b6162cc2b3d admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:27.226604 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1305/2615] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:01:27.230812 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1cc241-bd5c-4a6a-ba51-02ec715a3ede admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:27.242046 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1cc241-bd5c-4a6a-ba51-02ec715a3ede admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:27.246887 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1642a7-5b4f-4a98-b57b-acf50fba319c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:27.247826 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1642a7-5b4f-4a98-b57b-acf50fba319c admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:27.248112 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1642a7-5b4f-4a98-b57b-acf50fba319c admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:27.248404 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1642a7-5b4f-4a98-b57b-acf50fba319c admin admin] PATH_INFO: `/v3/projects/4077e0c7c63645f2af50fca481c8264b/users/fee10ab59e2545db806f783c87d961d6/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:27.264738 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1642a7-5b4f-4a98-b57b-acf50fba319c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4077e0c7c63645f2af50fca481c8264b, user_id=fee10ab59e2545db806f783c87d961d6, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:27.267412 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1642a7-5b4f-4a98-b57b-acf50fba319c admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:27.315492 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1311/2616] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:01:27 2022] PUT /identity/v3/projects/4077e0c7c63645f2af50fca481c8264b/users/fee10ab59e2545db806f783c87d961d6/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:27.320117 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a64b8f-1375-4f62-b147-0b6162cc2b3d admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:27.330641 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a64b8f-1375-4f62-b147-0b6162cc2b3d admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:27.387167 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:27.397958 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb9ff2-2c1e-41dc-995b-329d1decd7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:27.399063 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb9ff2-2c1e-41dc-995b-329d1decd7ac admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:27.399271 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb9ff2-2c1e-41dc-995b-329d1decd7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:27.399594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb9ff2-2c1e-41dc-995b-329d1decd7ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:27.400363 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb9ff2-2c1e-41dc-995b-329d1decd7ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:27.401990 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb9ff2-2c1e-41dc-995b-329d1decd7ac admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:27.413055 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1306/2617] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:01:27.417312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1642a7-5b4f-4a98-b57b-acf50fba319c admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:27.429732 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1642a7-5b4f-4a98-b57b-acf50fba319c admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:27.434683 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005ce01-f0be-496f-8c49-09ec4b19d28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:27.435572 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005ce01-f0be-496f-8c49-09ec4b19d28d admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:27.435893 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005ce01-f0be-496f-8c49-09ec4b19d28d admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:27.436174 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005ce01-f0be-496f-8c49-09ec4b19d28d admin admin] PATH_INFO: `/v3/projects/4077e0c7c63645f2af50fca481c8264b/users/fee10ab59e2545db806f783c87d961d6/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:27.439790 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005ce01-f0be-496f-8c49-09ec4b19d28d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4077e0c7c63645f2af50fca481c8264b, user_id=fee10ab59e2545db806f783c87d961d6, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:27.441741 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005ce01-f0be-496f-8c49-09ec4b19d28d admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:27.454554 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1312/2618] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:01:27 2022] PUT /identity/v3/projects/4077e0c7c63645f2af50fca481c8264b/users/fee10ab59e2545db806f783c87d961d6/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:27.466062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6bb543-497c-4f5a-b9d0-4fc647ce39be None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:27.466359 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6bb543-497c-4f5a-b9d0-4fc647ce39be None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:27.466644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6bb543-497c-4f5a-b9d0-4fc647ce39be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:27.499852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-aa6bb543-497c-4f5a-b9d0-4fc647ce39be None None] MFA Rules not processed for user `fee10ab59e2545db806f783c87d961d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:27.501181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-aa6bb543-497c-4f5a-b9d0-4fc647ce39be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:27.584651 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1307/2619] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:01:27.595472 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005ce01-f0be-496f-8c49-09ec4b19d28d admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:27.597288 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-e005ce01-f0be-496f-8c49-09ec4b19d28d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:27.631716 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:27.663890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005ce01-f0be-496f-8c49-09ec4b19d28d admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:27.667823 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ebad5-9374-47a0-a87c-6273f10d9284 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:27.668510 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ebad5-9374-47a0-a87c-6273f10d9284 service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:27.668822 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ebad5-9374-47a0-a87c-6273f10d9284 service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:27.669105 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ebad5-9374-47a0-a87c-6273f10d9284 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:27.679526 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ebad5-9374-47a0-a87c-6273f10d9284 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:27.681043 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ebad5-9374-47a0-a87c-6273f10d9284 service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:27.692642 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1313/2620] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:01:27 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:01:27.805222 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6bb543-497c-4f5a-b9d0-4fc647ce39be None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:27.815637 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6bb543-497c-4f5a-b9d0-4fc647ce39be None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:27.820618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3952c53-7b79-4a13-8422-0a4251e7d0ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:27.821280 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3952c53-7b79-4a13-8422-0a4251e7d0ca service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:27.821568 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3952c53-7b79-4a13-8422-0a4251e7d0ca service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:27.821849 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3952c53-7b79-4a13-8422-0a4251e7d0ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:27.891397 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3952c53-7b79-4a13-8422-0a4251e7d0ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:27.892793 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3952c53-7b79-4a13-8422-0a4251e7d0ca service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:27.905352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1308/2621] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:01:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:01:32.034905 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ebad5-9374-47a0-a87c-6273f10d9284 service cinder] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:32.113537 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ebad5-9374-47a0-a87c-6273f10d9284 service cinder] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:32.119149 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3bf46c-4329-4c0b-970b-5addffcfb7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:32.120063 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bf46c-4329-4c0b-970b-5addffcfb7b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:32.120347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bf46c-4329-4c0b-970b-5addffcfb7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:32.120623 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bf46c-4329-4c0b-970b-5addffcfb7b4 admin admin] PATH_INFO: `/v3/users/b3ddde50a06a4895a11c9dbef410b97d` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:32.121820 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3bf46c-4329-4c0b-970b-5addffcfb7b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3ddde50a06a4895a11c9dbef410b97d)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:32.123810 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3bf46c-4329-4c0b-970b-5addffcfb7b4 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:32.302822 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-ae3bf46c-4329-4c0b-970b-5addffcfb7b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3ddde50a06a4895a11c9dbef410b97d'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:32.303492 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-ae3bf46c-4329-4c0b-970b-5addffcfb7b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3ddde50a06a4895a11c9dbef410b97d'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:32.304133 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-ae3bf46c-4329-4c0b-970b-5addffcfb7b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3ddde50a06a4895a11c9dbef410b97d'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:32.311517 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-ae3bf46c-4329-4c0b-970b-5addffcfb7b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3ddde50a06a4895a11c9dbef410b97d'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:32.376298 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-ae3bf46c-4329-4c0b-970b-5addffcfb7b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3ddde50a06a4895a11c9dbef410b97d'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:32.398203 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1314/2622] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:01:32 2022] DELETE /identity/v3/users/b3ddde50a06a4895a11c9dbef410b97d => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:32.403835 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7f3e4-54a2-42ab-a6e7-a8094f4f7211 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:32.404455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7f3e4-54a2-42ab-a6e7-a8094f4f7211 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:32.404455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7f3e4-54a2-42ab-a6e7-a8094f4f7211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:32.425709 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-4bd7f3e4-54a2-42ab-a6e7-a8094f4f7211 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:32.427518 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4bd7f3e4-54a2-42ab-a6e7-a8094f4f7211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:32.495919 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1309/2623] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:01:32.509402 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3bf46c-4329-4c0b-970b-5addffcfb7b4 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:32.510863 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-ae3bf46c-4329-4c0b-970b-5addffcfb7b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:32.572343 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:32.575861 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3bf46c-4329-4c0b-970b-5addffcfb7b4 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:32.580393 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fdcef-fcaf-4b9c-a168-338121fa6f33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:32.581047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fdcef-fcaf-4b9c-a168-338121fa6f33 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:32.581354 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fdcef-fcaf-4b9c-a168-338121fa6f33 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:32.581664 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fdcef-fcaf-4b9c-a168-338121fa6f33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:32.592783 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fdcef-fcaf-4b9c-a168-338121fa6f33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:32.594255 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fdcef-fcaf-4b9c-a168-338121fa6f33 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:32.605479 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1315/2624] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:01:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:01:33.052962 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7f3e4-54a2-42ab-a6e7-a8094f4f7211 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:33.054465 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4bd7f3e4-54a2-42ab-a6e7-a8094f4f7211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:33.074323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7f3e4-54a2-42ab-a6e7-a8094f4f7211 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:33.088445 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4001a-9c06-4a63-b3ed-50fadec4bdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:33.089334 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4001a-9c06-4a63-b3ed-50fadec4bdc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:33.089619 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4001a-9c06-4a63-b3ed-50fadec4bdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:33.089903 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4001a-9c06-4a63-b3ed-50fadec4bdc6 admin admin] PATH_INFO: `/v3/projects/e81d70958f9343f78bf1476debe61e8a` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:33.091100 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4001a-9c06-4a63-b3ed-50fadec4bdc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e81d70958f9343f78bf1476debe61e8a)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:33.093117 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4001a-9c06-4a63-b3ed-50fadec4bdc6 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:33.101875 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:33.217734 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-54d4001a-9c06-4a63-b3ed-50fadec4bdc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e81d70958f9343f78bf1476debe61e8a', 'request_id': 'req-54d4001a-9c06-4a63-b3ed-50fadec4bdc6'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:33.224795 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-54d4001a-9c06-4a63-b3ed-50fadec4bdc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e81d70958f9343f78bf1476debe61e8a', 'request_id': 'req-54d4001a-9c06-4a63-b3ed-50fadec4bdc6'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:33.230833 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-54d4001a-9c06-4a63-b3ed-50fadec4bdc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e81d70958f9343f78bf1476debe61e8a', 'request_id': 'req-54d4001a-9c06-4a63-b3ed-50fadec4bdc6'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:33.307458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-54d4001a-9c06-4a63-b3ed-50fadec4bdc6 admin admin] The token cache is being invalidate because project e81d70958f9343f78bf1476debe61e8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:01:33.307835 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-54d4001a-9c06-4a63-b3ed-50fadec4bdc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:33.308445 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-54d4001a-9c06-4a63-b3ed-50fadec4bdc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:33.310082 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1310/2625] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:01:33 2022] DELETE /identity/v3/projects/e81d70958f9343f78bf1476debe61e8a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:33.314315 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fdcef-fcaf-4b9c-a168-338121fa6f33 service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:33.324234 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fdcef-fcaf-4b9c-a168-338121fa6f33 service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:33.387675 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67919616-2b69-4cab-8dba-116e8ff876c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:33.388474 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67919616-2b69-4cab-8dba-116e8ff876c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:33.388760 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67919616-2b69-4cab-8dba-116e8ff876c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:33.389039 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67919616-2b69-4cab-8dba-116e8ff876c7 admin admin] PATH_INFO: `/v3/users/fee10ab59e2545db806f783c87d961d6` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:33.390243 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67919616-2b69-4cab-8dba-116e8ff876c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fee10ab59e2545db806f783c87d961d6)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:33.392228 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67919616-2b69-4cab-8dba-116e8ff876c7 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:33.545280 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-67919616-2b69-4cab-8dba-116e8ff876c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fee10ab59e2545db806f783c87d961d6'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:33.545975 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-67919616-2b69-4cab-8dba-116e8ff876c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fee10ab59e2545db806f783c87d961d6'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:33.546565 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-67919616-2b69-4cab-8dba-116e8ff876c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fee10ab59e2545db806f783c87d961d6'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:33.554272 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-67919616-2b69-4cab-8dba-116e8ff876c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fee10ab59e2545db806f783c87d961d6'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:33.644991 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-67919616-2b69-4cab-8dba-116e8ff876c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fee10ab59e2545db806f783c87d961d6'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:33.667558 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1316/2626] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:01:33 2022] DELETE /identity/v3/users/fee10ab59e2545db806f783c87d961d6 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 09:01:34.155878 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4001a-9c06-4a63-b3ed-50fadec4bdc6 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:34.157396 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-54d4001a-9c06-4a63-b3ed-50fadec4bdc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:34.171923 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4001a-9c06-4a63-b3ed-50fadec4bdc6 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:34.233207 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c45832-bed9-4c40-acd2-bcd7971a2f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:34.234085 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c45832-bed9-4c40-acd2-bcd7971a2f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:34.234373 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c45832-bed9-4c40-acd2-bcd7971a2f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:34.234655 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c45832-bed9-4c40-acd2-bcd7971a2f7e admin admin] PATH_INFO: `/v3/projects/4077e0c7c63645f2af50fca481c8264b` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:34.235904 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c45832-bed9-4c40-acd2-bcd7971a2f7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4077e0c7c63645f2af50fca481c8264b)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:34.237899 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c45832-bed9-4c40-acd2-bcd7971a2f7e admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:34.354224 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b1c45832-bed9-4c40-acd2-bcd7971a2f7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4077e0c7c63645f2af50fca481c8264b', 'request_id': 'req-b1c45832-bed9-4c40-acd2-bcd7971a2f7e'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:34.361406 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b1c45832-bed9-4c40-acd2-bcd7971a2f7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4077e0c7c63645f2af50fca481c8264b', 'request_id': 'req-b1c45832-bed9-4c40-acd2-bcd7971a2f7e'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:34.367554 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b1c45832-bed9-4c40-acd2-bcd7971a2f7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4077e0c7c63645f2af50fca481c8264b', 'request_id': 'req-b1c45832-bed9-4c40-acd2-bcd7971a2f7e'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:34.439109 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b1c45832-bed9-4c40-acd2-bcd7971a2f7e admin admin] The token cache is being invalidate because project 4077e0c7c63645f2af50fca481c8264b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:01:34.439341 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b1c45832-bed9-4c40-acd2-bcd7971a2f7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:34.440066 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b1c45832-bed9-4c40-acd2-bcd7971a2f7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:34.441674 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1311/2627] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:01:34 2022] DELETE /identity/v3/projects/4077e0c7c63645f2af50fca481c8264b => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:34.453145 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefcf5d-2486-4005-bed3-a25d64f40ed1 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:34.453145 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefcf5d-2486-4005-bed3-a25d64f40ed1 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:34.453145 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefcf5d-2486-4005-bed3-a25d64f40ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:34.469629 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-9aefcf5d-2486-4005-bed3-a25d64f40ed1 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:34.470859 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-9aefcf5d-2486-4005-bed3-a25d64f40ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:34.538756 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1317/2628] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:01:34.554058 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341daa2-85d2-431a-bb34-f04eed1d4f23 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:34.556102 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341daa2-85d2-431a-bb34-f04eed1d4f23 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:34.556102 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341daa2-85d2-431a-bb34-f04eed1d4f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:34.575855 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-e341daa2-85d2-431a-bb34-f04eed1d4f23 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:34.577094 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-e341daa2-85d2-431a-bb34-f04eed1d4f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:34.586419 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1312/2629] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:01:34.593272 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefcf5d-2486-4005-bed3-a25d64f40ed1 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:34.605083 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefcf5d-2486-4005-bed3-a25d64f40ed1 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:34.614678 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4213cf0-8c93-4a1c-a927-2f7dc0b6adde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:34.615691 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4213cf0-8c93-4a1c-a927-2f7dc0b6adde admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:34.615927 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4213cf0-8c93-4a1c-a927-2f7dc0b6adde admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:34.616340 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4213cf0-8c93-4a1c-a927-2f7dc0b6adde admin admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:34.616990 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4213cf0-8c93-4a1c-a927-2f7dc0b6adde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:01:34.617272 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4213cf0-8c93-4a1c-a927-2f7dc0b6adde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:34.618895 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4213cf0-8c93-4a1c-a927-2f7dc0b6adde admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:34.626654 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:34.635528 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1318/2630] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 09:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:01:34.638232 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341daa2-85d2-431a-bb34-f04eed1d4f23 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:34.649081 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341daa2-85d2-431a-bb34-f04eed1d4f23 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:34.653772 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a99142-45a2-46f3-aff9-396b485a2f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:34.654422 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a99142-45a2-46f3-aff9-396b485a2f68 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:34.654706 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a99142-45a2-46f3-aff9-396b485a2f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:34.654982 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a99142-45a2-46f3-aff9-396b485a2f68 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:34.655699 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a99142-45a2-46f3-aff9-396b485a2f68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:34.657585 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a99142-45a2-46f3-aff9-396b485a2f68 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:34.736689 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:34.744744 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1313/2631] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 09:01:34 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:01:34.749552 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4213cf0-8c93-4a1c-a927-2f7dc0b6adde admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:34.760473 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4213cf0-8c93-4a1c-a927-2f7dc0b6adde admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:34.828037 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31c118-3bee-4c3a-9915-5e1ec684d177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:34.828709 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31c118-3bee-4c3a-9915-5e1ec684d177 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:34.828999 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31c118-3bee-4c3a-9915-5e1ec684d177 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:34.829264 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31c118-3bee-4c3a-9915-5e1ec684d177 admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:34.830045 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31c118-3bee-4c3a-9915-5e1ec684d177 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:34.832046 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31c118-3bee-4c3a-9915-5e1ec684d177 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:34.909623 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1319/2632] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 09:01:34 2022] POST /identity/v3/users => generated 291 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:01:34.913802 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a99142-45a2-46f3-aff9-396b485a2f68 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:34.926772 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a99142-45a2-46f3-aff9-396b485a2f68 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:34.932525 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f7b53-68f2-4957-934c-90a437936614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:34.936117 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f7b53-68f2-4957-934c-90a437936614 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:34.936117 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f7b53-68f2-4957-934c-90a437936614 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:34.936117 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f7b53-68f2-4957-934c-90a437936614 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:34.936117 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f7b53-68f2-4957-934c-90a437936614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:34.936117 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f7b53-68f2-4957-934c-90a437936614 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:34.949192 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1314/2633] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:01:34.954029 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31c118-3bee-4c3a-9915-5e1ec684d177 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:34.965756 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31c118-3bee-4c3a-9915-5e1ec684d177 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:34.970806 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b7748-b547-48c9-ba59-f4b4072ed2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:34.971500 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b7748-b547-48c9-ba59-f4b4072ed2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:34.971830 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b7748-b547-48c9-ba59-f4b4072ed2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:34.972111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b7748-b547-48c9-ba59-f4b4072ed2b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:34.972858 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b7748-b547-48c9-ba59-f4b4072ed2b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:34.974674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b7748-b547-48c9-ba59-f4b4072ed2b1 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:34.985411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1320/2634] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:01:34.992049 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f7b53-68f2-4957-934c-90a437936614 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:35.002420 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f7b53-68f2-4957-934c-90a437936614 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:35.010216 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf8b68-cb98-4d21-afa4-d1195fc84f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:35.011167 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf8b68-cb98-4d21-afa4-d1195fc84f76 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:35.011447 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf8b68-cb98-4d21-afa4-d1195fc84f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:35.011752 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf8b68-cb98-4d21-afa4-d1195fc84f76 admin admin] PATH_INFO: `/v3/projects/5515e1ff2e774d7185c309f6b650587a/users/586ed8edf8b646bea22d6769aae9be92/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:35.028607 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf8b68-cb98-4d21-afa4-d1195fc84f76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5515e1ff2e774d7185c309f6b650587a, user_id=586ed8edf8b646bea22d6769aae9be92, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:35.032288 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf8b68-cb98-4d21-afa4-d1195fc84f76 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:35.082214 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1315/2635] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:01:34 2022] PUT /identity/v3/projects/5515e1ff2e774d7185c309f6b650587a/users/586ed8edf8b646bea22d6769aae9be92/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:35.093998 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904aef0-8dfe-4461-9cd5-eccee411cecd None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:35.094286 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904aef0-8dfe-4461-9cd5-eccee411cecd None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:35.094565 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904aef0-8dfe-4461-9cd5-eccee411cecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:35.128285 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-6904aef0-8dfe-4461-9cd5-eccee411cecd None None] MFA Rules not processed for user `586ed8edf8b646bea22d6769aae9be92`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:35.129665 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-6904aef0-8dfe-4461-9cd5-eccee411cecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:35.206814 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1321/2636] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:01:35.212172 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf8b68-cb98-4d21-afa4-d1195fc84f76 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:35.280616 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf8b68-cb98-4d21-afa4-d1195fc84f76 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:35.285466 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae66209-a683-4906-b467-517866e98ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:35.286875 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae66209-a683-4906-b467-517866e98ddc admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:35.287362 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae66209-a683-4906-b467-517866e98ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:35.287667 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae66209-a683-4906-b467-517866e98ddc admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:35.288399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae66209-a683-4906-b467-517866e98ddc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:35.290445 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae66209-a683-4906-b467-517866e98ddc admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:35.395766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1316/2637] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 09:01:35 2022] POST /identity/v3/projects => generated 381 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:01:35.400946 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904aef0-8dfe-4461-9cd5-eccee411cecd None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:35.412776 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904aef0-8dfe-4461-9cd5-eccee411cecd None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:35.475665 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588eaa7-c0d6-4e72-9979-4101f85635a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:35.476449 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588eaa7-c0d6-4e72-9979-4101f85635a6 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:35.476635 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588eaa7-c0d6-4e72-9979-4101f85635a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:35.476913 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588eaa7-c0d6-4e72-9979-4101f85635a6 admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:35.477670 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f588eaa7-c0d6-4e72-9979-4101f85635a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:35.479724 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f588eaa7-c0d6-4e72-9979-4101f85635a6 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:35.493008 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:35.560991 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1322/2638] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 09:01:35 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:01:35.564650 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae66209-a683-4906-b467-517866e98ddc admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:35.577175 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae66209-a683-4906-b467-517866e98ddc admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:35.581904 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10bccb-a663-4d4e-a608-d7805141ab41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:35.583700 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10bccb-a663-4d4e-a608-d7805141ab41 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:35.584014 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10bccb-a663-4d4e-a608-d7805141ab41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:35.584300 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10bccb-a663-4d4e-a608-d7805141ab41 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:35.585037 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10bccb-a663-4d4e-a608-d7805141ab41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:35.586690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10bccb-a663-4d4e-a608-d7805141ab41 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:35.601527 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1317/2639] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:01:35.605874 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588eaa7-c0d6-4e72-9979-4101f85635a6 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:35.616895 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588eaa7-c0d6-4e72-9979-4101f85635a6 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:35.622725 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee5294-7881-42b4-afa1-7625034d0f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:35.623675 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee5294-7881-42b4-afa1-7625034d0f4a admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:35.623967 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee5294-7881-42b4-afa1-7625034d0f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:35.624254 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee5294-7881-42b4-afa1-7625034d0f4a admin admin] PATH_INFO: `/v3/projects/05fa987eca954ffc8bb3e59bbf70c8e0/users/51d6dc40412c4d97844bed0d07db9c73/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:35.641200 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee5294-7881-42b4-afa1-7625034d0f4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=05fa987eca954ffc8bb3e59bbf70c8e0, user_id=51d6dc40412c4d97844bed0d07db9c73, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:35.644089 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee5294-7881-42b4-afa1-7625034d0f4a admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:35.714765 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1323/2640] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:01:35 2022] PUT /identity/v3/projects/05fa987eca954ffc8bb3e59bbf70c8e0/users/51d6dc40412c4d97844bed0d07db9c73/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:35.720232 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10bccb-a663-4d4e-a608-d7805141ab41 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:35.732369 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10bccb-a663-4d4e-a608-d7805141ab41 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:35.795956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110295d-7c21-4cbd-8d96-76002927a634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:35.796650 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110295d-7c21-4cbd-8d96-76002927a634 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:35.796966 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110295d-7c21-4cbd-8d96-76002927a634 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:35.797250 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110295d-7c21-4cbd-8d96-76002927a634 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:35.798005 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110295d-7c21-4cbd-8d96-76002927a634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:35.799641 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110295d-7c21-4cbd-8d96-76002927a634 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:35.811276 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1318/2641] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:01:35.815461 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee5294-7881-42b4-afa1-7625034d0f4a admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:35.828085 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee5294-7881-42b4-afa1-7625034d0f4a admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:35.833373 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732292e-d641-47ab-8a8c-ecb7812a3a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:35.836376 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732292e-d641-47ab-8a8c-ecb7812a3a4c admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:35.836376 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732292e-d641-47ab-8a8c-ecb7812a3a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:35.836376 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732292e-d641-47ab-8a8c-ecb7812a3a4c admin admin] PATH_INFO: `/v3/projects/05fa987eca954ffc8bb3e59bbf70c8e0/users/51d6dc40412c4d97844bed0d07db9c73/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:35.836981 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732292e-d641-47ab-8a8c-ecb7812a3a4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=05fa987eca954ffc8bb3e59bbf70c8e0, user_id=51d6dc40412c4d97844bed0d07db9c73, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:35.839772 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732292e-d641-47ab-8a8c-ecb7812a3a4c admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:35.851722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1324/2642] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:01:35 2022] PUT /identity/v3/projects/05fa987eca954ffc8bb3e59bbf70c8e0/users/51d6dc40412c4d97844bed0d07db9c73/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:35.862587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d6438-4c18-44f2-8a6e-76912eb8491c None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:35.862880 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d6438-4c18-44f2-8a6e-76912eb8491c None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:35.863164 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d6438-4c18-44f2-8a6e-76912eb8491c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:35.894487 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-d89d6438-4c18-44f2-8a6e-76912eb8491c None None] MFA Rules not processed for user `51d6dc40412c4d97844bed0d07db9c73`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:35.895781 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d89d6438-4c18-44f2-8a6e-76912eb8491c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:35.919484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:35.972337 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1319/2643] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:01:35.984482 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732292e-d641-47ab-8a8c-ecb7812a3a4c admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:35.986266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-0732292e-d641-47ab-8a8c-ecb7812a3a4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:36.052287 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732292e-d641-47ab-8a8c-ecb7812a3a4c admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:36.056776 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886e433-211e-4633-baed-c858d4138278 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:36.057435 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886e433-211e-4633-baed-c858d4138278 service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:36.057715 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886e433-211e-4633-baed-c858d4138278 service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:36.057990 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886e433-211e-4633-baed-c858d4138278 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:36.068327 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886e433-211e-4633-baed-c858d4138278 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:36.070301 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886e433-211e-4633-baed-c858d4138278 service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:36.080641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1325/2644] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:01:35 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:01:36.272100 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d6438-4c18-44f2-8a6e-76912eb8491c None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:36.282130 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d6438-4c18-44f2-8a6e-76912eb8491c None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:36.285748 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96df03-f3ae-4b48-8d87-414ee7c2a987 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:36.286394 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96df03-f3ae-4b48-8d87-414ee7c2a987 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:36.286683 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96df03-f3ae-4b48-8d87-414ee7c2a987 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:36.286956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96df03-f3ae-4b48-8d87-414ee7c2a987 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:36.354157 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96df03-f3ae-4b48-8d87-414ee7c2a987 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:36.355649 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96df03-f3ae-4b48-8d87-414ee7c2a987 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:36.365635 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1320/2645] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:01:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:01:36.882604 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886e433-211e-4633-baed-c858d4138278 service cinder] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:36.953693 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886e433-211e-4633-baed-c858d4138278 service cinder] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:36.959173 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c810ce0-cd28-4ef7-9425-882f3af9604b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:36.960811 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c810ce0-cd28-4ef7-9425-882f3af9604b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:36.961189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c810ce0-cd28-4ef7-9425-882f3af9604b admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:36.961570 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c810ce0-cd28-4ef7-9425-882f3af9604b admin admin] PATH_INFO: `/v3/users/586ed8edf8b646bea22d6769aae9be92` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:36.962937 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c810ce0-cd28-4ef7-9425-882f3af9604b admin admin] RBAC: Authorizing `identity:delete_user(user_id=586ed8edf8b646bea22d6769aae9be92)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:36.965048 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c810ce0-cd28-4ef7-9425-882f3af9604b admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:37.127859 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-7c810ce0-cd28-4ef7-9425-882f3af9604b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '586ed8edf8b646bea22d6769aae9be92'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:37.128454 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-7c810ce0-cd28-4ef7-9425-882f3af9604b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '586ed8edf8b646bea22d6769aae9be92'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:37.129155 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-7c810ce0-cd28-4ef7-9425-882f3af9604b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '586ed8edf8b646bea22d6769aae9be92'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:37.137053 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-7c810ce0-cd28-4ef7-9425-882f3af9604b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '586ed8edf8b646bea22d6769aae9be92'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:37.205023 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-7c810ce0-cd28-4ef7-9425-882f3af9604b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '586ed8edf8b646bea22d6769aae9be92'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:37.206451 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:37.229351 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1326/2646] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:01:36 2022] DELETE /identity/v3/users/586ed8edf8b646bea22d6769aae9be92 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:37.234014 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dbe10-42e0-4ec3-bd25-157e66144454 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:37.234604 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dbe10-42e0-4ec3-bd25-157e66144454 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:37.234604 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dbe10-42e0-4ec3-bd25-157e66144454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:37.256492 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-0b3dbe10-42e0-4ec3-bd25-157e66144454 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:37.258076 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0b3dbe10-42e0-4ec3-bd25-157e66144454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:37.320580 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1321/2647] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:01:37.330978 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c810ce0-cd28-4ef7-9425-882f3af9604b admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:37.332575 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-7c810ce0-cd28-4ef7-9425-882f3af9604b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:37.394318 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c810ce0-cd28-4ef7-9425-882f3af9604b admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:37.399373 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060693a-61e4-4d2f-ae50-d577f75e6737 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:37.401002 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060693a-61e4-4d2f-ae50-d577f75e6737 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:37.401002 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060693a-61e4-4d2f-ae50-d577f75e6737 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:37.401002 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060693a-61e4-4d2f-ae50-d577f75e6737 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:37.410690 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060693a-61e4-4d2f-ae50-d577f75e6737 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:37.412184 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060693a-61e4-4d2f-ae50-d577f75e6737 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:37.421993 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1327/2648] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:01:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:01:37.812448 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3dbe10-42e0-4ec3-bd25-157e66144454 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:37.814136 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0b3dbe10-42e0-4ec3-bd25-157e66144454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:37.826809 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3dbe10-42e0-4ec3-bd25-157e66144454 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:37.831934 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f4b7b-e44f-49f0-95da-b5009854a880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:37.832735 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f4b7b-e44f-49f0-95da-b5009854a880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:37.833026 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f4b7b-e44f-49f0-95da-b5009854a880 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:37.833308 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f4b7b-e44f-49f0-95da-b5009854a880 admin admin] PATH_INFO: `/v3/projects/5515e1ff2e774d7185c309f6b650587a` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:37.834547 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f4b7b-e44f-49f0-95da-b5009854a880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5515e1ff2e774d7185c309f6b650587a)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:37.837109 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f4b7b-e44f-49f0-95da-b5009854a880 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:37.973979 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a65f4b7b-e44f-49f0-95da-b5009854a880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5515e1ff2e774d7185c309f6b650587a', 'request_id': 'req-a65f4b7b-e44f-49f0-95da-b5009854a880'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:37.976594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:37.981540 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a65f4b7b-e44f-49f0-95da-b5009854a880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5515e1ff2e774d7185c309f6b650587a', 'request_id': 'req-a65f4b7b-e44f-49f0-95da-b5009854a880'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:37.987185 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a65f4b7b-e44f-49f0-95da-b5009854a880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5515e1ff2e774d7185c309f6b650587a', 'request_id': 'req-a65f4b7b-e44f-49f0-95da-b5009854a880'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:38.057347 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a65f4b7b-e44f-49f0-95da-b5009854a880 admin admin] The token cache is being invalidate because project 5515e1ff2e774d7185c309f6b650587a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:01:38.057643 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a65f4b7b-e44f-49f0-95da-b5009854a880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:38.058294 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a65f4b7b-e44f-49f0-95da-b5009854a880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:38.062411 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1322/2649] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:01:37 2022] DELETE /identity/v3/projects/5515e1ff2e774d7185c309f6b650587a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:38.065157 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060693a-61e4-4d2f-ae50-d577f75e6737 service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:38.075658 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060693a-61e4-4d2f-ae50-d577f75e6737 service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:38.138577 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f3aa6-7c22-4eb3-a4b3-ccf71fc8e054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:38.139442 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f3aa6-7c22-4eb3-a4b3-ccf71fc8e054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:38.139756 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f3aa6-7c22-4eb3-a4b3-ccf71fc8e054 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:38.140031 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f3aa6-7c22-4eb3-a4b3-ccf71fc8e054 admin admin] PATH_INFO: `/v3/users/51d6dc40412c4d97844bed0d07db9c73` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:38.141224 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f3aa6-7c22-4eb3-a4b3-ccf71fc8e054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51d6dc40412c4d97844bed0d07db9c73)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:38.143171 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f3aa6-7c22-4eb3-a4b3-ccf71fc8e054 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:38.347517 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-787f3aa6-7c22-4eb3-a4b3-ccf71fc8e054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51d6dc40412c4d97844bed0d07db9c73'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:38.348217 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-787f3aa6-7c22-4eb3-a4b3-ccf71fc8e054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51d6dc40412c4d97844bed0d07db9c73'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:38.348852 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-787f3aa6-7c22-4eb3-a4b3-ccf71fc8e054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51d6dc40412c4d97844bed0d07db9c73'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:38.358551 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-787f3aa6-7c22-4eb3-a4b3-ccf71fc8e054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51d6dc40412c4d97844bed0d07db9c73'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:38.455916 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-787f3aa6-7c22-4eb3-a4b3-ccf71fc8e054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51d6dc40412c4d97844bed0d07db9c73'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:38.474814 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1328/2650] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:01:38 2022] DELETE /identity/v3/users/51d6dc40412c4d97844bed0d07db9c73 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:38.909943 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f4b7b-e44f-49f0-95da-b5009854a880 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:38.911452 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a65f4b7b-e44f-49f0-95da-b5009854a880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:38.926503 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f4b7b-e44f-49f0-95da-b5009854a880 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:38.989160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb0e7c-2a62-46ab-b16f-2cea04f95b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:38.990036 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb0e7c-2a62-46ab-b16f-2cea04f95b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:38.990314 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb0e7c-2a62-46ab-b16f-2cea04f95b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:38.990589 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb0e7c-2a62-46ab-b16f-2cea04f95b97 admin admin] PATH_INFO: `/v3/projects/05fa987eca954ffc8bb3e59bbf70c8e0` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:38.991822 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb0e7c-2a62-46ab-b16f-2cea04f95b97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05fa987eca954ffc8bb3e59bbf70c8e0)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:38.994714 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb0e7c-2a62-46ab-b16f-2cea04f95b97 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:39.154997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4dbb0e7c-2a62-46ab-b16f-2cea04f95b97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05fa987eca954ffc8bb3e59bbf70c8e0', 'request_id': 'req-4dbb0e7c-2a62-46ab-b16f-2cea04f95b97'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:39.161156 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4dbb0e7c-2a62-46ab-b16f-2cea04f95b97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05fa987eca954ffc8bb3e59bbf70c8e0', 'request_id': 'req-4dbb0e7c-2a62-46ab-b16f-2cea04f95b97'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:39.167954 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4dbb0e7c-2a62-46ab-b16f-2cea04f95b97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05fa987eca954ffc8bb3e59bbf70c8e0', 'request_id': 'req-4dbb0e7c-2a62-46ab-b16f-2cea04f95b97'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:39.251294 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4dbb0e7c-2a62-46ab-b16f-2cea04f95b97 admin admin] The token cache is being invalidate because project 05fa987eca954ffc8bb3e59bbf70c8e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:01:39.251690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4dbb0e7c-2a62-46ab-b16f-2cea04f95b97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:39.252251 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4dbb0e7c-2a62-46ab-b16f-2cea04f95b97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:39.253842 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1323/2651] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:01:38 2022] DELETE /identity/v3/projects/05fa987eca954ffc8bb3e59bbf70c8e0 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:39.259634 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aaa2ec-8687-404f-9f0a-ca206f6b56af None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:39.260126 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aaa2ec-8687-404f-9f0a-ca206f6b56af None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:39.260242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aaa2ec-8687-404f-9f0a-ca206f6b56af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:39.268253 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:39.281231 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-45aaa2ec-8687-404f-9f0a-ca206f6b56af None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:39.282475 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-45aaa2ec-8687-404f-9f0a-ca206f6b56af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:39.344801 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1329/2652] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:01:39.352881 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab81ec-8fbd-48a7-9fce-6ec6af925a97 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:39.353174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab81ec-8fbd-48a7-9fce-6ec6af925a97 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:39.353462 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab81ec-8fbd-48a7-9fce-6ec6af925a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:39.374337 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-2bab81ec-8fbd-48a7-9fce-6ec6af925a97 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:39.375556 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-2bab81ec-8fbd-48a7-9fce-6ec6af925a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:39.384542 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1324/2653] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:01:39.388825 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aaa2ec-8687-404f-9f0a-ca206f6b56af None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:39.400337 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aaa2ec-8687-404f-9f0a-ca206f6b56af None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:39.406984 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420044f-533f-4ca8-b730-3fcae805784d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:39.408028 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420044f-533f-4ca8-b730-3fcae805784d admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:39.408488 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420044f-533f-4ca8-b730-3fcae805784d admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:39.408943 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420044f-533f-4ca8-b730-3fcae805784d admin admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:39.410189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420044f-533f-4ca8-b730-3fcae805784d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:01:39.410687 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420044f-533f-4ca8-b730-3fcae805784d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:39.413264 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420044f-533f-4ca8-b730-3fcae805784d admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:39.426281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1330/2654] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 09:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:01:39.432234 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab81ec-8fbd-48a7-9fce-6ec6af925a97 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:39.441596 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab81ec-8fbd-48a7-9fce-6ec6af925a97 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:39.446773 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff7451-2e8e-49bb-88d3-83f418123597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:39.447428 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff7451-2e8e-49bb-88d3-83f418123597 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:39.447752 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff7451-2e8e-49bb-88d3-83f418123597 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:39.448057 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff7451-2e8e-49bb-88d3-83f418123597 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:39.448774 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff7451-2e8e-49bb-88d3-83f418123597 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:39.450724 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff7451-2e8e-49bb-88d3-83f418123597 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:39.566435 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1325/2655] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 09:01:39 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:01:39.572899 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420044f-533f-4ca8-b730-3fcae805784d admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:39.583511 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420044f-533f-4ca8-b730-3fcae805784d admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:39.643151 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4acd1e-6272-4d24-a89b-1f833c2e0f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:39.644000 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4acd1e-6272-4d24-a89b-1f833c2e0f86 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:39.644355 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4acd1e-6272-4d24-a89b-1f833c2e0f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:39.644630 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4acd1e-6272-4d24-a89b-1f833c2e0f86 admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:39.645322 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4acd1e-6272-4d24-a89b-1f833c2e0f86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:39.649316 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4acd1e-6272-4d24-a89b-1f833c2e0f86 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:39.708136 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1331/2656] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 09:01:39 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:01:39.712749 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff7451-2e8e-49bb-88d3-83f418123597 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:39.723310 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff7451-2e8e-49bb-88d3-83f418123597 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:39.728980 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d3b5c-a129-4c4f-94c0-0456935b2818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:39.729649 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d3b5c-a129-4c4f-94c0-0456935b2818 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:39.729933 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d3b5c-a129-4c4f-94c0-0456935b2818 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:39.730211 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d3b5c-a129-4c4f-94c0-0456935b2818 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:39.730940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d3b5c-a129-4c4f-94c0-0456935b2818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:39.732553 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d3b5c-a129-4c4f-94c0-0456935b2818 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:39.746831 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1326/2657] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:01:39.751074 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4acd1e-6272-4d24-a89b-1f833c2e0f86 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:39.762132 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4acd1e-6272-4d24-a89b-1f833c2e0f86 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:39.766883 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21d9aa-f4a4-43b2-a09e-aa11be3d17d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:39.767563 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21d9aa-f4a4-43b2-a09e-aa11be3d17d9 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:39.767886 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21d9aa-f4a4-43b2-a09e-aa11be3d17d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:39.768170 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21d9aa-f4a4-43b2-a09e-aa11be3d17d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:39.768941 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21d9aa-f4a4-43b2-a09e-aa11be3d17d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:39.770564 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21d9aa-f4a4-43b2-a09e-aa11be3d17d9 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:39.782854 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1332/2658] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 09:01:39.787480 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d3b5c-a129-4c4f-94c0-0456935b2818 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:39.798548 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d3b5c-a129-4c4f-94c0-0456935b2818 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:39.803327 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80ac42-e32c-4341-8e70-ef017e58f83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:39.804256 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80ac42-e32c-4341-8e70-ef017e58f83f admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:39.804542 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80ac42-e32c-4341-8e70-ef017e58f83f admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:39.804822 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80ac42-e32c-4341-8e70-ef017e58f83f admin admin] PATH_INFO: `/v3/projects/7e8675386e91480d9bba4e0bc8daff8f/users/139e5bd9eab44de2adfde827df6148ff/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:39.821498 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80ac42-e32c-4341-8e70-ef017e58f83f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e8675386e91480d9bba4e0bc8daff8f, user_id=139e5bd9eab44de2adfde827df6148ff, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:39.824331 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80ac42-e32c-4341-8e70-ef017e58f83f admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:39.886492 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1327/2659] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:01:39 2022] PUT /identity/v3/projects/7e8675386e91480d9bba4e0bc8daff8f/users/139e5bd9eab44de2adfde827df6148ff/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:39.898123 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86ae46-3575-4d40-bbcb-23781b6b2099 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:39.898678 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86ae46-3575-4d40-bbcb-23781b6b2099 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:39.898957 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86ae46-3575-4d40-bbcb-23781b6b2099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:39.928716 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-ed86ae46-3575-4d40-bbcb-23781b6b2099 None None] MFA Rules not processed for user `139e5bd9eab44de2adfde827df6148ff`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:39.929954 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-ed86ae46-3575-4d40-bbcb-23781b6b2099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:39.991905 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:39.997654 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1333/2660] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:01:40.002976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80ac42-e32c-4341-8e70-ef017e58f83f admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:40.012663 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:40.204554 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80ac42-e32c-4341-8e70-ef017e58f83f admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:40.209314 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd31ae-7645-4305-8c88-6ae23cb634fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:40.209976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd31ae-7645-4305-8c88-6ae23cb634fd admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:40.210260 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd31ae-7645-4305-8c88-6ae23cb634fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:40.210539 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd31ae-7645-4305-8c88-6ae23cb634fd admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:40.211244 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd31ae-7645-4305-8c88-6ae23cb634fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:40.214023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd31ae-7645-4305-8c88-6ae23cb634fd admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:40.286003 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1328/2661] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 09:01:40 2022] POST /identity/v3/projects => generated 383 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:01:40.290322 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86ae46-3575-4d40-bbcb-23781b6b2099 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:40.302163 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86ae46-3575-4d40-bbcb-23781b6b2099 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:40.361927 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c996f0-3339-4503-a3f7-e10fb82e196a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:40.362603 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c996f0-3339-4503-a3f7-e10fb82e196a admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:40.362892 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c996f0-3339-4503-a3f7-e10fb82e196a admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:40.363172 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c996f0-3339-4503-a3f7-e10fb82e196a admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:40.363907 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c996f0-3339-4503-a3f7-e10fb82e196a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:40.365822 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c996f0-3339-4503-a3f7-e10fb82e196a admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:40.468834 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1334/2662] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 09:01:40 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:01:40.473183 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd31ae-7645-4305-8c88-6ae23cb634fd admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:40.484711 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd31ae-7645-4305-8c88-6ae23cb634fd admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:40.489858 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d49855-35e1-44db-bfd4-a37e4ae43c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:40.490534 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d49855-35e1-44db-bfd4-a37e4ae43c49 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:40.490820 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d49855-35e1-44db-bfd4-a37e4ae43c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:40.491091 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d49855-35e1-44db-bfd4-a37e4ae43c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:40.491858 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d49855-35e1-44db-bfd4-a37e4ae43c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:40.493960 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d49855-35e1-44db-bfd4-a37e4ae43c49 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:40.504797 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1329/2663] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:01:40.509508 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c996f0-3339-4503-a3f7-e10fb82e196a admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:40.520058 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c996f0-3339-4503-a3f7-e10fb82e196a admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:40.525830 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b21fc8-9da9-4b24-840b-6d335309b742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:40.526511 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b21fc8-9da9-4b24-840b-6d335309b742 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:40.526794 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b21fc8-9da9-4b24-840b-6d335309b742 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:40.527073 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b21fc8-9da9-4b24-840b-6d335309b742 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:40.527853 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b21fc8-9da9-4b24-840b-6d335309b742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:40.529469 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b21fc8-9da9-4b24-840b-6d335309b742 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:40.539898 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1335/2664] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:01:40.544323 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d49855-35e1-44db-bfd4-a37e4ae43c49 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:40.554527 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d49855-35e1-44db-bfd4-a37e4ae43c49 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:40.560015 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c416ed-28e0-4224-bbb1-c01ce9bf94a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:40.560902 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c416ed-28e0-4224-bbb1-c01ce9bf94a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:40.561185 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c416ed-28e0-4224-bbb1-c01ce9bf94a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:40.561460 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c416ed-28e0-4224-bbb1-c01ce9bf94a0 admin admin] PATH_INFO: `/v3/projects/bff6d72b3e0c4c99a4740f8b8a9cce29/users/782afd67ecb645e3b3a7da0ec2c1a417/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:40.577638 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c416ed-28e0-4224-bbb1-c01ce9bf94a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bff6d72b3e0c4c99a4740f8b8a9cce29, user_id=782afd67ecb645e3b3a7da0ec2c1a417, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:40.580376 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c416ed-28e0-4224-bbb1-c01ce9bf94a0 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:40.661922 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1330/2665] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:01:40 2022] PUT /identity/v3/projects/bff6d72b3e0c4c99a4740f8b8a9cce29/users/782afd67ecb645e3b3a7da0ec2c1a417/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:40.673490 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a77358-fc1f-4239-ba9c-c3091a1d238b None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:40.673943 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a77358-fc1f-4239-ba9c-c3091a1d238b None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:40.674329 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a77358-fc1f-4239-ba9c-c3091a1d238b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:40.707119 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-d2a77358-fc1f-4239-ba9c-c3091a1d238b None None] MFA Rules not processed for user `782afd67ecb645e3b3a7da0ec2c1a417`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:40.708566 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-d2a77358-fc1f-4239-ba9c-c3091a1d238b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:40.777569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1336/2666] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:01:40.782086 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c416ed-28e0-4224-bbb1-c01ce9bf94a0 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:40.848021 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c416ed-28e0-4224-bbb1-c01ce9bf94a0 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:40.853473 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7734da-23b8-48ce-9d46-2e53578a55f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:40.854158 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7734da-23b8-48ce-9d46-2e53578a55f8 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:40.854449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7734da-23b8-48ce-9d46-2e53578a55f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:40.854730 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7734da-23b8-48ce-9d46-2e53578a55f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:40.855435 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7734da-23b8-48ce-9d46-2e53578a55f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:40.857372 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7734da-23b8-48ce-9d46-2e53578a55f8 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:40.943091 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1331/2667] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 09:01:40 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:01:40.948233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a77358-fc1f-4239-ba9c-c3091a1d238b None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:40.959347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a77358-fc1f-4239-ba9c-c3091a1d238b None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:41.021292 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce727b-d550-4f5f-8bb4-d081d5ae22e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:41.021970 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce727b-d550-4f5f-8bb4-d081d5ae22e8 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:41.022254 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce727b-d550-4f5f-8bb4-d081d5ae22e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:41.022525 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce727b-d550-4f5f-8bb4-d081d5ae22e8 admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:41.023480 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce727b-d550-4f5f-8bb4-d081d5ae22e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:41.026428 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce727b-d550-4f5f-8bb4-d081d5ae22e8 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:41.037797 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:41.108448 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1337/2668] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 09:01:40 2022] POST /identity/v3/users => generated 299 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:01:41.112266 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7734da-23b8-48ce-9d46-2e53578a55f8 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:41.123302 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7734da-23b8-48ce-9d46-2e53578a55f8 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:41.128137 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf6a3c-d166-46a5-9da7-a8f039e913a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:41.128847 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf6a3c-d166-46a5-9da7-a8f039e913a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:41.129131 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf6a3c-d166-46a5-9da7-a8f039e913a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:41.129439 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf6a3c-d166-46a5-9da7-a8f039e913a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:41.130179 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf6a3c-d166-46a5-9da7-a8f039e913a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:41.131789 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf6a3c-d166-46a5-9da7-a8f039e913a4 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:41.143273 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1332/2669] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:01:41.154186 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce727b-d550-4f5f-8bb4-d081d5ae22e8 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:41.164670 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce727b-d550-4f5f-8bb4-d081d5ae22e8 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:41.170949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9f4c8-5924-4c3f-b367-c61f0c4f7405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:41.171889 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9f4c8-5924-4c3f-b367-c61f0c4f7405 admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:41.172200 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9f4c8-5924-4c3f-b367-c61f0c4f7405 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:41.172478 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9f4c8-5924-4c3f-b367-c61f0c4f7405 admin admin] PATH_INFO: `/v3/projects/709060f410824d39a6993d0ec44a28de/users/0b6a5da8792447fd96080d1037cf15d4/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:41.190107 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9f4c8-5924-4c3f-b367-c61f0c4f7405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=709060f410824d39a6993d0ec44a28de, user_id=0b6a5da8792447fd96080d1037cf15d4, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:41.192683 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9f4c8-5924-4c3f-b367-c61f0c4f7405 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:41.263639 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1338/2670] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:01:41 2022] PUT /identity/v3/projects/709060f410824d39a6993d0ec44a28de/users/0b6a5da8792447fd96080d1037cf15d4/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:41.267794 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf6a3c-d166-46a5-9da7-a8f039e913a4 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:41.281368 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf6a3c-d166-46a5-9da7-a8f039e913a4 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:41.314166 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:41.345273 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1b28c-b677-4816-be1d-91d88fbddd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:41.345273 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1b28c-b677-4816-be1d-91d88fbddd96 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:41.345273 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1b28c-b677-4816-be1d-91d88fbddd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:41.345273 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1b28c-b677-4816-be1d-91d88fbddd96 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:41.345808 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1b28c-b677-4816-be1d-91d88fbddd96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:41.346599 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1b28c-b677-4816-be1d-91d88fbddd96 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:41.360710 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1333/2671] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:01:41.364828 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9f4c8-5924-4c3f-b367-c61f0c4f7405 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:41.376089 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9f4c8-5924-4c3f-b367-c61f0c4f7405 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:41.380896 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ea1e5-3cb0-4962-8bb0-07a1bd0d468c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:41.381603 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ea1e5-3cb0-4962-8bb0-07a1bd0d468c admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:41.381879 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ea1e5-3cb0-4962-8bb0-07a1bd0d468c admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:41.382152 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ea1e5-3cb0-4962-8bb0-07a1bd0d468c admin admin] PATH_INFO: `/v3/projects/709060f410824d39a6993d0ec44a28de/users/0b6a5da8792447fd96080d1037cf15d4/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:41.384878 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ea1e5-3cb0-4962-8bb0-07a1bd0d468c admin admin] RBAC: Authorizing `identity:create_grant(project_id=709060f410824d39a6993d0ec44a28de, user_id=0b6a5da8792447fd96080d1037cf15d4, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:41.387521 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ea1e5-3cb0-4962-8bb0-07a1bd0d468c admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:41.398426 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1339/2672] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:01:41 2022] PUT /identity/v3/projects/709060f410824d39a6993d0ec44a28de/users/0b6a5da8792447fd96080d1037cf15d4/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:41.467153 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bc74e-688c-4a85-99b8-d8f48d28108f None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:41.467450 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bc74e-688c-4a85-99b8-d8f48d28108f None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:41.467777 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bc74e-688c-4a85-99b8-d8f48d28108f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:41.498856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-0c8bc74e-688c-4a85-99b8-d8f48d28108f None None] MFA Rules not processed for user `0b6a5da8792447fd96080d1037cf15d4`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:41.500122 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0c8bc74e-688c-4a85-99b8-d8f48d28108f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:41.570524 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1334/2673] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:01:41.583384 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ea1e5-3cb0-4962-8bb0-07a1bd0d468c admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:41.585112 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-4b3ea1e5-3cb0-4962-8bb0-07a1bd0d468c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:41.644378 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ea1e5-3cb0-4962-8bb0-07a1bd0d468c admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:41.648068 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81048b34-5ba0-4fd7-b1a7-b4cd83dd245f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:41.649044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81048b34-5ba0-4fd7-b1a7-b4cd83dd245f service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:41.649331 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81048b34-5ba0-4fd7-b1a7-b4cd83dd245f service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:41.649695 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81048b34-5ba0-4fd7-b1a7-b4cd83dd245f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:41.707898 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81048b34-5ba0-4fd7-b1a7-b4cd83dd245f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:41.709400 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81048b34-5ba0-4fd7-b1a7-b4cd83dd245f service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:41.719726 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1340/2674] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:01:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:01:44.763169 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bc74e-688c-4a85-99b8-d8f48d28108f None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:44.772918 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bc74e-688c-4a85-99b8-d8f48d28108f None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:44.777748 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f60a7-825b-45bd-82ee-9b4a3f82e3fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:44.778401 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f60a7-825b-45bd-82ee-9b4a3f82e3fc service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:44.778685 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f60a7-825b-45bd-82ee-9b4a3f82e3fc service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:44.778963 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f60a7-825b-45bd-82ee-9b4a3f82e3fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:44.837511 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f60a7-825b-45bd-82ee-9b4a3f82e3fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:44.839006 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f60a7-825b-45bd-82ee-9b4a3f82e3fc service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:44.848408 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1335/2675] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:01:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:01:46.084197 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81048b34-5ba0-4fd7-b1a7-b4cd83dd245f service cinder] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:46.094621 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81048b34-5ba0-4fd7-b1a7-b4cd83dd245f service cinder] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:46.101276 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b48c9-bfbe-44bb-b716-1426fb44cd00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:46.101936 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b48c9-bfbe-44bb-b716-1426fb44cd00 service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:46.102930 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b48c9-bfbe-44bb-b716-1426fb44cd00 service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:46.103409 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b48c9-bfbe-44bb-b716-1426fb44cd00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:46.116489 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b48c9-bfbe-44bb-b716-1426fb44cd00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:46.118141 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b48c9-bfbe-44bb-b716-1426fb44cd00 service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:46.129027 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1341/2676] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:01:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:01:51.797581 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f60a7-825b-45bd-82ee-9b4a3f82e3fc service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:51.851867 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:51.865147 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f60a7-825b-45bd-82ee-9b4a3f82e3fc service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:51.872953 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcfa6dd-b9dc-42b7-a2fd-a4176ee484f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:51.873896 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfa6dd-b9dc-42b7-a2fd-a4176ee484f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:51.874206 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfa6dd-b9dc-42b7-a2fd-a4176ee484f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:51.874485 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfa6dd-b9dc-42b7-a2fd-a4176ee484f0 admin admin] PATH_INFO: `/v3/users/139e5bd9eab44de2adfde827df6148ff` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:51.875741 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcfa6dd-b9dc-42b7-a2fd-a4176ee484f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=139e5bd9eab44de2adfde827df6148ff)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:51.877806 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcfa6dd-b9dc-42b7-a2fd-a4176ee484f0 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:52.065717 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-cbcfa6dd-b9dc-42b7-a2fd-a4176ee484f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '139e5bd9eab44de2adfde827df6148ff'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:52.066379 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-cbcfa6dd-b9dc-42b7-a2fd-a4176ee484f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '139e5bd9eab44de2adfde827df6148ff'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:52.073721 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-cbcfa6dd-b9dc-42b7-a2fd-a4176ee484f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '139e5bd9eab44de2adfde827df6148ff'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:52.074397 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-cbcfa6dd-b9dc-42b7-a2fd-a4176ee484f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '139e5bd9eab44de2adfde827df6148ff'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:52.173220 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-cbcfa6dd-b9dc-42b7-a2fd-a4176ee484f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '139e5bd9eab44de2adfde827df6148ff'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:52.194727 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1336/2677] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:01:51 2022] DELETE /identity/v3/users/139e5bd9eab44de2adfde827df6148ff => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:52.200449 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db50be3-25e1-42b7-847f-124d7fb67e58 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:52.200970 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db50be3-25e1-42b7-847f-124d7fb67e58 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:52.201078 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db50be3-25e1-42b7-847f-124d7fb67e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:52.221236 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-9db50be3-25e1-42b7-847f-124d7fb67e58 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:52.224413 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-9db50be3-25e1-42b7-847f-124d7fb67e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:52.278316 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:52.286878 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1342/2678] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:01:52.297428 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcfa6dd-b9dc-42b7-a2fd-a4176ee484f0 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:52.302324 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-cbcfa6dd-b9dc-42b7-a2fd-a4176ee484f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:52.364527 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcfa6dd-b9dc-42b7-a2fd-a4176ee484f0 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:52.370538 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768404c-b752-4edf-9638-9ef11a7d9270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:52.371208 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768404c-b752-4edf-9638-9ef11a7d9270 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:52.371518 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768404c-b752-4edf-9638-9ef11a7d9270 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:52.371823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768404c-b752-4edf-9638-9ef11a7d9270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:52.381927 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3768404c-b752-4edf-9638-9ef11a7d9270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:52.383468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3768404c-b752-4edf-9638-9ef11a7d9270 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:52.400419 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1337/2679] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:01:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:01:52.813678 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db50be3-25e1-42b7-847f-124d7fb67e58 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:52.815114 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-9db50be3-25e1-42b7-847f-124d7fb67e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:52.828664 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db50be3-25e1-42b7-847f-124d7fb67e58 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:52.834517 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16077b-5686-4e0b-a268-1c9462657493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:52.835403 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16077b-5686-4e0b-a268-1c9462657493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:52.835784 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16077b-5686-4e0b-a268-1c9462657493 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:52.836068 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16077b-5686-4e0b-a268-1c9462657493 admin admin] PATH_INFO: `/v3/projects/7e8675386e91480d9bba4e0bc8daff8f` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:52.837587 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16077b-5686-4e0b-a268-1c9462657493 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e8675386e91480d9bba4e0bc8daff8f)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:52.839534 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16077b-5686-4e0b-a268-1c9462657493 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:52.948684 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-bc16077b-5686-4e0b-a268-1c9462657493 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e8675386e91480d9bba4e0bc8daff8f', 'request_id': 'req-bc16077b-5686-4e0b-a268-1c9462657493'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:52.955018 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-bc16077b-5686-4e0b-a268-1c9462657493 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e8675386e91480d9bba4e0bc8daff8f', 'request_id': 'req-bc16077b-5686-4e0b-a268-1c9462657493'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:52.960537 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-bc16077b-5686-4e0b-a268-1c9462657493 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e8675386e91480d9bba4e0bc8daff8f', 'request_id': 'req-bc16077b-5686-4e0b-a268-1c9462657493'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:53.038553 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-bc16077b-5686-4e0b-a268-1c9462657493 admin admin] The token cache is being invalidate because project 7e8675386e91480d9bba4e0bc8daff8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:01:53.038829 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-bc16077b-5686-4e0b-a268-1c9462657493 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:53.039475 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-bc16077b-5686-4e0b-a268-1c9462657493 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:53.041598 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1343/2680] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:01:52 2022] DELETE /identity/v3/projects/7e8675386e91480d9bba4e0bc8daff8f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:53.045780 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768404c-b752-4edf-9638-9ef11a7d9270 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:53.059904 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768404c-b752-4edf-9638-9ef11a7d9270 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:53.120783 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667d511-7ccb-4da7-8fff-6f5e0505a107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:53.121732 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667d511-7ccb-4da7-8fff-6f5e0505a107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:53.122053 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667d511-7ccb-4da7-8fff-6f5e0505a107 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:53.122380 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667d511-7ccb-4da7-8fff-6f5e0505a107 admin admin] PATH_INFO: `/v3/users/782afd67ecb645e3b3a7da0ec2c1a417` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:53.123653 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667d511-7ccb-4da7-8fff-6f5e0505a107 admin admin] RBAC: Authorizing `identity:delete_user(user_id=782afd67ecb645e3b3a7da0ec2c1a417)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:53.125570 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667d511-7ccb-4da7-8fff-6f5e0505a107 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:53.139376 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:53.322285 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-8667d511-7ccb-4da7-8fff-6f5e0505a107 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '782afd67ecb645e3b3a7da0ec2c1a417'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:53.322510 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-8667d511-7ccb-4da7-8fff-6f5e0505a107 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '782afd67ecb645e3b3a7da0ec2c1a417'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:53.329600 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-8667d511-7ccb-4da7-8fff-6f5e0505a107 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '782afd67ecb645e3b3a7da0ec2c1a417'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:53.330296 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-8667d511-7ccb-4da7-8fff-6f5e0505a107 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '782afd67ecb645e3b3a7da0ec2c1a417'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:53.404517 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-8667d511-7ccb-4da7-8fff-6f5e0505a107 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '782afd67ecb645e3b3a7da0ec2c1a417'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:53.424262 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1338/2681] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:01:53 2022] DELETE /identity/v3/users/782afd67ecb645e3b3a7da0ec2c1a417 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:53.435185 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16077b-5686-4e0b-a268-1c9462657493 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:53.436818 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-bc16077b-5686-4e0b-a268-1c9462657493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:53.450223 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16077b-5686-4e0b-a268-1c9462657493 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:53.515710 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7128a-a572-42ae-8a08-99295a19c990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:53.516595 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7128a-a572-42ae-8a08-99295a19c990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:53.516882 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7128a-a572-42ae-8a08-99295a19c990 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:53.517160 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7128a-a572-42ae-8a08-99295a19c990 admin admin] PATH_INFO: `/v3/users/c5a1a156008a43908ad3e3e2ac8445a1` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:53.518370 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a7128a-a572-42ae-8a08-99295a19c990 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5a1a156008a43908ad3e3e2ac8445a1)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:53.520347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a7128a-a572-42ae-8a08-99295a19c990 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:53.677844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-61a7128a-a572-42ae-8a08-99295a19c990 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5a1a156008a43908ad3e3e2ac8445a1'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:53.678552 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-61a7128a-a572-42ae-8a08-99295a19c990 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5a1a156008a43908ad3e3e2ac8445a1'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:53.679266 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-61a7128a-a572-42ae-8a08-99295a19c990 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5a1a156008a43908ad3e3e2ac8445a1'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:53.687852 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-61a7128a-a572-42ae-8a08-99295a19c990 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5a1a156008a43908ad3e3e2ac8445a1'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:53.736364 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-61a7128a-a572-42ae-8a08-99295a19c990 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5a1a156008a43908ad3e3e2ac8445a1'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:53.761172 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1344/2682] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:01:53 2022] DELETE /identity/v3/users/c5a1a156008a43908ad3e3e2ac8445a1 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:53.766611 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c5c0e-764b-4a47-9d48-437f91cf2723 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:53.766611 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c5c0e-764b-4a47-9d48-437f91cf2723 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:53.766611 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c5c0e-764b-4a47-9d48-437f91cf2723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:53.786084 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-5e5c5c0e-764b-4a47-9d48-437f91cf2723 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:53.787299 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-5e5c5c0e-764b-4a47-9d48-437f91cf2723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:53.847817 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1339/2683] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:01:53.857536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7128a-a572-42ae-8a08-99295a19c990 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:53.859694 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-61a7128a-a572-42ae-8a08-99295a19c990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:53.865074 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:53.875279 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c5c0e-764b-4a47-9d48-437f91cf2723 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:53.876831 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-5e5c5c0e-764b-4a47-9d48-437f91cf2723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:53.893400 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c5c0e-764b-4a47-9d48-437f91cf2723 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:53.898675 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08638948-0d39-4a7e-9f15-c44390aa6597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:53.900275 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08638948-0d39-4a7e-9f15-c44390aa6597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:53.900587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08638948-0d39-4a7e-9f15-c44390aa6597 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:53.900871 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08638948-0d39-4a7e-9f15-c44390aa6597 admin admin] PATH_INFO: `/v3/projects/bff6d72b3e0c4c99a4740f8b8a9cce29` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:53.902366 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08638948-0d39-4a7e-9f15-c44390aa6597 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bff6d72b3e0c4c99a4740f8b8a9cce29)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:53.904428 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08638948-0d39-4a7e-9f15-c44390aa6597 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:53.938994 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7128a-a572-42ae-8a08-99295a19c990 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:53.943080 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa928659-6535-4409-930c-842609fb20b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:53.943804 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa928659-6535-4409-930c-842609fb20b5 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:53.944091 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa928659-6535-4409-930c-842609fb20b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:53.944366 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa928659-6535-4409-930c-842609fb20b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:53.954799 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa928659-6535-4409-930c-842609fb20b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:53.956312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa928659-6535-4409-930c-842609fb20b5 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:53.966726 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1345/2684] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:01:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:01:54.015406 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-08638948-0d39-4a7e-9f15-c44390aa6597 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bff6d72b3e0c4c99a4740f8b8a9cce29', 'request_id': 'req-08638948-0d39-4a7e-9f15-c44390aa6597'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:54.022054 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-08638948-0d39-4a7e-9f15-c44390aa6597 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bff6d72b3e0c4c99a4740f8b8a9cce29', 'request_id': 'req-08638948-0d39-4a7e-9f15-c44390aa6597'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:54.029660 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-08638948-0d39-4a7e-9f15-c44390aa6597 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bff6d72b3e0c4c99a4740f8b8a9cce29', 'request_id': 'req-08638948-0d39-4a7e-9f15-c44390aa6597'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:54.126683 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-08638948-0d39-4a7e-9f15-c44390aa6597 admin admin] The token cache is being invalidate because project bff6d72b3e0c4c99a4740f8b8a9cce29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:01:54.127997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-08638948-0d39-4a7e-9f15-c44390aa6597 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:54.129283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-08638948-0d39-4a7e-9f15-c44390aa6597 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:54.132399 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1340/2685] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:01:53 2022] DELETE /identity/v3/projects/bff6d72b3e0c4c99a4740f8b8a9cce29 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:54.137065 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa928659-6535-4409-930c-842609fb20b5 service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:54.151561 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa928659-6535-4409-930c-842609fb20b5 service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:54.241548 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7d237-ba4c-41f2-b78f-d5e8242f933e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:54.242541 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7d237-ba4c-41f2-b78f-d5e8242f933e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:54.242834 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7d237-ba4c-41f2-b78f-d5e8242f933e admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:54.243110 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7d237-ba4c-41f2-b78f-d5e8242f933e admin admin] PATH_INFO: `/v3/users/0b6a5da8792447fd96080d1037cf15d4` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:54.245150 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7d237-ba4c-41f2-b78f-d5e8242f933e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b6a5da8792447fd96080d1037cf15d4)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:54.249858 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7d237-ba4c-41f2-b78f-d5e8242f933e admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:54.424482 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08638948-0d39-4a7e-9f15-c44390aa6597 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:54.427683 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-08638948-0d39-4a7e-9f15-c44390aa6597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:54.441686 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08638948-0d39-4a7e-9f15-c44390aa6597 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:54.449595 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada75bc4-f4da-4950-a7c4-88905498d4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:54.450550 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada75bc4-f4da-4950-a7c4-88905498d4b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:54.450753 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada75bc4-f4da-4950-a7c4-88905498d4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:54.451108 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada75bc4-f4da-4950-a7c4-88905498d4b6 admin admin] PATH_INFO: `/v3/projects/a3d020d514eb42a78878aa3255da9fa8` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:54.456873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada75bc4-f4da-4950-a7c4-88905498d4b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3d020d514eb42a78878aa3255da9fa8)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:54.456873 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada75bc4-f4da-4950-a7c4-88905498d4b6 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:54.466473 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:54.486859 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-a9e7d237-ba4c-41f2-b78f-d5e8242f933e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b6a5da8792447fd96080d1037cf15d4'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:54.487491 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-a9e7d237-ba4c-41f2-b78f-d5e8242f933e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b6a5da8792447fd96080d1037cf15d4'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:54.488135 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-a9e7d237-ba4c-41f2-b78f-d5e8242f933e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b6a5da8792447fd96080d1037cf15d4'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:54.496481 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-a9e7d237-ba4c-41f2-b78f-d5e8242f933e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b6a5da8792447fd96080d1037cf15d4'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:54.593110 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-a9e7d237-ba4c-41f2-b78f-d5e8242f933e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b6a5da8792447fd96080d1037cf15d4'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:54.601288 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ada75bc4-f4da-4950-a7c4-88905498d4b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3d020d514eb42a78878aa3255da9fa8', 'request_id': 'req-ada75bc4-f4da-4950-a7c4-88905498d4b6'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:54.608584 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ada75bc4-f4da-4950-a7c4-88905498d4b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3d020d514eb42a78878aa3255da9fa8', 'request_id': 'req-ada75bc4-f4da-4950-a7c4-88905498d4b6'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:54.613975 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1346/2686] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:01:54 2022] DELETE /identity/v3/users/0b6a5da8792447fd96080d1037cf15d4 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:54.614952 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ada75bc4-f4da-4950-a7c4-88905498d4b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3d020d514eb42a78878aa3255da9fa8', 'request_id': 'req-ada75bc4-f4da-4950-a7c4-88905498d4b6'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:54.721021 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ada75bc4-f4da-4950-a7c4-88905498d4b6 admin admin] The token cache is being invalidate because project a3d020d514eb42a78878aa3255da9fa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:01:54.726001 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ada75bc4-f4da-4950-a7c4-88905498d4b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:54.726001 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ada75bc4-f4da-4950-a7c4-88905498d4b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:54.726001 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1341/2687] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:01:54 2022] DELETE /identity/v3/projects/a3d020d514eb42a78878aa3255da9fa8 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 09:01:54.731572 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d35910-ec83-41d3-9353-29b46f6a4307 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:54.731906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d35910-ec83-41d3-9353-29b46f6a4307 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:54.732188 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d35910-ec83-41d3-9353-29b46f6a4307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:54.754601 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-b1d35910-ec83-41d3-9353-29b46f6a4307 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:54.755902 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-b1d35910-ec83-41d3-9353-29b46f6a4307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:54.778762 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:54.824495 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1347/2688] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:01:54.832172 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e098d75-c3cd-4053-b0bd-a6731df241c0 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:54.832589 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e098d75-c3cd-4053-b0bd-a6731df241c0 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:54.832905 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e098d75-c3cd-4053-b0bd-a6731df241c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:54.862718 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-7e098d75-c3cd-4053-b0bd-a6731df241c0 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:54.864035 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-7e098d75-c3cd-4053-b0bd-a6731df241c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:54.872277 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1342/2689] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:01:54.876762 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d35910-ec83-41d3-9353-29b46f6a4307 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:54.887186 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d35910-ec83-41d3-9353-29b46f6a4307 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:54.892634 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95735357-b7a7-4012-b068-358b76bfef54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:54.893270 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95735357-b7a7-4012-b068-358b76bfef54 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:54.893557 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95735357-b7a7-4012-b068-358b76bfef54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:54.893838 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95735357-b7a7-4012-b068-358b76bfef54 admin admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:54.894708 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95735357-b7a7-4012-b068-358b76bfef54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:01:54.895035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95735357-b7a7-4012-b068-358b76bfef54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:54.896812 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95735357-b7a7-4012-b068-358b76bfef54 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:54.912844 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1348/2690] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 09:01:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:01:54.916440 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e098d75-c3cd-4053-b0bd-a6731df241c0 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:54.926459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e098d75-c3cd-4053-b0bd-a6731df241c0 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:54.931313 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0433cd-3a0f-41da-9e5c-9e0bd235e85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:54.932507 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0433cd-3a0f-41da-9e5c-9e0bd235e85b admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:54.932507 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0433cd-3a0f-41da-9e5c-9e0bd235e85b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:54.932717 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0433cd-3a0f-41da-9e5c-9e0bd235e85b admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:54.933278 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0433cd-3a0f-41da-9e5c-9e0bd235e85b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:54.935221 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0433cd-3a0f-41da-9e5c-9e0bd235e85b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:55.041221 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1343/2691] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 09:01:54 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:01:55.045834 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95735357-b7a7-4012-b068-358b76bfef54 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:55.056000 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95735357-b7a7-4012-b068-358b76bfef54 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:55.063824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0433cd-3a0f-41da-9e5c-9e0bd235e85b admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:55.069583 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-8f0433cd-3a0f-41da-9e5c-9e0bd235e85b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:55.135668 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d368d-2b87-4aec-9fc5-4c52b7651458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:55.136489 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d368d-2b87-4aec-9fc5-4c52b7651458 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:55.136774 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d368d-2b87-4aec-9fc5-4c52b7651458 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:55.137048 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d368d-2b87-4aec-9fc5-4c52b7651458 admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:55.137745 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d368d-2b87-4aec-9fc5-4c52b7651458 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:55.139908 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d368d-2b87-4aec-9fc5-4c52b7651458 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:55.148557 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0433cd-3a0f-41da-9e5c-9e0bd235e85b admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:55.151032 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d0f3f-866d-4196-8c5c-1e3cf873fffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:55.151929 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d0f3f-866d-4196-8c5c-1e3cf873fffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:55.152213 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d0f3f-866d-4196-8c5c-1e3cf873fffe admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:55.152494 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d0f3f-866d-4196-8c5c-1e3cf873fffe admin admin] PATH_INFO: `/v3/projects/709060f410824d39a6993d0ec44a28de` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:55.153724 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d0f3f-866d-4196-8c5c-1e3cf873fffe admin admin] RBAC: Authorizing `identity:delete_project(project_id=709060f410824d39a6993d0ec44a28de)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:55.155712 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d0f3f-866d-4196-8c5c-1e3cf873fffe admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:55.245088 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1349/2692] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 09:01:55 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:01:55.249278 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d368d-2b87-4aec-9fc5-4c52b7651458 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:55.260386 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d368d-2b87-4aec-9fc5-4c52b7651458 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:55.264973 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d055968-d547-432c-921e-90af7d080db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:55.266110 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d055968-d547-432c-921e-90af7d080db2 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:55.266110 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d055968-d547-432c-921e-90af7d080db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:55.271922 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d055968-d547-432c-921e-90af7d080db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:55.271922 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d055968-d547-432c-921e-90af7d080db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:55.271922 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d055968-d547-432c-921e-90af7d080db2 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:55.281604 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1350/2693] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:01:55.285344 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d055968-d547-432c-921e-90af7d080db2 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:55.295285 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-dc4d0f3f-866d-4196-8c5c-1e3cf873fffe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '709060f410824d39a6993d0ec44a28de', 'request_id': 'req-dc4d0f3f-866d-4196-8c5c-1e3cf873fffe'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:55.296227 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d055968-d547-432c-921e-90af7d080db2 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:55.300820 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-dc4d0f3f-866d-4196-8c5c-1e3cf873fffe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '709060f410824d39a6993d0ec44a28de', 'request_id': 'req-dc4d0f3f-866d-4196-8c5c-1e3cf873fffe'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:55.309775 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-dc4d0f3f-866d-4196-8c5c-1e3cf873fffe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '709060f410824d39a6993d0ec44a28de', 'request_id': 'req-dc4d0f3f-866d-4196-8c5c-1e3cf873fffe'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:55.363351 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c64ad3-9b79-4428-adff-8bf3e25dec16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:55.364085 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c64ad3-9b79-4428-adff-8bf3e25dec16 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:55.364366 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c64ad3-9b79-4428-adff-8bf3e25dec16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:55.364641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c64ad3-9b79-4428-adff-8bf3e25dec16 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:55.365374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c64ad3-9b79-4428-adff-8bf3e25dec16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:55.366981 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c64ad3-9b79-4428-adff-8bf3e25dec16 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:55.377781 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:55.378699 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1351/2694] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 09:01:55.382821 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-dc4d0f3f-866d-4196-8c5c-1e3cf873fffe admin admin] The token cache is being invalidate because project 709060f410824d39a6993d0ec44a28de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:01:55.382821 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-dc4d0f3f-866d-4196-8c5c-1e3cf873fffe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:55.382821 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-dc4d0f3f-866d-4196-8c5c-1e3cf873fffe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:01:55.385819 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1344/2695] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:01:55 2022] DELETE /identity/v3/projects/709060f410824d39a6993d0ec44a28de => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:55.386714 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c64ad3-9b79-4428-adff-8bf3e25dec16 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:55.389314 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-65c64ad3-9b79-4428-adff-8bf3e25dec16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:55.391601 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1d7f5-6cbc-4366-b859-564c3fee17d1 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:55.391919 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1d7f5-6cbc-4366-b859-564c3fee17d1 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:55.395676 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1d7f5-6cbc-4366-b859-564c3fee17d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:55.408810 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c64ad3-9b79-4428-adff-8bf3e25dec16 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:55.414165 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1768f-db89-4e8d-9acb-2bd34d712230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:55.415008 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1768f-db89-4e8d-9acb-2bd34d712230 admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:55.415501 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1768f-db89-4e8d-9acb-2bd34d712230 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:55.415877 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1768f-db89-4e8d-9acb-2bd34d712230 admin admin] PATH_INFO: `/v3/projects/e18fba919fd54e4a99232fe72ff6ece2/users/7bc354ee86ff4d3e9438427fea3b0a6d/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:55.416636 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-d5a1d7f5-6cbc-4366-b859-564c3fee17d1 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:55.419737 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d5a1d7f5-6cbc-4366-b859-564c3fee17d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:55.426642 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1345/2696] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:01:55.435401 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c526cff-7ad4-4bc8-b96c-a6629d87a1dc None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:55.436046 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c526cff-7ad4-4bc8-b96c-a6629d87a1dc None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:55.436328 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c526cff-7ad4-4bc8-b96c-a6629d87a1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:55.443885 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1768f-db89-4e8d-9acb-2bd34d712230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e18fba919fd54e4a99232fe72ff6ece2, user_id=7bc354ee86ff4d3e9438427fea3b0a6d, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:55.448593 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1768f-db89-4e8d-9acb-2bd34d712230 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:55.461894 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-6c526cff-7ad4-4bc8-b96c-a6629d87a1dc None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:55.463705 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6c526cff-7ad4-4bc8-b96c-a6629d87a1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:55.471989 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1346/2697] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:01:55.476242 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c526cff-7ad4-4bc8-b96c-a6629d87a1dc None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:55.486158 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c526cff-7ad4-4bc8-b96c-a6629d87a1dc None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:55.490870 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84c0d5-e260-4428-b3d8-999920fe627f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:55.491523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84c0d5-e260-4428-b3d8-999920fe627f admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:55.491845 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84c0d5-e260-4428-b3d8-999920fe627f admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:55.492119 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84c0d5-e260-4428-b3d8-999920fe627f admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:55.492844 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84c0d5-e260-4428-b3d8-999920fe627f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:01:55.493152 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84c0d5-e260-4428-b3d8-999920fe627f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:55.495483 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84c0d5-e260-4428-b3d8-999920fe627f admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:55.507794 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1347/2698] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 09:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:01:55.512852 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84c0d5-e260-4428-b3d8-999920fe627f admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:55.522882 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84c0d5-e260-4428-b3d8-999920fe627f admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:55.528496 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f2b0f-cb47-46a4-9771-4cbb076134db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:55.528872 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f2b0f-cb47-46a4-9771-4cbb076134db admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:55.529154 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f2b0f-cb47-46a4-9771-4cbb076134db admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:55.529434 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f2b0f-cb47-46a4-9771-4cbb076134db admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:55.530127 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f2b0f-cb47-46a4-9771-4cbb076134db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:55.532062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f2b0f-cb47-46a4-9771-4cbb076134db admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:55.540216 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1352/2699] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:01:55 2022] PUT /identity/v3/projects/e18fba919fd54e4a99232fe72ff6ece2/users/7bc354ee86ff4d3e9438427fea3b0a6d/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:55.545546 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b7a27-2654-4b85-ad9a-122936748349 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:55.545906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b7a27-2654-4b85-ad9a-122936748349 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:55.546211 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b7a27-2654-4b85-ad9a-122936748349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:55.553588 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:55.566730 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-234b7a27-2654-4b85-ad9a-122936748349 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:55.567991 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-234b7a27-2654-4b85-ad9a-122936748349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:55.640472 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1353/2700] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:01:55.650669 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b7a27-2654-4b85-ad9a-122936748349 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:55.652240 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-234b7a27-2654-4b85-ad9a-122936748349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:55.657542 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1348/2701] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 09:01:55 2022] POST /identity/v3/projects => generated 369 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:01:55.663253 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f2b0f-cb47-46a4-9771-4cbb076134db admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:55.726341 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b7a27-2654-4b85-ad9a-122936748349 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:55.736188 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f2b0f-cb47-46a4-9771-4cbb076134db admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:55.747496 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c1273-6c5f-40fa-971b-b58e908d316c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:55.748226 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c1273-6c5f-40fa-971b-b58e908d316c admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:55.749196 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c1273-6c5f-40fa-971b-b58e908d316c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:55.749493 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c1273-6c5f-40fa-971b-b58e908d316c admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:55.750235 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c1273-6c5f-40fa-971b-b58e908d316c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:55.752192 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c1273-6c5f-40fa-971b-b58e908d316c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:55.780662 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66aa4f-ecff-4a72-be0d-5faae23711fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:55.782824 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66aa4f-ecff-4a72-be0d-5faae23711fc service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:55.782824 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66aa4f-ecff-4a72-be0d-5faae23711fc service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:55.782824 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66aa4f-ecff-4a72-be0d-5faae23711fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:55.792280 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af66aa4f-ecff-4a72-be0d-5faae23711fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:55.793734 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af66aa4f-ecff-4a72-be0d-5faae23711fc service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:55.806315 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1354/2702] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:01:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 09:01:55.823783 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1349/2703] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 09:01:55 2022] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:01:55.827969 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66aa4f-ecff-4a72-be0d-5faae23711fc service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:55.838331 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66aa4f-ecff-4a72-be0d-5faae23711fc service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:55.843082 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d42536-1aa3-4e18-954b-57a77bffcc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:55.843851 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d42536-1aa3-4e18-954b-57a77bffcc5c admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:55.844137 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d42536-1aa3-4e18-954b-57a77bffcc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:55.844413 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d42536-1aa3-4e18-954b-57a77bffcc5c admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:55.845141 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d42536-1aa3-4e18-954b-57a77bffcc5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:55.846744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d42536-1aa3-4e18-954b-57a77bffcc5c admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:55.858070 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1355/2704] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:01:55.863358 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c1273-6c5f-40fa-971b-b58e908d316c admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:55.878941 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c1273-6c5f-40fa-971b-b58e908d316c admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:55.883831 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213fca7-2ce9-4ea7-bf4a-f1fb45b135bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:55.885305 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213fca7-2ce9-4ea7-bf4a-f1fb45b135bf admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:55.885593 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213fca7-2ce9-4ea7-bf4a-f1fb45b135bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:55.885874 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213fca7-2ce9-4ea7-bf4a-f1fb45b135bf admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:55.886624 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a213fca7-2ce9-4ea7-bf4a-f1fb45b135bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:55.888275 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a213fca7-2ce9-4ea7-bf4a-f1fb45b135bf admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:55.907499 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1350/2705] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:01:55.907960 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d42536-1aa3-4e18-954b-57a77bffcc5c admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:55.917196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d42536-1aa3-4e18-954b-57a77bffcc5c admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:55.923778 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431f4b0-7c26-4f39-bbea-4ec6be1cff1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:55.924699 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431f4b0-7c26-4f39-bbea-4ec6be1cff1c admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:55.924986 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431f4b0-7c26-4f39-bbea-4ec6be1cff1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:55.925269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431f4b0-7c26-4f39-bbea-4ec6be1cff1c admin admin] PATH_INFO: `/v3/projects/e08c4160d9844f93a99ffd484aafe4b1/users/8c9c54beebdd42fba56b4d3c204a432c/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:55.946223 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431f4b0-7c26-4f39-bbea-4ec6be1cff1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e08c4160d9844f93a99ffd484aafe4b1, user_id=8c9c54beebdd42fba56b4d3c204a432c, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:55.948993 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431f4b0-7c26-4f39-bbea-4ec6be1cff1c admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:56.024222 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1356/2706] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:01:55 2022] PUT /identity/v3/projects/e08c4160d9844f93a99ffd484aafe4b1/users/8c9c54beebdd42fba56b4d3c204a432c/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:01:56.035530 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd84a85-a253-46d7-828f-38d7d76cd551 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:56.035909 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd84a85-a253-46d7-828f-38d7d76cd551 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:56.036202 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd84a85-a253-46d7-828f-38d7d76cd551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:56.072062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-2bd84a85-a253-46d7-828f-38d7d76cd551 None None] MFA Rules not processed for user `8c9c54beebdd42fba56b4d3c204a432c`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:01:56.073342 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-2bd84a85-a253-46d7-828f-38d7d76cd551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:56.148255 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1351/2707] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:01:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:01:56.160096 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431f4b0-7c26-4f39-bbea-4ec6be1cff1c admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:01:56.161874 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-4431f4b0-7c26-4f39-bbea-4ec6be1cff1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:01:56.196438 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:01:56.256314 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431f4b0-7c26-4f39-bbea-4ec6be1cff1c admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:01:56.261221 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c474c1-9d4d-4b76-b28f-8138d3bd6d23 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd75a24363c14e86b0fbbb782b372646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:01:56.261975 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c474c1-9d4d-4b76-b28f-8138d3bd6d23 service glance] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:01:56.262331 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c474c1-9d4d-4b76-b28f-8138d3bd6d23 service glance] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:01:56.262677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c474c1-9d4d-4b76-b28f-8138d3bd6d23 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:01:56.278422 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c474c1-9d4d-4b76-b28f-8138d3bd6d23 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:01:56.280059 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c474c1-9d4d-4b76-b28f-8138d3bd6d23 service glance] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:01:56.291987 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1357/2708] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:01:56 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:02:02.603761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86e76a-07ea-4038-8089-45d64e7cbeb9 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:02:02.604381 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86e76a-07ea-4038-8089-45d64e7cbeb9 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:02:02.604594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86e76a-07ea-4038-8089-45d64e7cbeb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:02:02.640394 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-be86e76a-07ea-4038-8089-45d64e7cbeb9 None None] MFA Rules not processed for user `7bc354ee86ff4d3e9438427fea3b0a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:02:02.641620 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-be86e76a-07ea-4038-8089-45d64e7cbeb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:02:02.651750 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:02:02.759383 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1352/2709] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:02:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:02:02.763993 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c474c1-9d4d-4b76-b28f-8138d3bd6d23 service glance] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:02:02.852986 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c474c1-9d4d-4b76-b28f-8138d3bd6d23 service glance] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:02:02.857965 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1cb49-185c-442b-8852-19d35954364f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:02:02.858786 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1cb49-185c-442b-8852-19d35954364f admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:02:02.859177 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1cb49-185c-442b-8852-19d35954364f admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:02:02.859559 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1cb49-185c-442b-8852-19d35954364f admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:02:02.860590 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de1cb49-185c-442b-8852-19d35954364f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:02:02.862695 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de1cb49-185c-442b-8852-19d35954364f admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:02:02.974292 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1358/2710] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 09:02:02 2022] POST /identity/v3/projects => generated 385 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:02:02.987429 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86e76a-07ea-4038-8089-45d64e7cbeb9 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:02:02.999481 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86e76a-07ea-4038-8089-45d64e7cbeb9 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:02:03.076094 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee46c5-04c1-4d04-a0f7-73812dbe84ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:02:03.076923 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee46c5-04c1-4d04-a0f7-73812dbe84ed admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:02:03.077215 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee46c5-04c1-4d04-a0f7-73812dbe84ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:02:03.077500 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee46c5-04c1-4d04-a0f7-73812dbe84ed admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:02:03.078270 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee46c5-04c1-4d04-a0f7-73812dbe84ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:02:03.080280 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee46c5-04c1-4d04-a0f7-73812dbe84ed admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:02:03.174182 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1353/2711] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 09:02:02 2022] POST /identity/v3/users => generated 299 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:02:03.177196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1cb49-185c-442b-8852-19d35954364f admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:02:03.189345 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1cb49-185c-442b-8852-19d35954364f admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:02:03.194206 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bddde4-0bcf-4479-a23f-95fb9aef9bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:02:03.195147 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bddde4-0bcf-4479-a23f-95fb9aef9bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:02:03.196062 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bddde4-0bcf-4479-a23f-95fb9aef9bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:02:03.199191 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bddde4-0bcf-4479-a23f-95fb9aef9bf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:02:03.199191 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bddde4-0bcf-4479-a23f-95fb9aef9bf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:02:03.199735 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bddde4-0bcf-4479-a23f-95fb9aef9bf7 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:02:03.219670 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1359/2712] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:02:03.223681 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee46c5-04c1-4d04-a0f7-73812dbe84ed admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:02:03.234954 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee46c5-04c1-4d04-a0f7-73812dbe84ed admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:02:03.239755 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f9da7-d26e-4098-8b08-c62c116b2fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:02:03.240667 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f9da7-d26e-4098-8b08-c62c116b2fa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:02:03.240958 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f9da7-d26e-4098-8b08-c62c116b2fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:02:03.241243 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f9da7-d26e-4098-8b08-c62c116b2fa5 admin admin] PATH_INFO: `/v3/projects/a91c4d56741f404590d8ca269c147fec/users/0e8c62bfd4974f51abba472d5f28d7ed/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:02:03.282896 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f9da7-d26e-4098-8b08-c62c116b2fa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a91c4d56741f404590d8ca269c147fec, user_id=0e8c62bfd4974f51abba472d5f28d7ed, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:02:03.286030 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f9da7-d26e-4098-8b08-c62c116b2fa5 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:02:03.365567 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1354/2713] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:02:03 2022] PUT /identity/v3/projects/a91c4d56741f404590d8ca269c147fec/users/0e8c62bfd4974f51abba472d5f28d7ed/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:02:03.370777 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bddde4-0bcf-4479-a23f-95fb9aef9bf7 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:02:03.382090 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bddde4-0bcf-4479-a23f-95fb9aef9bf7 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:02:03.468298 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f85c0-7e4c-43c1-bd42-eff79ad6cee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:02:03.468995 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f85c0-7e4c-43c1-bd42-eff79ad6cee8 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:02:03.469279 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f85c0-7e4c-43c1-bd42-eff79ad6cee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:02:03.469554 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f85c0-7e4c-43c1-bd42-eff79ad6cee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:02:03.470296 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f85c0-7e4c-43c1-bd42-eff79ad6cee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:02:03.472063 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f85c0-7e4c-43c1-bd42-eff79ad6cee8 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:02:03.491662 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1360/2714] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:02:03.497046 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f9da7-d26e-4098-8b08-c62c116b2fa5 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:02:03.517626 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f9da7-d26e-4098-8b08-c62c116b2fa5 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:02:03.539027 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1b28c-bb6e-46a8-96c7-7b35f59c26d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:02:03.540659 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1b28c-bb6e-46a8-96c7-7b35f59c26d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:02:03.541054 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1b28c-bb6e-46a8-96c7-7b35f59c26d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:02:03.541435 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1b28c-bb6e-46a8-96c7-7b35f59c26d3 admin admin] PATH_INFO: `/v3/projects/a91c4d56741f404590d8ca269c147fec/users/0e8c62bfd4974f51abba472d5f28d7ed/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:02:03.544089 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1b28c-bb6e-46a8-96c7-7b35f59c26d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a91c4d56741f404590d8ca269c147fec, user_id=0e8c62bfd4974f51abba472d5f28d7ed, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:02:03.547342 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1b28c-bb6e-46a8-96c7-7b35f59c26d3 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:02:03.570617 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1355/2715] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:02:03 2022] PUT /identity/v3/projects/a91c4d56741f404590d8ca269c147fec/users/0e8c62bfd4974f51abba472d5f28d7ed/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:02:10.769372 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48385a-1391-403c-ac29-29fcc204d7de None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:02:10.769878 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48385a-1391-403c-ac29-29fcc204d7de None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:02:10.775012 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48385a-1391-403c-ac29-29fcc204d7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:02:10.812709 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-ea48385a-1391-403c-ac29-29fcc204d7de None None] MFA Rules not processed for user `0e8c62bfd4974f51abba472d5f28d7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:02:10.813535 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-ea48385a-1391-403c-ac29-29fcc204d7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:02:10.825396 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:02:10.924350 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1361/2716] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:02:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:02:10.938963 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1b28c-bb6e-46a8-96c7-7b35f59c26d3 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:02:11.008011 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1b28c-bb6e-46a8-96c7-7b35f59c26d3 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:02:11.018911 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed911f46-d27a-4da5-8ac2-d1fcd068f7b1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd75a24363c14e86b0fbbb782b372646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:02:11.018911 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed911f46-d27a-4da5-8ac2-d1fcd068f7b1 service glance] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:02:11.018911 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed911f46-d27a-4da5-8ac2-d1fcd068f7b1 service glance] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:02:11.018911 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed911f46-d27a-4da5-8ac2-d1fcd068f7b1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:02:11.030671 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:02:11.086966 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed911f46-d27a-4da5-8ac2-d1fcd068f7b1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:02:11.088738 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed911f46-d27a-4da5-8ac2-d1fcd068f7b1 service glance] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:02:11.099311 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1356/2717] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:02:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:02:11.405952 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db4f05-1e0a-4cc4-bcd8-d64f22a3aed4 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:02:11.406232 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db4f05-1e0a-4cc4-bcd8-d64f22a3aed4 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:02:11.406512 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db4f05-1e0a-4cc4-bcd8-d64f22a3aed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:02:11.460782 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-00db4f05-1e0a-4cc4-bcd8-d64f22a3aed4 None None] MFA Rules not processed for user `b3c1d56bc0a64411a68f97a4417b0379`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:02:11.462622 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-00db4f05-1e0a-4cc4-bcd8-d64f22a3aed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:02:11.534840 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1362/2718] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Jul 25 09:02:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:02:11.668241 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed911f46-d27a-4da5-8ac2-d1fcd068f7b1 service glance] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:02:11.670225 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-ed911f46-d27a-4da5-8ac2-d1fcd068f7b1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:02:11.780487 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed911f46-d27a-4da5-8ac2-d1fcd068f7b1 service glance] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:02:11.788011 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8221d-0cb5-45a8-b0b7-711e315883f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2763e540681547d3a6677567b3be86ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:02:11.788639 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8221d-0cb5-45a8-b0b7-711e315883f3 service swift] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:02:11.789415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8221d-0cb5-45a8-b0b7-711e315883f3 service swift] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:02:11.789415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8221d-0cb5-45a8-b0b7-711e315883f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:02:11.798638 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8221d-0cb5-45a8-b0b7-711e315883f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:02:11.800304 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8221d-0cb5-45a8-b0b7-711e315883f3 service swift] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:02:11.812617 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1357/2719] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Jul 25 09:02:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 09:02:14.148540 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9fe20-db98-4727-bd04-63f184e129cc None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:02:14.151985 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9fe20-db98-4727-bd04-63f184e129cc None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:02:14.152308 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9fe20-db98-4727-bd04-63f184e129cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:02:14.194747 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-f2a9fe20-db98-4727-bd04-63f184e129cc None None] MFA Rules not processed for user `fa467b0890784cabbd6bcad011ee1c91`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:02:14.196994 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-f2a9fe20-db98-4727-bd04-63f184e129cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:02:14.286038 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1363/2720] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:02:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:02:15.483276 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8221d-0cb5-45a8-b0b7-711e315883f3 service swift] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:02:15.486312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-15c8221d-0cb5-45a8-b0b7-711e315883f3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:02:15.609684 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8221d-0cb5-45a8-b0b7-711e315883f3 service swift] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:02:15.615780 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b8e5c-915d-41e7-85e0-fdf97b282a1a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfb4be75496444dd897b880c2ac3e67e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:02:15.616559 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b8e5c-915d-41e7-85e0-fdf97b282a1a service placement] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:02:15.616887 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b8e5c-915d-41e7-85e0-fdf97b282a1a service placement] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:02:15.617207 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b8e5c-915d-41e7-85e0-fdf97b282a1a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:02:15.620820 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-417b8e5c-915d-41e7-85e0-fdf97b282a1a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:02:15.634945 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b8e5c-915d-41e7-85e0-fdf97b282a1a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:02:15.637000 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b8e5c-915d-41e7-85e0-fdf97b282a1a service placement] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:02:15.651875 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1358/2721] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:02:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:02:23.180488 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2d663-fab9-474b-8f7f-80ab25b01f27 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:02:23.181347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2d663-fab9-474b-8f7f-80ab25b01f27 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:02:23.181347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2d663-fab9-474b-8f7f-80ab25b01f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:02:23.200657 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-72c2d663-fab9-474b-8f7f-80ab25b01f27 None None] MFA Rules not processed for user `7bc354ee86ff4d3e9438427fea3b0a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:02:23.202042 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-72c2d663-fab9-474b-8f7f-80ab25b01f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:02:23.209642 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1364/2722] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:02:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:02:25.645796 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=93 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:02:30.576888 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb737862-feff-41a9-9776-280392db8b7f None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:02:30.577641 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb737862-feff-41a9-9776-280392db8b7f None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:02:30.577641 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb737862-feff-41a9-9776-280392db8b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:02:30.597833 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-fb737862-feff-41a9-9776-280392db8b7f None None] MFA Rules not processed for user `b3c1d56bc0a64411a68f97a4417b0379`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:02:30.599052 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-fb737862-feff-41a9-9776-280392db8b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:02:30.606367 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1359/2723] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Jul 25 09:02:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:02:30.620120 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2d663-fab9-474b-8f7f-80ab25b01f27 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:02:30.632242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2d663-fab9-474b-8f7f-80ab25b01f27 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:02:30.638179 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4e4c8-f166-4df2-8bbb-285814cadfb4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2763e540681547d3a6677567b3be86ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:02:30.638831 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4e4c8-f166-4df2-8bbb-285814cadfb4 service swift] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:02:30.639117 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4e4c8-f166-4df2-8bbb-285814cadfb4 service swift] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:02:30.639392 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4e4c8-f166-4df2-8bbb-285814cadfb4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:02:30.649376 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc4e4c8-f166-4df2-8bbb-285814cadfb4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:02:30.651403 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc4e4c8-f166-4df2-8bbb-285814cadfb4 service swift] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:02:30.661952 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1365/2724] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Jul 25 09:02:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 09:02:31.187449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb737862-feff-41a9-9776-280392db8b7f None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:02:31.189175 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-fb737862-feff-41a9-9776-280392db8b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:02:31.365978 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb737862-feff-41a9-9776-280392db8b7f None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:02:31.380459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73377c0d-6667-48ef-be91-149a407404b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:02:31.381170 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73377c0d-6667-48ef-be91-149a407404b5 service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:02:31.381458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73377c0d-6667-48ef-be91-149a407404b5 service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:02:31.381745 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73377c0d-6667-48ef-be91-149a407404b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:02:31.385021 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-73377c0d-6667-48ef-be91-149a407404b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:02:31.406119 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73377c0d-6667-48ef-be91-149a407404b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:02:31.408095 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73377c0d-6667-48ef-be91-149a407404b5 service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:02:31.440332 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1360/2725] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:02:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:02:40.658044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:02:41.424464 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=37 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:02:51.164795 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4e4c8-f166-4df2-8bbb-285814cadfb4 service swift] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:02:51.167257 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-5fc4e4c8-f166-4df2-8bbb-285814cadfb4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:02:51.183467 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4e4c8-f166-4df2-8bbb-285814cadfb4 service swift] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:02:51.188914 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09aea3-1a2f-469c-8d36-ec3e78d02c8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:02:51.189545 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09aea3-1a2f-469c-8d36-ec3e78d02c8f service nova] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:02:51.189828 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09aea3-1a2f-469c-8d36-ec3e78d02c8f service nova] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:02:51.190101 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09aea3-1a2f-469c-8d36-ec3e78d02c8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:02:51.191857 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-bf09aea3-1a2f-469c-8d36-ec3e78d02c8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:02:51.202275 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09aea3-1a2f-469c-8d36-ec3e78d02c8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:02:51.203933 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09aea3-1a2f-469c-8d36-ec3e78d02c8f service nova] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:02:51.213733 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1366/2726] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:02:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:02:59.964387 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73377c0d-6667-48ef-be91-149a407404b5 service nova] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:03:00.025466 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73377c0d-6667-48ef-be91-149a407404b5 service nova] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:03:00.030252 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df220ae-92c0-49d6-bc17-67e1fd518196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:03:00.031113 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df220ae-92c0-49d6-bc17-67e1fd518196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:03:00.031398 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df220ae-92c0-49d6-bc17-67e1fd518196 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:03:00.031705 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df220ae-92c0-49d6-bc17-67e1fd518196 admin admin] PATH_INFO: `/v3/users/8c9c54beebdd42fba56b4d3c204a432c` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:03:00.032888 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df220ae-92c0-49d6-bc17-67e1fd518196 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c9c54beebdd42fba56b4d3c204a432c)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:03:00.034784 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df220ae-92c0-49d6-bc17-67e1fd518196 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:03:00.272087 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4df220ae-92c0-49d6-bc17-67e1fd518196 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c9c54beebdd42fba56b4d3c204a432c'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:03:00.273103 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4df220ae-92c0-49d6-bc17-67e1fd518196 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c9c54beebdd42fba56b4d3c204a432c'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:03:00.280705 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4df220ae-92c0-49d6-bc17-67e1fd518196 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c9c54beebdd42fba56b4d3c204a432c'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:03:00.284980 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4df220ae-92c0-49d6-bc17-67e1fd518196 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c9c54beebdd42fba56b4d3c204a432c'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:03:00.369052 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4df220ae-92c0-49d6-bc17-67e1fd518196 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c9c54beebdd42fba56b4d3c204a432c'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:03:00.387559 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1361/2727] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:02:59 2022] DELETE /identity/v3/users/8c9c54beebdd42fba56b4d3c204a432c => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:03:00.392465 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ef637-e6a8-41d0-b600-e48617f2cb01 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:03:00.393135 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ef637-e6a8-41d0-b600-e48617f2cb01 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:03:00.393135 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ef637-e6a8-41d0-b600-e48617f2cb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:03:00.412876 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-c99ef637-e6a8-41d0-b600-e48617f2cb01 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:03:00.414080 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-c99ef637-e6a8-41d0-b600-e48617f2cb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:03:00.474772 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1367/2728] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:03:00.485927 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df220ae-92c0-49d6-bc17-67e1fd518196 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:03:00.487312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4df220ae-92c0-49d6-bc17-67e1fd518196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:03:00.544508 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df220ae-92c0-49d6-bc17-67e1fd518196 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:03:00.548064 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eab9c8-b495-4058-9442-dc9dfbc9a2a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:03:00.548738 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eab9c8-b495-4058-9442-dc9dfbc9a2a7 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:03:00.549024 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eab9c8-b495-4058-9442-dc9dfbc9a2a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:03:00.549306 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eab9c8-b495-4058-9442-dc9dfbc9a2a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:03:00.559095 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eab9c8-b495-4058-9442-dc9dfbc9a2a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:03:00.560706 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eab9c8-b495-4058-9442-dc9dfbc9a2a7 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:03:00.570296 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1362/2729] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:03:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:03:00.964320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ef637-e6a8-41d0-b600-e48617f2cb01 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:03:00.967795 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-c99ef637-e6a8-41d0-b600-e48617f2cb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:03:00.981053 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ef637-e6a8-41d0-b600-e48617f2cb01 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:03:00.986128 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2975892-5708-4534-8efa-43ac7f1229fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:03:00.987011 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2975892-5708-4534-8efa-43ac7f1229fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:03:00.987281 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2975892-5708-4534-8efa-43ac7f1229fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:03:00.987782 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2975892-5708-4534-8efa-43ac7f1229fe admin admin] PATH_INFO: `/v3/projects/e08c4160d9844f93a99ffd484aafe4b1` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:03:00.989113 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2975892-5708-4534-8efa-43ac7f1229fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=e08c4160d9844f93a99ffd484aafe4b1)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:03:00.991031 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2975892-5708-4534-8efa-43ac7f1229fe admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:03:01.107141 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-d2975892-5708-4534-8efa-43ac7f1229fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e08c4160d9844f93a99ffd484aafe4b1', 'request_id': 'req-d2975892-5708-4534-8efa-43ac7f1229fe'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:03:01.113819 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-d2975892-5708-4534-8efa-43ac7f1229fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e08c4160d9844f93a99ffd484aafe4b1', 'request_id': 'req-d2975892-5708-4534-8efa-43ac7f1229fe'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:03:01.119453 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-d2975892-5708-4534-8efa-43ac7f1229fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e08c4160d9844f93a99ffd484aafe4b1', 'request_id': 'req-d2975892-5708-4534-8efa-43ac7f1229fe'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:03:01.185641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-d2975892-5708-4534-8efa-43ac7f1229fe admin admin] The token cache is being invalidate because project e08c4160d9844f93a99ffd484aafe4b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:03:01.185933 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-d2975892-5708-4534-8efa-43ac7f1229fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:03:01.186574 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-d2975892-5708-4534-8efa-43ac7f1229fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:03:01.188158 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1368/2730] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:03:00 2022] DELETE /identity/v3/projects/e08c4160d9844f93a99ffd484aafe4b1 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:03:01.193035 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16dd59-e6a0-4819-aad8-a2cab0c87805 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:03:01.193501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16dd59-e6a0-4819-aad8-a2cab0c87805 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:03:01.193600 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16dd59-e6a0-4819-aad8-a2cab0c87805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:03:01.213463 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-4b16dd59-e6a0-4819-aad8-a2cab0c87805 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:03:01.215280 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4b16dd59-e6a0-4819-aad8-a2cab0c87805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:03:01.233455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:03:01.278522 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1363/2731] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:03:01.286379 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d223ee-2d72-4320-9613-5b5af5ae0b9f None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:03:01.286675 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d223ee-2d72-4320-9613-5b5af5ae0b9f None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:03:01.286982 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d223ee-2d72-4320-9613-5b5af5ae0b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:03:01.306875 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-e5d223ee-2d72-4320-9613-5b5af5ae0b9f None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:03:01.312273 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-e5d223ee-2d72-4320-9613-5b5af5ae0b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:03:01.316723 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1369/2732] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:03:01.321001 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16dd59-e6a0-4819-aad8-a2cab0c87805 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:03:01.332290 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16dd59-e6a0-4819-aad8-a2cab0c87805 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:03:01.337234 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec440d-962a-4ca7-b5be-340bedf18558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:03:01.337937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec440d-962a-4ca7-b5be-340bedf18558 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:03:01.338292 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec440d-962a-4ca7-b5be-340bedf18558 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:03:01.338571 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec440d-962a-4ca7-b5be-340bedf18558 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:03:01.339318 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec440d-962a-4ca7-b5be-340bedf18558 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:03:01.340312 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec440d-962a-4ca7-b5be-340bedf18558 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:03:01.342044 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec440d-962a-4ca7-b5be-340bedf18558 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:03:01.358167 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1364/2733] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 09:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:03:01.362042 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d223ee-2d72-4320-9613-5b5af5ae0b9f None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:03:01.371822 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d223ee-2d72-4320-9613-5b5af5ae0b9f None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:03:01.377042 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f56b3a-1926-467b-bea7-98f489ebe61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:03:01.377703 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f56b3a-1926-467b-bea7-98f489ebe61b admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:03:01.377987 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f56b3a-1926-467b-bea7-98f489ebe61b admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:03:01.378259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f56b3a-1926-467b-bea7-98f489ebe61b admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:03:01.378967 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f56b3a-1926-467b-bea7-98f489ebe61b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:03:01.381062 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f56b3a-1926-467b-bea7-98f489ebe61b admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:03:01.491289 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1370/2734] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 09:03:01 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:03:01.494824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec440d-962a-4ca7-b5be-340bedf18558 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:03:01.505920 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec440d-962a-4ca7-b5be-340bedf18558 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:03:01.564700 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac684ebf-e362-468e-84e4-f69d3235b61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:03:01.565418 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac684ebf-e362-468e-84e4-f69d3235b61d admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:03:01.565707 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac684ebf-e362-468e-84e4-f69d3235b61d admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:03:01.566017 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac684ebf-e362-468e-84e4-f69d3235b61d admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:03:01.566730 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac684ebf-e362-468e-84e4-f69d3235b61d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:03:01.568716 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac684ebf-e362-468e-84e4-f69d3235b61d admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:03:01.677702 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1365/2735] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 09:03:01 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:03:01.681649 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f56b3a-1926-467b-bea7-98f489ebe61b admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:03:01.693216 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f56b3a-1926-467b-bea7-98f489ebe61b admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:03:01.698150 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20138de4-e2cb-4f04-9dfe-85505078c563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:03:01.699508 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20138de4-e2cb-4f04-9dfe-85505078c563 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:03:01.699856 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20138de4-e2cb-4f04-9dfe-85505078c563 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:03:01.700217 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20138de4-e2cb-4f04-9dfe-85505078c563 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:03:01.701271 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20138de4-e2cb-4f04-9dfe-85505078c563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:03:01.702916 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20138de4-e2cb-4f04-9dfe-85505078c563 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:03:01.713659 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1371/2736] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:03:01.717642 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac684ebf-e362-468e-84e4-f69d3235b61d admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:03:01.727538 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac684ebf-e362-468e-84e4-f69d3235b61d admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:03:01.732425 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976efaca-1eea-4368-b278-c04956a55f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:03:01.733077 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976efaca-1eea-4368-b278-c04956a55f75 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:03:01.733362 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976efaca-1eea-4368-b278-c04956a55f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:03:01.733636 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976efaca-1eea-4368-b278-c04956a55f75 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:03:01.734359 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976efaca-1eea-4368-b278-c04956a55f75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:03:01.735984 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976efaca-1eea-4368-b278-c04956a55f75 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:03:01.747985 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1366/2737] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:03:01.752195 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20138de4-e2cb-4f04-9dfe-85505078c563 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:03:01.762606 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20138de4-e2cb-4f04-9dfe-85505078c563 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:03:01.767367 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a08b8-9b15-486b-ab82-57845c3396fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:03:01.768282 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a08b8-9b15-486b-ab82-57845c3396fa admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:03:01.768566 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a08b8-9b15-486b-ab82-57845c3396fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:03:01.768840 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a08b8-9b15-486b-ab82-57845c3396fa admin admin] PATH_INFO: `/v3/projects/163d9032a7504403b56a0cc1978d6dc9/users/8cc8b522162140f7bb7bd50967433775/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:03:01.783472 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a08b8-9b15-486b-ab82-57845c3396fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=163d9032a7504403b56a0cc1978d6dc9, user_id=8cc8b522162140f7bb7bd50967433775, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:03:01.786141 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a08b8-9b15-486b-ab82-57845c3396fa admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:03:01.861049 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1372/2738] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:03:01 2022] PUT /identity/v3/projects/163d9032a7504403b56a0cc1978d6dc9/users/8cc8b522162140f7bb7bd50967433775/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:03:01.873445 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca1c68-2372-4151-ac9d-6c8b170dd365 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:03:01.873737 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca1c68-2372-4151-ac9d-6c8b170dd365 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:03:01.874016 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca1c68-2372-4151-ac9d-6c8b170dd365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:03:01.901020 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-54ca1c68-2372-4151-ac9d-6c8b170dd365 None None] MFA Rules not processed for user `8cc8b522162140f7bb7bd50967433775`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:03:01.902262 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-54ca1c68-2372-4151-ac9d-6c8b170dd365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:03:01.965745 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1367/2739] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:03:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:03:01.976828 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a08b8-9b15-486b-ab82-57845c3396fa admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:03:01.978512 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-189a08b8-9b15-486b-ab82-57845c3396fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:03:01.989275 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:03:02.036359 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a08b8-9b15-486b-ab82-57845c3396fa admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:03:02.040088 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ca538-fbc0-4467-8352-91590b5fa24d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:03:02.040733 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ca538-fbc0-4467-8352-91590b5fa24d service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:03:02.041018 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ca538-fbc0-4467-8352-91590b5fa24d service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:03:02.041296 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ca538-fbc0-4467-8352-91590b5fa24d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:03:02.050638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ca538-fbc0-4467-8352-91590b5fa24d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:03:02.052241 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ca538-fbc0-4467-8352-91590b5fa24d service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:03:02.061863 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1373/2740] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:03:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:03:05.023044 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca1c68-2372-4151-ac9d-6c8b170dd365 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:03:05.045052 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:03:05.090752 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca1c68-2372-4151-ac9d-6c8b170dd365 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:03:05.096599 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be50009-2f4f-4648-be02-3c15172706fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:03:05.097474 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be50009-2f4f-4648-be02-3c15172706fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:03:05.097763 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be50009-2f4f-4648-be02-3c15172706fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:03:05.098037 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be50009-2f4f-4648-be02-3c15172706fb admin admin] PATH_INFO: `/v3/users/8cc8b522162140f7bb7bd50967433775` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:03:05.099355 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be50009-2f4f-4648-be02-3c15172706fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cc8b522162140f7bb7bd50967433775)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:03:05.101819 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be50009-2f4f-4648-be02-3c15172706fb admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:03:05.285796 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7be50009-2f4f-4648-be02-3c15172706fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cc8b522162140f7bb7bd50967433775'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:03:05.286457 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7be50009-2f4f-4648-be02-3c15172706fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cc8b522162140f7bb7bd50967433775'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:03:05.294116 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7be50009-2f4f-4648-be02-3c15172706fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cc8b522162140f7bb7bd50967433775'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:03:05.294745 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7be50009-2f4f-4648-be02-3c15172706fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cc8b522162140f7bb7bd50967433775'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:03:05.345566 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7be50009-2f4f-4648-be02-3c15172706fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cc8b522162140f7bb7bd50967433775'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:03:05.364787 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1368/2741] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:03:05 2022] DELETE /identity/v3/users/8cc8b522162140f7bb7bd50967433775 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:03:05.369361 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c5374-1e32-413b-88b3-6e24e8f6412c None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:03:05.369824 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c5374-1e32-413b-88b3-6e24e8f6412c None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:03:05.369943 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c5374-1e32-413b-88b3-6e24e8f6412c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:03:05.392248 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-ce0c5374-1e32-413b-88b3-6e24e8f6412c None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:03:05.393505 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-ce0c5374-1e32-413b-88b3-6e24e8f6412c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:03:05.461405 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1374/2742] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:03:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:03:05.471896 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be50009-2f4f-4648-be02-3c15172706fb admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:03:05.473336 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-7be50009-2f4f-4648-be02-3c15172706fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:03:05.531389 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be50009-2f4f-4648-be02-3c15172706fb admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:03:05.535131 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764d65e-97f7-4d83-b61a-5fddd1f1409c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:03:05.535755 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764d65e-97f7-4d83-b61a-5fddd1f1409c service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:03:05.536042 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764d65e-97f7-4d83-b61a-5fddd1f1409c service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:03:05.536319 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764d65e-97f7-4d83-b61a-5fddd1f1409c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:03:05.546861 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764d65e-97f7-4d83-b61a-5fddd1f1409c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:03:05.548313 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764d65e-97f7-4d83-b61a-5fddd1f1409c service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:03:05.557898 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1369/2743] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:03:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:03:05.976165 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c5374-1e32-413b-88b3-6e24e8f6412c None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:03:05.977575 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-ce0c5374-1e32-413b-88b3-6e24e8f6412c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:03:05.992311 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c5374-1e32-413b-88b3-6e24e8f6412c None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:03:05.997736 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeaca42-aabe-4266-abfc-0d134fbaa659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:03:05.999284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeaca42-aabe-4266-abfc-0d134fbaa659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:03:05.999576 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeaca42-aabe-4266-abfc-0d134fbaa659 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:03:05.999899 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeaca42-aabe-4266-abfc-0d134fbaa659 admin admin] PATH_INFO: `/v3/projects/163d9032a7504403b56a0cc1978d6dc9` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:03:06.001328 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeaca42-aabe-4266-abfc-0d134fbaa659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=163d9032a7504403b56a0cc1978d6dc9)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:03:06.003685 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeaca42-aabe-4266-abfc-0d134fbaa659 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:03:06.111898 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-2eeaca42-aabe-4266-abfc-0d134fbaa659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '163d9032a7504403b56a0cc1978d6dc9', 'request_id': 'req-2eeaca42-aabe-4266-abfc-0d134fbaa659'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:03:06.118336 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-2eeaca42-aabe-4266-abfc-0d134fbaa659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '163d9032a7504403b56a0cc1978d6dc9', 'request_id': 'req-2eeaca42-aabe-4266-abfc-0d134fbaa659'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:03:06.125023 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-2eeaca42-aabe-4266-abfc-0d134fbaa659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '163d9032a7504403b56a0cc1978d6dc9', 'request_id': 'req-2eeaca42-aabe-4266-abfc-0d134fbaa659'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:03:06.185765 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-2eeaca42-aabe-4266-abfc-0d134fbaa659 admin admin] The token cache is being invalidate because project 163d9032a7504403b56a0cc1978d6dc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:03:06.185965 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-2eeaca42-aabe-4266-abfc-0d134fbaa659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:03:06.186542 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-2eeaca42-aabe-4266-abfc-0d134fbaa659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:03:06.188141 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1375/2744] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:03:05 2022] DELETE /identity/v3/projects/163d9032a7504403b56a0cc1978d6dc9 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:03:13.524301 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764d65e-97f7-4d83-b61a-5fddd1f1409c service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:03:13.525735 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d764d65e-97f7-4d83-b61a-5fddd1f1409c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:03:13.537663 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764d65e-97f7-4d83-b61a-5fddd1f1409c service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:03:13.575632 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:03:13.586620 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5eb4d-36e3-42f4-b8fd-508a2b15d338 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:03:13.587272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5eb4d-36e3-42f4-b8fd-508a2b15d338 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:03:13.588545 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5eb4d-36e3-42f4-b8fd-508a2b15d338 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:03:13.588545 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5eb4d-36e3-42f4-b8fd-508a2b15d338 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:03:13.589877 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-7ee5eb4d-36e3-42f4-b8fd-508a2b15d338 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:03:13.655297 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5eb4d-36e3-42f4-b8fd-508a2b15d338 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:03:13.656756 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5eb4d-36e3-42f4-b8fd-508a2b15d338 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:03:13.666484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1370/2745] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:03:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 09:03:16.181987 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:03:23.694094 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=32 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:03:56.382996 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeaca42-aabe-4266-abfc-0d134fbaa659 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:03:56.386093 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-2eeaca42-aabe-4266-abfc-0d134fbaa659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:03:56.397320 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeaca42-aabe-4266-abfc-0d134fbaa659 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:03:56.401345 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b993ae5-f8cd-4708-87be-770d8115e8d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:03:56.402024 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b993ae5-f8cd-4708-87be-770d8115e8d3 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:03:56.402303 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b993ae5-f8cd-4708-87be-770d8115e8d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:03:56.402578 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b993ae5-f8cd-4708-87be-770d8115e8d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:03:56.404348 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-1b993ae5-f8cd-4708-87be-770d8115e8d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:03:56.469467 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b993ae5-f8cd-4708-87be-770d8115e8d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:03:56.470858 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b993ae5-f8cd-4708-87be-770d8115e8d3 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:03:56.481572 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1376/2746] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:03:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 09:04:03.677732 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5eb4d-36e3-42f4-b8fd-508a2b15d338 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:04:03.679778 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-7ee5eb4d-36e3-42f4-b8fd-508a2b15d338 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:04:03.759513 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5eb4d-36e3-42f4-b8fd-508a2b15d338 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:04:03.764515 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539c120-514f-47b2-aa62-ba89d9898d66 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfb4be75496444dd897b880c2ac3e67e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:04:03.765445 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539c120-514f-47b2-aa62-ba89d9898d66 service placement] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:04:03.765445 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539c120-514f-47b2-aa62-ba89d9898d66 service placement] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:04:03.765713 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539c120-514f-47b2-aa62-ba89d9898d66 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:04:03.767499 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f539c120-514f-47b2-aa62-ba89d9898d66 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:04:03.781143 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f539c120-514f-47b2-aa62-ba89d9898d66 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:04:03.783030 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f539c120-514f-47b2-aa62-ba89d9898d66 service placement] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:04:03.798673 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b993ae5-f8cd-4708-87be-770d8115e8d3 service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:04:03.800206 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-1b993ae5-f8cd-4708-87be-770d8115e8d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:04:03.807727 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1371/2747] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:04:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:04:03.815156 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b993ae5-f8cd-4708-87be-770d8115e8d3 service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:04:03.820344 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74352f02-508c-4010-a5f7-79b66d4edbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:04:03.821179 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74352f02-508c-4010-a5f7-79b66d4edbbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:04:03.821469 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74352f02-508c-4010-a5f7-79b66d4edbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:04:03.821748 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74352f02-508c-4010-a5f7-79b66d4edbbc admin admin] PATH_INFO: `/v3/users/a68b8d62ceb940469ef66df571f9a7e7` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:04:03.836835 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74352f02-508c-4010-a5f7-79b66d4edbbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a68b8d62ceb940469ef66df571f9a7e7)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:04:03.838772 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74352f02-508c-4010-a5f7-79b66d4edbbc admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:04:04.009422 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-74352f02-508c-4010-a5f7-79b66d4edbbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a68b8d62ceb940469ef66df571f9a7e7'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:04:04.010126 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-74352f02-508c-4010-a5f7-79b66d4edbbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a68b8d62ceb940469ef66df571f9a7e7'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:04:04.010682 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-74352f02-508c-4010-a5f7-79b66d4edbbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a68b8d62ceb940469ef66df571f9a7e7'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:04:04.017624 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-74352f02-508c-4010-a5f7-79b66d4edbbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a68b8d62ceb940469ef66df571f9a7e7'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:04:04.081066 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-74352f02-508c-4010-a5f7-79b66d4edbbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a68b8d62ceb940469ef66df571f9a7e7'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:04:04.101893 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1377/2748] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:04:03 2022] DELETE /identity/v3/users/a68b8d62ceb940469ef66df571f9a7e7 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:04:04.340689 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539c120-514f-47b2-aa62-ba89d9898d66 service placement] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:04:04.352071 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539c120-514f-47b2-aa62-ba89d9898d66 service placement] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:04:04.426890 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3047b3-956c-4946-8649-c2cf6340e952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:04:04.427830 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3047b3-956c-4946-8649-c2cf6340e952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:04:04.428147 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3047b3-956c-4946-8649-c2cf6340e952 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:04:04.428430 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3047b3-956c-4946-8649-c2cf6340e952 admin admin] PATH_INFO: `/v3/projects/512c4d8a58ae44ad9d33280f3adf08eb` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:04:04.439413 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3047b3-956c-4946-8649-c2cf6340e952 admin admin] RBAC: Authorizing `identity:delete_project(project_id=512c4d8a58ae44ad9d33280f3adf08eb)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:04:04.441368 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3047b3-956c-4946-8649-c2cf6340e952 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:04:04.544193 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-9f3047b3-956c-4946-8649-c2cf6340e952 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '512c4d8a58ae44ad9d33280f3adf08eb', 'request_id': 'req-9f3047b3-956c-4946-8649-c2cf6340e952'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:04:04.550851 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-9f3047b3-956c-4946-8649-c2cf6340e952 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '512c4d8a58ae44ad9d33280f3adf08eb', 'request_id': 'req-9f3047b3-956c-4946-8649-c2cf6340e952'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:04:04.562420 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-9f3047b3-956c-4946-8649-c2cf6340e952 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '512c4d8a58ae44ad9d33280f3adf08eb', 'request_id': 'req-9f3047b3-956c-4946-8649-c2cf6340e952'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:04:04.647336 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-9f3047b3-956c-4946-8649-c2cf6340e952 admin admin] The token cache is being invalidate because project 512c4d8a58ae44ad9d33280f3adf08eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:04:04.647634 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-9f3047b3-956c-4946-8649-c2cf6340e952 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:04:04.648266 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-9f3047b3-956c-4946-8649-c2cf6340e952 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:04:04.649859 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1372/2749] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:04:04 2022] DELETE /identity/v3/projects/512c4d8a58ae44ad9d33280f3adf08eb => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:04:04.653777 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74352f02-508c-4010-a5f7-79b66d4edbbc admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:04:04.655194 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-74352f02-508c-4010-a5f7-79b66d4edbbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:04:04.668745 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74352f02-508c-4010-a5f7-79b66d4edbbc admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:04:04.721178 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:04:04.727859 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63126a-cc2a-478b-a869-dde4ae316bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:04:04.728742 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63126a-cc2a-478b-a869-dde4ae316bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:04:04.729106 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63126a-cc2a-478b-a869-dde4ae316bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:04:04.729391 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63126a-cc2a-478b-a869-dde4ae316bc8 admin admin] PATH_INFO: `/v3/users/532aea5062f946ddbc5dc3d78c62c47b` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:04:04.743819 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63126a-cc2a-478b-a869-dde4ae316bc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=532aea5062f946ddbc5dc3d78c62c47b)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:04:04.746427 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63126a-cc2a-478b-a869-dde4ae316bc8 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:04:04.906667 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-cd63126a-cc2a-478b-a869-dde4ae316bc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '532aea5062f946ddbc5dc3d78c62c47b'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:04:04.907317 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-cd63126a-cc2a-478b-a869-dde4ae316bc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '532aea5062f946ddbc5dc3d78c62c47b'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:04:04.907843 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-cd63126a-cc2a-478b-a869-dde4ae316bc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '532aea5062f946ddbc5dc3d78c62c47b'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:04:04.914862 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-cd63126a-cc2a-478b-a869-dde4ae316bc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '532aea5062f946ddbc5dc3d78c62c47b'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:04:04.961222 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-cd63126a-cc2a-478b-a869-dde4ae316bc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '532aea5062f946ddbc5dc3d78c62c47b'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:04:04.980110 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1378/2750] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:04:04 2022] DELETE /identity/v3/users/532aea5062f946ddbc5dc3d78c62c47b => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:04:05.192039 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3047b3-956c-4946-8649-c2cf6340e952 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:04:05.193630 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9f3047b3-956c-4946-8649-c2cf6340e952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:04:05.206850 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3047b3-956c-4946-8649-c2cf6340e952 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:04:05.216485 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:04:05.267277 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b52852-7450-4b73-a9a4-1a604fc00790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:04:05.268176 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b52852-7450-4b73-a9a4-1a604fc00790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:04:05.268459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b52852-7450-4b73-a9a4-1a604fc00790 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:04:05.268734 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b52852-7450-4b73-a9a4-1a604fc00790 admin admin] PATH_INFO: `/v3/projects/c4dbcf21c87342d486ea9f412712d08d` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:04:05.280669 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b52852-7450-4b73-a9a4-1a604fc00790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4dbcf21c87342d486ea9f412712d08d)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:04:05.282701 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b52852-7450-4b73-a9a4-1a604fc00790 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:04:05.368687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-39b52852-7450-4b73-a9a4-1a604fc00790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4dbcf21c87342d486ea9f412712d08d', 'request_id': 'req-39b52852-7450-4b73-a9a4-1a604fc00790'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:04:05.375457 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-39b52852-7450-4b73-a9a4-1a604fc00790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4dbcf21c87342d486ea9f412712d08d', 'request_id': 'req-39b52852-7450-4b73-a9a4-1a604fc00790'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:04:05.380958 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-39b52852-7450-4b73-a9a4-1a604fc00790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4dbcf21c87342d486ea9f412712d08d', 'request_id': 'req-39b52852-7450-4b73-a9a4-1a604fc00790'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:04:05.440646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-39b52852-7450-4b73-a9a4-1a604fc00790 admin admin] The token cache is being invalidate because project c4dbcf21c87342d486ea9f412712d08d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:04:05.440857 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-39b52852-7450-4b73-a9a4-1a604fc00790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:04:05.441466 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-39b52852-7450-4b73-a9a4-1a604fc00790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:04:05.443020 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1373/2751] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:04:05 2022] DELETE /identity/v3/projects/c4dbcf21c87342d486ea9f412712d08d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:04:14.976024 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=33,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:04:15.453574 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=50,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:04:28.181459 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63126a-cc2a-478b-a869-dde4ae316bc8 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:04:28.182897 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-cd63126a-cc2a-478b-a869-dde4ae316bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:04:28.398963 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63126a-cc2a-478b-a869-dde4ae316bc8 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:04:28.483063 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae51ee9-31bd-423e-8bb1-a7e13cb19d49 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfb4be75496444dd897b880c2ac3e67e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:04:28.484102 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae51ee9-31bd-423e-8bb1-a7e13cb19d49 service placement] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:04:28.484504 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae51ee9-31bd-423e-8bb1-a7e13cb19d49 service placement] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:04:28.485538 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae51ee9-31bd-423e-8bb1-a7e13cb19d49 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:04:28.487894 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-cae51ee9-31bd-423e-8bb1-a7e13cb19d49 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:04:28.501954 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae51ee9-31bd-423e-8bb1-a7e13cb19d49 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:04:28.505336 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae51ee9-31bd-423e-8bb1-a7e13cb19d49 service placement] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:04:28.523812 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1379/2752] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:04:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:04:33.076104 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080a71c-0bb4-4928-ac33-14ba79d740ff None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:04:33.076647 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080a71c-0bb4-4928-ac33-14ba79d740ff None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:04:33.076647 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080a71c-0bb4-4928-ac33-14ba79d740ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:04:33.096028 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-b080a71c-0bb4-4928-ac33-14ba79d740ff None None] MFA Rules not processed for user `fa467b0890784cabbd6bcad011ee1c91`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:04:33.098349 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b080a71c-0bb4-4928-ac33-14ba79d740ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:04:33.153715 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1374/2753] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:04:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:04:33.465432 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae51ee9-31bd-423e-8bb1-a7e13cb19d49 service placement] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:04:33.466901 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-cae51ee9-31bd-423e-8bb1-a7e13cb19d49 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:04:33.521743 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae51ee9-31bd-423e-8bb1-a7e13cb19d49 service placement] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:04:33.525285 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8f77a-4e4a-45ea-9551-93edf9d29ebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:04:33.527765 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8f77a-4e4a-45ea-9551-93edf9d29ebf service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:04:33.527765 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8f77a-4e4a-45ea-9551-93edf9d29ebf service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:04:33.527765 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8f77a-4e4a-45ea-9551-93edf9d29ebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:04:33.528341 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-5bd8f77a-4e4a-45ea-9551-93edf9d29ebf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:04:33.537783 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8f77a-4e4a-45ea-9551-93edf9d29ebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:04:33.539214 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8f77a-4e4a-45ea-9551-93edf9d29ebf service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:04:33.546955 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1380/2754] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:04:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:04:43.147333 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=25 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:04:43.543442 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=84 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:05:36.275051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080a71c-0bb4-4928-ac33-14ba79d740ff None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:05:36.284950 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080a71c-0bb4-4928-ac33-14ba79d740ff None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:05:36.288503 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848c310-f8e3-437b-ad65-2ba8e155893a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:05:36.290390 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848c310-f8e3-437b-ad65-2ba8e155893a service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:05:36.290390 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848c310-f8e3-437b-ad65-2ba8e155893a service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:05:36.290390 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848c310-f8e3-437b-ad65-2ba8e155893a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:05:36.291441 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4848c310-f8e3-437b-ad65-2ba8e155893a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:05:36.362291 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848c310-f8e3-437b-ad65-2ba8e155893a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:05:36.363774 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848c310-f8e3-437b-ad65-2ba8e155893a service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:05:36.374661 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1375/2755] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:05:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:05:36.870983 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8f77a-4e4a-45ea-9551-93edf9d29ebf service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:05:36.872837 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-5bd8f77a-4e4a-45ea-9551-93edf9d29ebf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:05:36.898773 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8f77a-4e4a-45ea-9551-93edf9d29ebf service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:05:36.917883 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5eeb1-d0c4-44a6-a630-2041f67c407a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:05:36.917883 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5eeb1-d0c4-44a6-a630-2041f67c407a service nova] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:05:36.917883 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5eeb1-d0c4-44a6-a630-2041f67c407a service nova] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:05:36.917883 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5eeb1-d0c4-44a6-a630-2041f67c407a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:05:36.918278 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-44f5eeb1-d0c4-44a6-a630-2041f67c407a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:05:36.939481 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5eeb1-d0c4-44a6-a630-2041f67c407a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:05:36.941303 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5eeb1-d0c4-44a6-a630-2041f67c407a service nova] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:05:36.954411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1381/2756] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:05:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:05:42.409201 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848c310-f8e3-437b-ad65-2ba8e155893a service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:05:42.410683 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4848c310-f8e3-437b-ad65-2ba8e155893a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:05:42.421394 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848c310-f8e3-437b-ad65-2ba8e155893a service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:05:42.425109 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32b15c-a8ce-4dee-af0e-dc22f1f2e8dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:05:42.425747 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32b15c-a8ce-4dee-af0e-dc22f1f2e8dc service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:05:42.426035 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32b15c-a8ce-4dee-af0e-dc22f1f2e8dc service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:05:42.426314 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32b15c-a8ce-4dee-af0e-dc22f1f2e8dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:05:42.428071 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-5d32b15c-a8ce-4dee-af0e-dc22f1f2e8dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:05:42.441369 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d32b15c-a8ce-4dee-af0e-dc22f1f2e8dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:05:42.442784 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d32b15c-a8ce-4dee-af0e-dc22f1f2e8dc service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:05:42.454567 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1376/2757] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:05:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:05:44.827597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c0519-a5e7-47a6-8d6f-3ddb8c34f400 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:05:44.840563 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c0519-a5e7-47a6-8d6f-3ddb8c34f400 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:05:44.840563 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c0519-a5e7-47a6-8d6f-3ddb8c34f400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:05:44.847417 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-6c2c0519-a5e7-47a6-8d6f-3ddb8c34f400 None None] MFA Rules not processed for user `b3c1d56bc0a64411a68f97a4417b0379`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:05:44.848765 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-6c2c0519-a5e7-47a6-8d6f-3ddb8c34f400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:05:44.904399 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1382/2758] 10.222.0.18 () {58 vars in 967 bytes} [Mon Jul 25 09:05:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:05:44.949218 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32b15c-a8ce-4dee-af0e-dc22f1f2e8dc service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:05:44.950649 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-5d32b15c-a8ce-4dee-af0e-dc22f1f2e8dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:05:45.021364 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32b15c-a8ce-4dee-af0e-dc22f1f2e8dc service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:05:45.032398 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395d09e-f0ba-4ee8-8cf5-6d58b3f11f97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2763e540681547d3a6677567b3be86ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:05:45.033061 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395d09e-f0ba-4ee8-8cf5-6d58b3f11f97 service swift] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:05:45.033341 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395d09e-f0ba-4ee8-8cf5-6d58b3f11f97 service swift] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:05:45.033617 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395d09e-f0ba-4ee8-8cf5-6d58b3f11f97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:05:45.042198 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395d09e-f0ba-4ee8-8cf5-6d58b3f11f97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:05:45.043803 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395d09e-f0ba-4ee8-8cf5-6d58b3f11f97 service swift] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:05:45.052697 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1377/2759] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Jul 25 09:05:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 09:05:49.515235 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c0519-a5e7-47a6-8d6f-3ddb8c34f400 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:05:49.517835 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-6c2c0519-a5e7-47a6-8d6f-3ddb8c34f400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:05:49.538619 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c0519-a5e7-47a6-8d6f-3ddb8c34f400 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:05:49.543924 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41eb92-5706-4475-ab97-b3526b04a156 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfb4be75496444dd897b880c2ac3e67e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:05:49.544698 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41eb92-5706-4475-ab97-b3526b04a156 service placement] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:05:49.544911 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41eb92-5706-4475-ab97-b3526b04a156 service placement] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:05:49.545186 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41eb92-5706-4475-ab97-b3526b04a156 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:05:49.547181 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-5e41eb92-5706-4475-ab97-b3526b04a156 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:05:49.561115 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41eb92-5706-4475-ab97-b3526b04a156 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:05:49.563527 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41eb92-5706-4475-ab97-b3526b04a156 service placement] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:05:49.574259 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1383/2760] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:05:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:05:53.637982 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395d09e-f0ba-4ee8-8cf5-6d58b3f11f97 service swift] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:05:53.639484 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d395d09e-f0ba-4ee8-8cf5-6d58b3f11f97 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:05:53.706263 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395d09e-f0ba-4ee8-8cf5-6d58b3f11f97 service swift] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:05:53.711070 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e4419-5935-43f9-b367-371eb0cd0569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:05:53.711987 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e4419-5935-43f9-b367-371eb0cd0569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:05:53.712297 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e4419-5935-43f9-b367-371eb0cd0569 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:05:53.712545 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e4419-5935-43f9-b367-371eb0cd0569 admin admin] PATH_INFO: `/v3/users/7bc354ee86ff4d3e9438427fea3b0a6d` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:05:53.713797 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e4419-5935-43f9-b367-371eb0cd0569 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bc354ee86ff4d3e9438427fea3b0a6d)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:05:53.715790 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e4419-5935-43f9-b367-371eb0cd0569 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:05:53.720543 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:05:53.846959 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a29e4419-5935-43f9-b367-371eb0cd0569 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bc354ee86ff4d3e9438427fea3b0a6d'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:05:53.847543 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a29e4419-5935-43f9-b367-371eb0cd0569 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bc354ee86ff4d3e9438427fea3b0a6d'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:05:53.854553 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a29e4419-5935-43f9-b367-371eb0cd0569 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bc354ee86ff4d3e9438427fea3b0a6d'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:05:53.855277 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a29e4419-5935-43f9-b367-371eb0cd0569 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bc354ee86ff4d3e9438427fea3b0a6d'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:05:53.918820 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a29e4419-5935-43f9-b367-371eb0cd0569 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bc354ee86ff4d3e9438427fea3b0a6d'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:05:53.937211 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1378/2761] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:05:53 2022] DELETE /identity/v3/users/7bc354ee86ff4d3e9438427fea3b0a6d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:05:54.236139 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41eb92-5706-4475-ab97-b3526b04a156 service placement] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:05:54.247706 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41eb92-5706-4475-ab97-b3526b04a156 service placement] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:05:54.306829 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474d415-c225-4dca-a413-8fa7ba767ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:05:54.307779 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474d415-c225-4dca-a413-8fa7ba767ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:05:54.308112 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474d415-c225-4dca-a413-8fa7ba767ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:05:54.308437 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474d415-c225-4dca-a413-8fa7ba767ce8 admin admin] PATH_INFO: `/v3/projects/e18fba919fd54e4a99232fe72ff6ece2` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:05:54.309643 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f474d415-c225-4dca-a413-8fa7ba767ce8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e18fba919fd54e4a99232fe72ff6ece2)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:05:54.311566 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f474d415-c225-4dca-a413-8fa7ba767ce8 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:05:54.411110 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-f474d415-c225-4dca-a413-8fa7ba767ce8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e18fba919fd54e4a99232fe72ff6ece2', 'request_id': 'req-f474d415-c225-4dca-a413-8fa7ba767ce8'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:05:54.417372 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-f474d415-c225-4dca-a413-8fa7ba767ce8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e18fba919fd54e4a99232fe72ff6ece2', 'request_id': 'req-f474d415-c225-4dca-a413-8fa7ba767ce8'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:05:54.423583 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-f474d415-c225-4dca-a413-8fa7ba767ce8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e18fba919fd54e4a99232fe72ff6ece2', 'request_id': 'req-f474d415-c225-4dca-a413-8fa7ba767ce8'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:05:54.478956 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-f474d415-c225-4dca-a413-8fa7ba767ce8 admin admin] The token cache is being invalidate because project e18fba919fd54e4a99232fe72ff6ece2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:05:54.479205 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-f474d415-c225-4dca-a413-8fa7ba767ce8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:05:54.479852 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-f474d415-c225-4dca-a413-8fa7ba767ce8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:05:54.481399 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1384/2762] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:05:54 2022] DELETE /identity/v3/projects/e18fba919fd54e4a99232fe72ff6ece2 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:05:54.486176 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e4419-5935-43f9-b367-371eb0cd0569 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:05:54.487602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a29e4419-5935-43f9-b367-371eb0cd0569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:05:54.501302 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e4419-5935-43f9-b367-371eb0cd0569 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:05:54.558265 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a940a-8eb0-4640-8fa5-78a5e95f5480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:05:54.559152 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a940a-8eb0-4640-8fa5-78a5e95f5480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:05:54.559442 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a940a-8eb0-4640-8fa5-78a5e95f5480 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:05:54.559773 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a940a-8eb0-4640-8fa5-78a5e95f5480 admin admin] PATH_INFO: `/v3/users/0e8c62bfd4974f51abba472d5f28d7ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:05:54.560987 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9a940a-8eb0-4640-8fa5-78a5e95f5480 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e8c62bfd4974f51abba472d5f28d7ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:05:54.562997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9a940a-8eb0-4640-8fa5-78a5e95f5480 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:05:54.710765 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7b9a940a-8eb0-4640-8fa5-78a5e95f5480 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e8c62bfd4974f51abba472d5f28d7ed'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:05:54.711438 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7b9a940a-8eb0-4640-8fa5-78a5e95f5480 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e8c62bfd4974f51abba472d5f28d7ed'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:05:54.718614 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7b9a940a-8eb0-4640-8fa5-78a5e95f5480 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e8c62bfd4974f51abba472d5f28d7ed'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:05:54.720356 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7b9a940a-8eb0-4640-8fa5-78a5e95f5480 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e8c62bfd4974f51abba472d5f28d7ed'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:05:54.799437 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7b9a940a-8eb0-4640-8fa5-78a5e95f5480 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e8c62bfd4974f51abba472d5f28d7ed'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:05:54.813618 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:05:54.818059 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1379/2763] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:05:54 2022] DELETE /identity/v3/users/0e8c62bfd4974f51abba472d5f28d7ed => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:05:55.087478 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474d415-c225-4dca-a413-8fa7ba767ce8 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:05:55.088986 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-f474d415-c225-4dca-a413-8fa7ba767ce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:05:55.104153 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474d415-c225-4dca-a413-8fa7ba767ce8 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:05:55.109431 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:05:55.163485 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19295f37-ebcd-413f-a241-a51d61f24611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:05:55.164374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19295f37-ebcd-413f-a241-a51d61f24611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:05:55.164654 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19295f37-ebcd-413f-a241-a51d61f24611 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:05:55.164925 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19295f37-ebcd-413f-a241-a51d61f24611 admin admin] PATH_INFO: `/v3/projects/a91c4d56741f404590d8ca269c147fec` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:05:55.166086 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19295f37-ebcd-413f-a241-a51d61f24611 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a91c4d56741f404590d8ca269c147fec)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:05:55.168021 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19295f37-ebcd-413f-a241-a51d61f24611 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:05:55.301853 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-19295f37-ebcd-413f-a241-a51d61f24611 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a91c4d56741f404590d8ca269c147fec', 'request_id': 'req-19295f37-ebcd-413f-a241-a51d61f24611'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:05:55.307982 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-19295f37-ebcd-413f-a241-a51d61f24611 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a91c4d56741f404590d8ca269c147fec', 'request_id': 'req-19295f37-ebcd-413f-a241-a51d61f24611'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:05:55.315065 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-19295f37-ebcd-413f-a241-a51d61f24611 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a91c4d56741f404590d8ca269c147fec', 'request_id': 'req-19295f37-ebcd-413f-a241-a51d61f24611'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:05:55.404318 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-19295f37-ebcd-413f-a241-a51d61f24611 admin admin] The token cache is being invalidate because project a91c4d56741f404590d8ca269c147fec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:05:55.404520 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-19295f37-ebcd-413f-a241-a51d61f24611 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:05:55.405235 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-19295f37-ebcd-413f-a241-a51d61f24611 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:05:55.407236 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1385/2764] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:05:55 2022] DELETE /identity/v3/projects/a91c4d56741f404590d8ca269c147fec => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:06:05.401092 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:06:21.874352 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a940a-8eb0-4640-8fa5-78a5e95f5480 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:21.875959 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-7b9a940a-8eb0-4640-8fa5-78a5e95f5480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:06:21.960535 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a940a-8eb0-4640-8fa5-78a5e95f5480 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:22.073258 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48afba72-a4be-4550-9776-94bb312ddd70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:22.074247 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afba72-a4be-4550-9776-94bb312ddd70 service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:22.074539 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afba72-a4be-4550-9776-94bb312ddd70 service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:22.074821 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afba72-a4be-4550-9776-94bb312ddd70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:22.078217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-48afba72-a4be-4550-9776-94bb312ddd70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:06:22.096120 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48afba72-a4be-4550-9776-94bb312ddd70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:22.100318 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48afba72-a4be-4550-9776-94bb312ddd70 service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:22.115859 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1380/2765] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:06:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:06:28.565491 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19295f37-ebcd-413f-a241-a51d61f24611 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:28.566903 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-19295f37-ebcd-413f-a241-a51d61f24611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:06:28.625477 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19295f37-ebcd-413f-a241-a51d61f24611 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:28.629096 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a887d-5ac7-487e-bf1c-41807a40dcb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:28.629744 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a887d-5ac7-487e-bf1c-41807a40dcb9 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:28.630055 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a887d-5ac7-487e-bf1c-41807a40dcb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:28.630333 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a887d-5ac7-487e-bf1c-41807a40dcb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:28.632133 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-391a887d-5ac7-487e-bf1c-41807a40dcb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:06:28.694003 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a887d-5ac7-487e-bf1c-41807a40dcb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:28.695474 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a887d-5ac7-487e-bf1c-41807a40dcb9 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:28.705628 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1386/2766] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:06:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:06:32.109225 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=62 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:06:32.382493 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48afba72-a4be-4550-9776-94bb312ddd70 service nova] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:32.384057 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-48afba72-a4be-4550-9776-94bb312ddd70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:06:32.398701 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48afba72-a4be-4550-9776-94bb312ddd70 service nova] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:32.403325 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19cc449-7fa3-4a77-b110-617da26ceb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:32.405522 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19cc449-7fa3-4a77-b110-617da26ceb86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:32.405819 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19cc449-7fa3-4a77-b110-617da26ceb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:32.406100 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19cc449-7fa3-4a77-b110-617da26ceb86 admin admin] PATH_INFO: `/v3/users/fa467b0890784cabbd6bcad011ee1c91` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:32.407299 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19cc449-7fa3-4a77-b110-617da26ceb86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa467b0890784cabbd6bcad011ee1c91)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:32.409298 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19cc449-7fa3-4a77-b110-617da26ceb86 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:32.590732 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-d19cc449-7fa3-4a77-b110-617da26ceb86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa467b0890784cabbd6bcad011ee1c91'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:32.591405 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-d19cc449-7fa3-4a77-b110-617da26ceb86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa467b0890784cabbd6bcad011ee1c91'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:32.599415 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-d19cc449-7fa3-4a77-b110-617da26ceb86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa467b0890784cabbd6bcad011ee1c91'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:32.600147 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-d19cc449-7fa3-4a77-b110-617da26ceb86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa467b0890784cabbd6bcad011ee1c91'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:32.661699 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-d19cc449-7fa3-4a77-b110-617da26ceb86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa467b0890784cabbd6bcad011ee1c91'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:32.682424 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1381/2767] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:06:32 2022] DELETE /identity/v3/users/fa467b0890784cabbd6bcad011ee1c91 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:06:32.898252 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a887d-5ac7-487e-bf1c-41807a40dcb9 service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:32.909676 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a887d-5ac7-487e-bf1c-41807a40dcb9 service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:32.966356 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8da2c-d677-461a-9781-414759c5b65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:32.967855 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8da2c-d677-461a-9781-414759c5b65b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:32.968133 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8da2c-d677-461a-9781-414759c5b65b admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:32.968405 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8da2c-d677-461a-9781-414759c5b65b admin admin] PATH_INFO: `/v3/projects/2c27c41d18654e1587d7056f17868afc` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:32.969596 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f8da2c-d677-461a-9781-414759c5b65b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c27c41d18654e1587d7056f17868afc)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:32.971490 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f8da2c-d677-461a-9781-414759c5b65b admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:33.085069 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-29f8da2c-d677-461a-9781-414759c5b65b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c27c41d18654e1587d7056f17868afc', 'request_id': 'req-29f8da2c-d677-461a-9781-414759c5b65b'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:33.086876 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:06:33.091479 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-29f8da2c-d677-461a-9781-414759c5b65b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c27c41d18654e1587d7056f17868afc', 'request_id': 'req-29f8da2c-d677-461a-9781-414759c5b65b'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:33.097894 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-29f8da2c-d677-461a-9781-414759c5b65b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c27c41d18654e1587d7056f17868afc', 'request_id': 'req-29f8da2c-d677-461a-9781-414759c5b65b'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:33.163272 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-29f8da2c-d677-461a-9781-414759c5b65b admin admin] The token cache is being invalidate because project 2c27c41d18654e1587d7056f17868afc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:06:33.163557 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-29f8da2c-d677-461a-9781-414759c5b65b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:33.164240 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-29f8da2c-d677-461a-9781-414759c5b65b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:33.165818 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1387/2768] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:06:32 2022] DELETE /identity/v3/projects/2c27c41d18654e1587d7056f17868afc => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:06:33.171063 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fdb1f-241e-43ec-a234-6f2e27081a35 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:33.178267 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fdb1f-241e-43ec-a234-6f2e27081a35 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:33.178267 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fdb1f-241e-43ec-a234-6f2e27081a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:33.194625 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-d42fdb1f-241e-43ec-a234-6f2e27081a35 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:06:33.196048 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d42fdb1f-241e-43ec-a234-6f2e27081a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:06:33.255562 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1382/2769] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:06:33.263299 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1947aac-a1d5-4926-9fcf-b4028a6aede5 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:33.264212 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1947aac-a1d5-4926-9fcf-b4028a6aede5 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:33.264497 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1947aac-a1d5-4926-9fcf-b4028a6aede5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:33.284553 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-a1947aac-a1d5-4926-9fcf-b4028a6aede5 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:06:33.285758 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-a1947aac-a1d5-4926-9fcf-b4028a6aede5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:06:33.293930 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1388/2770] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:06:33.298591 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fdb1f-241e-43ec-a234-6f2e27081a35 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:33.308679 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fdb1f-241e-43ec-a234-6f2e27081a35 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:33.313703 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693f877-c78c-45d0-a0e4-1bc371b37465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:33.314359 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693f877-c78c-45d0-a0e4-1bc371b37465 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:33.314646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693f877-c78c-45d0-a0e4-1bc371b37465 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:33.314925 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693f877-c78c-45d0-a0e4-1bc371b37465 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:33.315687 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693f877-c78c-45d0-a0e4-1bc371b37465 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:06:33.315999 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693f877-c78c-45d0-a0e4-1bc371b37465 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:33.317613 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693f877-c78c-45d0-a0e4-1bc371b37465 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:33.329299 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1383/2771] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 09:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:06:33.333520 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1947aac-a1d5-4926-9fcf-b4028a6aede5 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:33.343431 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1947aac-a1d5-4926-9fcf-b4028a6aede5 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:33.348001 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518be261-a7db-49b6-8a48-f59d97377a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:33.348649 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518be261-a7db-49b6-8a48-f59d97377a0d admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:33.348933 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518be261-a7db-49b6-8a48-f59d97377a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:33.349210 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518be261-a7db-49b6-8a48-f59d97377a0d admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:33.349914 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518be261-a7db-49b6-8a48-f59d97377a0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:33.351830 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518be261-a7db-49b6-8a48-f59d97377a0d admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:33.434210 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1389/2772] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 09:06:33 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:06:33.438460 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693f877-c78c-45d0-a0e4-1bc371b37465 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:33.448487 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693f877-c78c-45d0-a0e4-1bc371b37465 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:33.504629 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade0d44-a10a-4b3f-8f26-5e8eb1daf188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:33.505294 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade0d44-a10a-4b3f-8f26-5e8eb1daf188 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:33.505576 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade0d44-a10a-4b3f-8f26-5e8eb1daf188 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:33.506016 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade0d44-a10a-4b3f-8f26-5e8eb1daf188 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:33.506975 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade0d44-a10a-4b3f-8f26-5e8eb1daf188 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:33.508954 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade0d44-a10a-4b3f-8f26-5e8eb1daf188 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:33.517147 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:06:33.581420 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1384/2773] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 09:06:33 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:06:33.585724 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518be261-a7db-49b6-8a48-f59d97377a0d admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:33.596801 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518be261-a7db-49b6-8a48-f59d97377a0d admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:33.601354 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a9743-a5b0-4136-a9ed-8b92da7220a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:33.602015 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a9743-a5b0-4136-a9ed-8b92da7220a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:33.602300 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a9743-a5b0-4136-a9ed-8b92da7220a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:33.602829 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a9743-a5b0-4136-a9ed-8b92da7220a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:33.603410 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a9743-a5b0-4136-a9ed-8b92da7220a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:33.605037 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a9743-a5b0-4136-a9ed-8b92da7220a9 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:33.615731 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1390/2774] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 09:06:33.619959 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade0d44-a10a-4b3f-8f26-5e8eb1daf188 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:33.629827 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade0d44-a10a-4b3f-8f26-5e8eb1daf188 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:33.634493 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44bb2f-f082-4c9b-9a81-dc4f9bd90b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:33.635164 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44bb2f-f082-4c9b-9a81-dc4f9bd90b5b admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:33.635434 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44bb2f-f082-4c9b-9a81-dc4f9bd90b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:33.635741 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44bb2f-f082-4c9b-9a81-dc4f9bd90b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:33.636469 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44bb2f-f082-4c9b-9a81-dc4f9bd90b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:33.638140 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44bb2f-f082-4c9b-9a81-dc4f9bd90b5b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:33.649337 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1385/2775] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:06:33.653503 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a9743-a5b0-4136-a9ed-8b92da7220a9 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:33.664863 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a9743-a5b0-4136-a9ed-8b92da7220a9 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:33.669611 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f63edb-8730-4395-9e4d-661253c024ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:33.670928 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f63edb-8730-4395-9e4d-661253c024ad admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:33.671251 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f63edb-8730-4395-9e4d-661253c024ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:33.671529 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f63edb-8730-4395-9e4d-661253c024ad admin admin] PATH_INFO: `/v3/projects/caeb724a1f4146c294c6277d5af33594/users/968c8ccf45cc4efe913e2e55c1b89195/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:33.686322 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f63edb-8730-4395-9e4d-661253c024ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=caeb724a1f4146c294c6277d5af33594, user_id=968c8ccf45cc4efe913e2e55c1b89195, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:33.689206 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f63edb-8730-4395-9e4d-661253c024ad admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:33.754564 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1391/2776] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:06:33 2022] PUT /identity/v3/projects/caeb724a1f4146c294c6277d5af33594/users/968c8ccf45cc4efe913e2e55c1b89195/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 09:06:33.765702 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fea5cc-9b36-4eac-b261-e0799fe76ad7 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:33.765991 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fea5cc-9b36-4eac-b261-e0799fe76ad7 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:33.766267 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fea5cc-9b36-4eac-b261-e0799fe76ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:33.794050 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-a2fea5cc-9b36-4eac-b261-e0799fe76ad7 None None] MFA Rules not processed for user `968c8ccf45cc4efe913e2e55c1b89195`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:06:33.795430 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a2fea5cc-9b36-4eac-b261-e0799fe76ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:06:33.862880 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1386/2777] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:06:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:06:33.874242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f63edb-8730-4395-9e4d-661253c024ad admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:33.875971 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-93f63edb-8730-4395-9e4d-661253c024ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:06:33.948389 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f63edb-8730-4395-9e4d-661253c024ad admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:33.954566 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40b181-46eb-40c4-accb-70b41326bcee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:33.955215 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40b181-46eb-40c4-accb-70b41326bcee service nova] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:33.955510 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40b181-46eb-40c4-accb-70b41326bcee service nova] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:33.955821 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40b181-46eb-40c4-accb-70b41326bcee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:33.963747 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40b181-46eb-40c4-accb-70b41326bcee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:33.965324 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40b181-46eb-40c4-accb-70b41326bcee service nova] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:33.974640 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1392/2778] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:06:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:06:37.073690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fea5cc-9b36-4eac-b261-e0799fe76ad7 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:37.135683 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fea5cc-9b36-4eac-b261-e0799fe76ad7 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:37.140216 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb80f82-ecad-4344-8ae4-ff49393592c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:37.141297 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb80f82-ecad-4344-8ae4-ff49393592c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:37.141587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb80f82-ecad-4344-8ae4-ff49393592c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:37.141871 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb80f82-ecad-4344-8ae4-ff49393592c8 admin admin] PATH_INFO: `/v3/users/968c8ccf45cc4efe913e2e55c1b89195` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:37.143099 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb80f82-ecad-4344-8ae4-ff49393592c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=968c8ccf45cc4efe913e2e55c1b89195)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:37.145318 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb80f82-ecad-4344-8ae4-ff49393592c8 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:37.360610 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2eb80f82-ecad-4344-8ae4-ff49393592c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '968c8ccf45cc4efe913e2e55c1b89195'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:37.361561 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2eb80f82-ecad-4344-8ae4-ff49393592c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '968c8ccf45cc4efe913e2e55c1b89195'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:37.369531 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2eb80f82-ecad-4344-8ae4-ff49393592c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '968c8ccf45cc4efe913e2e55c1b89195'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:37.370160 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2eb80f82-ecad-4344-8ae4-ff49393592c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '968c8ccf45cc4efe913e2e55c1b89195'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:37.444101 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2eb80f82-ecad-4344-8ae4-ff49393592c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '968c8ccf45cc4efe913e2e55c1b89195'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:37.449802 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:06:37.462800 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1387/2779] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:06:37 2022] DELETE /identity/v3/users/968c8ccf45cc4efe913e2e55c1b89195 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:06:37.467337 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d242d-90db-4804-95e9-850260134d15 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:37.467872 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d242d-90db-4804-95e9-850260134d15 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:37.467980 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d242d-90db-4804-95e9-850260134d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:37.487814 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-853d242d-90db-4804-95e9-850260134d15 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:06:37.489057 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-853d242d-90db-4804-95e9-850260134d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:06:37.547651 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1393/2780] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:06:37.558486 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb80f82-ecad-4344-8ae4-ff49393592c8 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:37.560714 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-2eb80f82-ecad-4344-8ae4-ff49393592c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:06:37.622703 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb80f82-ecad-4344-8ae4-ff49393592c8 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:37.626603 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61aa41-6f45-4618-a79a-1a1c1b95d215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:37.627241 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61aa41-6f45-4618-a79a-1a1c1b95d215 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:37.627524 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61aa41-6f45-4618-a79a-1a1c1b95d215 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:37.627831 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61aa41-6f45-4618-a79a-1a1c1b95d215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:37.637236 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61aa41-6f45-4618-a79a-1a1c1b95d215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:37.638979 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61aa41-6f45-4618-a79a-1a1c1b95d215 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:37.649750 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1388/2781] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:06:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:06:38.086876 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d242d-90db-4804-95e9-850260134d15 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:38.088319 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-853d242d-90db-4804-95e9-850260134d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:06:38.096100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:06:38.101852 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d242d-90db-4804-95e9-850260134d15 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:38.107959 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a614953-aba9-4708-a02c-49ebb739a3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:38.108509 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a614953-aba9-4708-a02c-49ebb739a3e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:38.108799 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a614953-aba9-4708-a02c-49ebb739a3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:38.109079 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a614953-aba9-4708-a02c-49ebb739a3e7 admin admin] PATH_INFO: `/v3/projects/caeb724a1f4146c294c6277d5af33594` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:38.110466 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a614953-aba9-4708-a02c-49ebb739a3e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caeb724a1f4146c294c6277d5af33594)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:38.113233 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a614953-aba9-4708-a02c-49ebb739a3e7 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:38.224091 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-8a614953-aba9-4708-a02c-49ebb739a3e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caeb724a1f4146c294c6277d5af33594', 'request_id': 'req-8a614953-aba9-4708-a02c-49ebb739a3e7'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:38.230263 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-8a614953-aba9-4708-a02c-49ebb739a3e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caeb724a1f4146c294c6277d5af33594', 'request_id': 'req-8a614953-aba9-4708-a02c-49ebb739a3e7'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:38.236664 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-8a614953-aba9-4708-a02c-49ebb739a3e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caeb724a1f4146c294c6277d5af33594', 'request_id': 'req-8a614953-aba9-4708-a02c-49ebb739a3e7'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:38.300796 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-8a614953-aba9-4708-a02c-49ebb739a3e7 admin admin] The token cache is being invalidate because project caeb724a1f4146c294c6277d5af33594 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:06:38.301078 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-8a614953-aba9-4708-a02c-49ebb739a3e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:38.301691 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-8a614953-aba9-4708-a02c-49ebb739a3e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:38.303260 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1394/2782] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:06:38 2022] DELETE /identity/v3/projects/caeb724a1f4146c294c6277d5af33594 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:06:38.308279 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b33603-f4a8-4390-ab83-09920835fd54 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:38.308766 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b33603-f4a8-4390-ab83-09920835fd54 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:38.308887 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b33603-f4a8-4390-ab83-09920835fd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:38.328691 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-c5b33603-f4a8-4390-ab83-09920835fd54 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:06:38.329897 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c5b33603-f4a8-4390-ab83-09920835fd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:06:38.388986 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1389/2783] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:06:38.397500 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59805ba4-2fa9-452a-bb01-45fd3b97d18c None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:38.397795 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59805ba4-2fa9-452a-bb01-45fd3b97d18c None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:38.398079 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59805ba4-2fa9-452a-bb01-45fd3b97d18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:38.418494 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-59805ba4-2fa9-452a-bb01-45fd3b97d18c None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:06:38.419741 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-59805ba4-2fa9-452a-bb01-45fd3b97d18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:06:38.428042 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1395/2784] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:06:38.432373 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b33603-f4a8-4390-ab83-09920835fd54 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:38.442569 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b33603-f4a8-4390-ab83-09920835fd54 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:38.447142 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6f535-55d7-4e32-9c3b-6a4cae9adf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:38.447828 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6f535-55d7-4e32-9c3b-6a4cae9adf39 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:38.448125 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6f535-55d7-4e32-9c3b-6a4cae9adf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:38.448395 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6f535-55d7-4e32-9c3b-6a4cae9adf39 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:38.449161 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6f535-55d7-4e32-9c3b-6a4cae9adf39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:06:38.449468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6f535-55d7-4e32-9c3b-6a4cae9adf39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:38.451056 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6f535-55d7-4e32-9c3b-6a4cae9adf39 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:38.463426 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1390/2785] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 09:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:06:38.467587 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59805ba4-2fa9-452a-bb01-45fd3b97d18c None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:38.476666 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59805ba4-2fa9-452a-bb01-45fd3b97d18c None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:38.481265 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029bfd19-2097-4ae9-a0d0-205818019692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:38.481912 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bfd19-2097-4ae9-a0d0-205818019692 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:38.482196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bfd19-2097-4ae9-a0d0-205818019692 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:38.482471 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bfd19-2097-4ae9-a0d0-205818019692 admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:38.483149 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029bfd19-2097-4ae9-a0d0-205818019692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:38.485254 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029bfd19-2097-4ae9-a0d0-205818019692 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:38.583256 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1396/2786] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 09:06:38 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:06:38.587802 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6f535-55d7-4e32-9c3b-6a4cae9adf39 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:38.597908 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6f535-55d7-4e32-9c3b-6a4cae9adf39 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:38.655453 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc97771-f4b0-4fb2-9f54-1821be06c584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:38.656130 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc97771-f4b0-4fb2-9f54-1821be06c584 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:38.656464 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc97771-f4b0-4fb2-9f54-1821be06c584 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:38.656751 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc97771-f4b0-4fb2-9f54-1821be06c584 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:38.657452 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc97771-f4b0-4fb2-9f54-1821be06c584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:38.659368 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc97771-f4b0-4fb2-9f54-1821be06c584 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:38.736728 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1391/2787] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 09:06:38 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:06:38.740989 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029bfd19-2097-4ae9-a0d0-205818019692 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:38.752218 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029bfd19-2097-4ae9-a0d0-205818019692 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:38.757269 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce38ca-5f4c-43fb-83d6-0bfba8fe642f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:38.758038 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce38ca-5f4c-43fb-83d6-0bfba8fe642f admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:38.758323 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce38ca-5f4c-43fb-83d6-0bfba8fe642f admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:38.758600 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce38ca-5f4c-43fb-83d6-0bfba8fe642f admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:38.762829 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce38ca-5f4c-43fb-83d6-0bfba8fe642f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:38.762829 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce38ca-5f4c-43fb-83d6-0bfba8fe642f admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:38.773080 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1397/2788] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:06:38.777164 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc97771-f4b0-4fb2-9f54-1821be06c584 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:38.788225 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc97771-f4b0-4fb2-9f54-1821be06c584 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:38.793257 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a1705-8f41-4fb6-9825-24db72a92437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:38.793927 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a1705-8f41-4fb6-9825-24db72a92437 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:38.794224 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a1705-8f41-4fb6-9825-24db72a92437 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:38.794527 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a1705-8f41-4fb6-9825-24db72a92437 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:38.795257 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a1705-8f41-4fb6-9825-24db72a92437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:38.797548 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a1705-8f41-4fb6-9825-24db72a92437 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:38.798870 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:06:38.809478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1392/2789] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:06:38.813664 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce38ca-5f4c-43fb-83d6-0bfba8fe642f admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:38.823950 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce38ca-5f4c-43fb-83d6-0bfba8fe642f admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:38.829262 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777155ff-2ffd-446d-b25f-9f1e87f4be85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:38.830151 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777155ff-2ffd-446d-b25f-9f1e87f4be85 admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:38.830466 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777155ff-2ffd-446d-b25f-9f1e87f4be85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:38.830763 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777155ff-2ffd-446d-b25f-9f1e87f4be85 admin admin] PATH_INFO: `/v3/projects/569adca25de7440389c4e8bdbf34cc72/users/ca00518d39454734be4560f3eefa16bf/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:38.845531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777155ff-2ffd-446d-b25f-9f1e87f4be85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=569adca25de7440389c4e8bdbf34cc72, user_id=ca00518d39454734be4560f3eefa16bf, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:38.848228 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777155ff-2ffd-446d-b25f-9f1e87f4be85 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:38.907534 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1398/2790] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:06:38 2022] PUT /identity/v3/projects/569adca25de7440389c4e8bdbf34cc72/users/ca00518d39454734be4560f3eefa16bf/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 09:06:38.972605 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e2fb5-9a7e-4d09-acae-d5bbc2dc2305 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:38.972946 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e2fb5-9a7e-4d09-acae-d5bbc2dc2305 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:38.973199 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e2fb5-9a7e-4d09-acae-d5bbc2dc2305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:39.002534 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-0b7e2fb5-9a7e-4d09-acae-d5bbc2dc2305 None None] MFA Rules not processed for user `ca00518d39454734be4560f3eefa16bf`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:06:39.003786 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0b7e2fb5-9a7e-4d09-acae-d5bbc2dc2305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:06:39.069718 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1393/2791] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:06:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:06:39.074087 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777155ff-2ffd-446d-b25f-9f1e87f4be85 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:39.135671 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777155ff-2ffd-446d-b25f-9f1e87f4be85 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:39.140486 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77b82c-52a7-4419-9845-bac97eb446db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:39.141294 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77b82c-52a7-4419-9845-bac97eb446db admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:39.141602 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77b82c-52a7-4419-9845-bac97eb446db admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:39.141943 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77b82c-52a7-4419-9845-bac97eb446db admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:39.142641 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77b82c-52a7-4419-9845-bac97eb446db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:39.144890 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77b82c-52a7-4419-9845-bac97eb446db admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:39.245953 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1399/2792] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 09:06:39 2022] POST /identity/v3/projects => generated 377 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:06:39.250599 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e2fb5-9a7e-4d09-acae-d5bbc2dc2305 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:39.261272 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e2fb5-9a7e-4d09-acae-d5bbc2dc2305 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:39.319511 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400870e-d9bd-4e66-96e1-64b1957629a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:39.320207 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400870e-d9bd-4e66-96e1-64b1957629a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:39.320471 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400870e-d9bd-4e66-96e1-64b1957629a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:39.320744 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400870e-d9bd-4e66-96e1-64b1957629a5 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:39.321442 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400870e-d9bd-4e66-96e1-64b1957629a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:39.323333 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400870e-d9bd-4e66-96e1-64b1957629a5 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:39.411062 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1394/2793] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 09:06:39 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:06:39.415094 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77b82c-52a7-4419-9845-bac97eb446db admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:39.426393 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77b82c-52a7-4419-9845-bac97eb446db admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:39.431957 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9c1af-9863-43f7-b6c0-add9e887802b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:39.432650 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9c1af-9863-43f7-b6c0-add9e887802b admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:39.432935 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9c1af-9863-43f7-b6c0-add9e887802b admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:39.433213 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9c1af-9863-43f7-b6c0-add9e887802b admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:39.433947 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c9c1af-9863-43f7-b6c0-add9e887802b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:39.435547 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c9c1af-9863-43f7-b6c0-add9e887802b admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:39.441046 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:06:39.447252 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1400/2794] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:06:39.451508 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400870e-d9bd-4e66-96e1-64b1957629a5 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:39.462182 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400870e-d9bd-4e66-96e1-64b1957629a5 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:39.466908 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b89cf-44d5-4333-9ab6-f90172533b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:39.467589 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b89cf-44d5-4333-9ab6-f90172533b2b admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:39.467903 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b89cf-44d5-4333-9ab6-f90172533b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:39.468207 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b89cf-44d5-4333-9ab6-f90172533b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:39.469506 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b89cf-44d5-4333-9ab6-f90172533b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:39.471269 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b89cf-44d5-4333-9ab6-f90172533b2b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:39.481178 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1395/2795] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:06:39.489684 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9c1af-9863-43f7-b6c0-add9e887802b admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:39.499441 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9c1af-9863-43f7-b6c0-add9e887802b admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:39.504450 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7f0c5-c957-483c-8aac-e00705c46e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:39.505464 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7f0c5-c957-483c-8aac-e00705c46e04 admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:39.505668 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7f0c5-c957-483c-8aac-e00705c46e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:39.506156 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7f0c5-c957-483c-8aac-e00705c46e04 admin admin] PATH_INFO: `/v3/projects/c8b12d309fa7415e9311757cd67e814c/users/3b754dd548e7492f98385ed44158411e/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:39.522504 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf7f0c5-c957-483c-8aac-e00705c46e04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8b12d309fa7415e9311757cd67e814c, user_id=3b754dd548e7492f98385ed44158411e, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:39.525256 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf7f0c5-c957-483c-8aac-e00705c46e04 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:39.616762 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1401/2796] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:06:39 2022] PUT /identity/v3/projects/c8b12d309fa7415e9311757cd67e814c/users/3b754dd548e7492f98385ed44158411e/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:06:39.627856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e31b0-4ab1-4a5f-8973-57b443992521 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:39.628150 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e31b0-4ab1-4a5f-8973-57b443992521 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:39.628431 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e31b0-4ab1-4a5f-8973-57b443992521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:39.656121 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-9e9e31b0-4ab1-4a5f-8973-57b443992521 None None] MFA Rules not processed for user `3b754dd548e7492f98385ed44158411e`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:06:39.657336 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9e9e31b0-4ab1-4a5f-8973-57b443992521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:06:39.713551 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:06:39.723584 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1396/2797] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:06:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:06:39.728513 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7f0c5-c957-483c-8aac-e00705c46e04 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:39.798380 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7f0c5-c957-483c-8aac-e00705c46e04 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:39.802969 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8247cc2-4ec5-444f-bc58-bb0304f2d0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:39.803659 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8247cc2-4ec5-444f-bc58-bb0304f2d0bb admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:39.803949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8247cc2-4ec5-444f-bc58-bb0304f2d0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:39.804230 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8247cc2-4ec5-444f-bc58-bb0304f2d0bb admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:39.804919 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8247cc2-4ec5-444f-bc58-bb0304f2d0bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:39.806810 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8247cc2-4ec5-444f-bc58-bb0304f2d0bb admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:39.897864 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1402/2798] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 09:06:39 2022] POST /identity/v3/projects => generated 379 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:06:39.902069 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e31b0-4ab1-4a5f-8973-57b443992521 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:39.913634 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e31b0-4ab1-4a5f-8973-57b443992521 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:39.970501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52e281-26a6-45b0-a6ba-de0c7183e511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:39.970944 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52e281-26a6-45b0-a6ba-de0c7183e511 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:39.971230 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52e281-26a6-45b0-a6ba-de0c7183e511 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:39.971508 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52e281-26a6-45b0-a6ba-de0c7183e511 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:39.972249 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52e281-26a6-45b0-a6ba-de0c7183e511 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:39.974228 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52e281-26a6-45b0-a6ba-de0c7183e511 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:40.102945 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1397/2799] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 09:06:39 2022] POST /identity/v3/users => generated 296 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:06:40.107287 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8247cc2-4ec5-444f-bc58-bb0304f2d0bb admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:40.118049 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8247cc2-4ec5-444f-bc58-bb0304f2d0bb admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:40.122585 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f308e9f-0b1e-48d5-a174-87c2c71ab587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:40.123273 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f308e9f-0b1e-48d5-a174-87c2c71ab587 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:40.123562 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f308e9f-0b1e-48d5-a174-87c2c71ab587 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:40.123873 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f308e9f-0b1e-48d5-a174-87c2c71ab587 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:40.124607 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f308e9f-0b1e-48d5-a174-87c2c71ab587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:40.126752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f308e9f-0b1e-48d5-a174-87c2c71ab587 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:40.137545 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1403/2800] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:06:40.142338 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52e281-26a6-45b0-a6ba-de0c7183e511 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:40.152814 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52e281-26a6-45b0-a6ba-de0c7183e511 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:40.157643 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea906e-3ef3-404b-8317-06039c159adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:40.158526 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea906e-3ef3-404b-8317-06039c159adf admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:40.162482 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea906e-3ef3-404b-8317-06039c159adf admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:40.162482 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea906e-3ef3-404b-8317-06039c159adf admin admin] PATH_INFO: `/v3/projects/b6c207bed28944d78c5508a100400091/users/eef3e6414f5c41e7b1fc1364d93adc27/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:40.174112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea906e-3ef3-404b-8317-06039c159adf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c207bed28944d78c5508a100400091, user_id=eef3e6414f5c41e7b1fc1364d93adc27, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:40.176767 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea906e-3ef3-404b-8317-06039c159adf admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:40.284689 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1398/2801] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:06:40 2022] PUT /identity/v3/projects/b6c207bed28944d78c5508a100400091/users/eef3e6414f5c41e7b1fc1364d93adc27/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:06:40.288819 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f308e9f-0b1e-48d5-a174-87c2c71ab587 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:40.300049 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f308e9f-0b1e-48d5-a174-87c2c71ab587 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:40.355066 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbf401-5f06-4eb9-ba80-f661c646d644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:40.355751 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbf401-5f06-4eb9-ba80-f661c646d644 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:40.356025 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbf401-5f06-4eb9-ba80-f661c646d644 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:40.356299 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbf401-5f06-4eb9-ba80-f661c646d644 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:40.357020 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbf401-5f06-4eb9-ba80-f661c646d644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:40.358612 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbf401-5f06-4eb9-ba80-f661c646d644 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:40.368817 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1404/2802] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:06:40.373148 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea906e-3ef3-404b-8317-06039c159adf admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:40.384021 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea906e-3ef3-404b-8317-06039c159adf admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:40.388615 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e38e3b-18e3-4ff7-a911-1a27a1244ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:40.389489 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e38e3b-18e3-4ff7-a911-1a27a1244ce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:40.389776 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e38e3b-18e3-4ff7-a911-1a27a1244ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:40.390054 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e38e3b-18e3-4ff7-a911-1a27a1244ce4 admin admin] PATH_INFO: `/v3/projects/b6c207bed28944d78c5508a100400091/users/eef3e6414f5c41e7b1fc1364d93adc27/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:40.392087 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e38e3b-18e3-4ff7-a911-1a27a1244ce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c207bed28944d78c5508a100400091, user_id=eef3e6414f5c41e7b1fc1364d93adc27, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:40.394952 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e38e3b-18e3-4ff7-a911-1a27a1244ce4 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:40.405100 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1399/2803] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:06:40 2022] PUT /identity/v3/projects/b6c207bed28944d78c5508a100400091/users/eef3e6414f5c41e7b1fc1364d93adc27/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:06:40.416812 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43095f89-dbab-4042-9fbc-8322ce82ef2a None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:40.417108 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43095f89-dbab-4042-9fbc-8322ce82ef2a None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:40.417387 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43095f89-dbab-4042-9fbc-8322ce82ef2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:40.446402 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-43095f89-dbab-4042-9fbc-8322ce82ef2a None None] MFA Rules not processed for user `eef3e6414f5c41e7b1fc1364d93adc27`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:06:40.447628 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-43095f89-dbab-4042-9fbc-8322ce82ef2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:06:40.477192 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:06:40.516979 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1405/2804] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:06:40 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:06:40.528694 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e38e3b-18e3-4ff7-a911-1a27a1244ce4 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:40.530376 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-22e38e3b-18e3-4ff7-a911-1a27a1244ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:06:40.589746 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e38e3b-18e3-4ff7-a911-1a27a1244ce4 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:40.593442 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c914f-a3dc-42fe-96e0-ac117c13ee42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:40.594365 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c914f-a3dc-42fe-96e0-ac117c13ee42 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:40.594653 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c914f-a3dc-42fe-96e0-ac117c13ee42 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:40.594936 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c914f-a3dc-42fe-96e0-ac117c13ee42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:40.604114 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c914f-a3dc-42fe-96e0-ac117c13ee42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:40.605597 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c914f-a3dc-42fe-96e0-ac117c13ee42 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:40.616239 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1400/2805] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:06:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:06:40.693074 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43095f89-dbab-4042-9fbc-8322ce82ef2a None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:40.694485 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-43095f89-dbab-4042-9fbc-8322ce82ef2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:06:40.707216 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43095f89-dbab-4042-9fbc-8322ce82ef2a None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:40.712393 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c741e99-cbcb-4b22-8cbe-06fa3606dabc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:40.713201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c741e99-cbcb-4b22-8cbe-06fa3606dabc service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:40.713201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c741e99-cbcb-4b22-8cbe-06fa3606dabc service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:40.713425 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c741e99-cbcb-4b22-8cbe-06fa3606dabc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:40.769981 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c741e99-cbcb-4b22-8cbe-06fa3606dabc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:40.771416 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c741e99-cbcb-4b22-8cbe-06fa3606dabc service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:40.780345 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1406/2806] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:06:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 09:06:44.626253 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c914f-a3dc-42fe-96e0-ac117c13ee42 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:44.676837 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:06:44.691080 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c914f-a3dc-42fe-96e0-ac117c13ee42 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:44.697722 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd59e13-23c2-4165-81ee-c078c57f0254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:44.698599 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd59e13-23c2-4165-81ee-c078c57f0254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:44.698889 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd59e13-23c2-4165-81ee-c078c57f0254 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:44.699170 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd59e13-23c2-4165-81ee-c078c57f0254 admin admin] PATH_INFO: `/v3/users/ca00518d39454734be4560f3eefa16bf` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:44.700408 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd59e13-23c2-4165-81ee-c078c57f0254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca00518d39454734be4560f3eefa16bf)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:44.702328 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd59e13-23c2-4165-81ee-c078c57f0254 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:44.892807 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2dd59e13-23c2-4165-81ee-c078c57f0254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca00518d39454734be4560f3eefa16bf'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:44.893504 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2dd59e13-23c2-4165-81ee-c078c57f0254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca00518d39454734be4560f3eefa16bf'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:44.900907 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2dd59e13-23c2-4165-81ee-c078c57f0254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca00518d39454734be4560f3eefa16bf'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:44.901538 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2dd59e13-23c2-4165-81ee-c078c57f0254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca00518d39454734be4560f3eefa16bf'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:44.952627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2dd59e13-23c2-4165-81ee-c078c57f0254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca00518d39454734be4560f3eefa16bf'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:44.972361 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1401/2807] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:06:44 2022] DELETE /identity/v3/users/ca00518d39454734be4560f3eefa16bf => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:06:44.976948 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50961e-9f24-4757-8bf6-6d93628726a5 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:44.977449 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50961e-9f24-4757-8bf6-6d93628726a5 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:44.977661 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50961e-9f24-4757-8bf6-6d93628726a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:44.997498 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-4f50961e-9f24-4757-8bf6-6d93628726a5 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:06:44.998682 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-4f50961e-9f24-4757-8bf6-6d93628726a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:06:45.058412 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1407/2808] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:06:45.068866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd59e13-23c2-4165-81ee-c078c57f0254 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:45.070337 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-2dd59e13-23c2-4165-81ee-c078c57f0254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:06:45.127470 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd59e13-23c2-4165-81ee-c078c57f0254 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:45.131182 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda301aa-a9c4-4ec5-a0e8-74b2b64abf83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:45.131865 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda301aa-a9c4-4ec5-a0e8-74b2b64abf83 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:45.132153 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda301aa-a9c4-4ec5-a0e8-74b2b64abf83 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:45.132432 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda301aa-a9c4-4ec5-a0e8-74b2b64abf83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:45.141455 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda301aa-a9c4-4ec5-a0e8-74b2b64abf83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:45.143043 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda301aa-a9c4-4ec5-a0e8-74b2b64abf83 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:45.152941 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1402/2809] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:06:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:06:45.537257 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50961e-9f24-4757-8bf6-6d93628726a5 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:45.538959 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-4f50961e-9f24-4757-8bf6-6d93628726a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:06:45.555635 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50961e-9f24-4757-8bf6-6d93628726a5 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:45.560602 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bc1b3-362a-4aba-b0a9-7891c8a39eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:45.562047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bc1b3-362a-4aba-b0a9-7891c8a39eb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:45.562047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bc1b3-362a-4aba-b0a9-7891c8a39eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:45.562047 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bc1b3-362a-4aba-b0a9-7891c8a39eb3 admin admin] PATH_INFO: `/v3/projects/569adca25de7440389c4e8bdbf34cc72` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:45.563270 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18bc1b3-362a-4aba-b0a9-7891c8a39eb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=569adca25de7440389c4e8bdbf34cc72)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:45.566201 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18bc1b3-362a-4aba-b0a9-7891c8a39eb3 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:45.702196 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-b18bc1b3-362a-4aba-b0a9-7891c8a39eb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '569adca25de7440389c4e8bdbf34cc72', 'request_id': 'req-b18bc1b3-362a-4aba-b0a9-7891c8a39eb3'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:45.708812 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-b18bc1b3-362a-4aba-b0a9-7891c8a39eb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '569adca25de7440389c4e8bdbf34cc72', 'request_id': 'req-b18bc1b3-362a-4aba-b0a9-7891c8a39eb3'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:45.714430 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:06:45.715674 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-b18bc1b3-362a-4aba-b0a9-7891c8a39eb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '569adca25de7440389c4e8bdbf34cc72', 'request_id': 'req-b18bc1b3-362a-4aba-b0a9-7891c8a39eb3'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:45.809191 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-b18bc1b3-362a-4aba-b0a9-7891c8a39eb3 admin admin] The token cache is being invalidate because project 569adca25de7440389c4e8bdbf34cc72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:06:45.809794 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-b18bc1b3-362a-4aba-b0a9-7891c8a39eb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:45.810831 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-b18bc1b3-362a-4aba-b0a9-7891c8a39eb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:45.812417 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1408/2810] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:06:45 2022] DELETE /identity/v3/projects/569adca25de7440389c4e8bdbf34cc72 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:06:45.817169 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda301aa-a9c4-4ec5-a0e8-74b2b64abf83 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:45.826827 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda301aa-a9c4-4ec5-a0e8-74b2b64abf83 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:45.886096 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143abd61-3479-46ea-909d-eae9328d7d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:45.886971 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143abd61-3479-46ea-909d-eae9328d7d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:45.887254 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143abd61-3479-46ea-909d-eae9328d7d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:45.887530 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143abd61-3479-46ea-909d-eae9328d7d5d admin admin] PATH_INFO: `/v3/users/3b754dd548e7492f98385ed44158411e` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:45.888743 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143abd61-3479-46ea-909d-eae9328d7d5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b754dd548e7492f98385ed44158411e)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:45.890643 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143abd61-3479-46ea-909d-eae9328d7d5d admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:45.904180 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:06:46.017790 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-143abd61-3479-46ea-909d-eae9328d7d5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b754dd548e7492f98385ed44158411e'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:46.018433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-143abd61-3479-46ea-909d-eae9328d7d5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b754dd548e7492f98385ed44158411e'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:46.025800 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-143abd61-3479-46ea-909d-eae9328d7d5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b754dd548e7492f98385ed44158411e'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:46.026441 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-143abd61-3479-46ea-909d-eae9328d7d5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b754dd548e7492f98385ed44158411e'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:46.072529 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-143abd61-3479-46ea-909d-eae9328d7d5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b754dd548e7492f98385ed44158411e'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:46.090467 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1403/2811] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:06:45 2022] DELETE /identity/v3/users/3b754dd548e7492f98385ed44158411e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:06:46.463630 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bc1b3-362a-4aba-b0a9-7891c8a39eb3 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:46.465195 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-b18bc1b3-362a-4aba-b0a9-7891c8a39eb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:06:46.479048 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bc1b3-362a-4aba-b0a9-7891c8a39eb3 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:46.545601 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01075e-f5f9-4fea-b86b-01539af0d470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:46.546410 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01075e-f5f9-4fea-b86b-01539af0d470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:46.546713 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01075e-f5f9-4fea-b86b-01539af0d470 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:46.546996 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01075e-f5f9-4fea-b86b-01539af0d470 admin admin] PATH_INFO: `/v3/projects/c8b12d309fa7415e9311757cd67e814c` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:46.548248 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01075e-f5f9-4fea-b86b-01539af0d470 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8b12d309fa7415e9311757cd67e814c)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:46.550312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01075e-f5f9-4fea-b86b-01539af0d470 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:46.672701 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-ec01075e-f5f9-4fea-b86b-01539af0d470 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8b12d309fa7415e9311757cd67e814c', 'request_id': 'req-ec01075e-f5f9-4fea-b86b-01539af0d470'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:46.678902 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-ec01075e-f5f9-4fea-b86b-01539af0d470 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8b12d309fa7415e9311757cd67e814c', 'request_id': 'req-ec01075e-f5f9-4fea-b86b-01539af0d470'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:46.684298 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-ec01075e-f5f9-4fea-b86b-01539af0d470 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8b12d309fa7415e9311757cd67e814c', 'request_id': 'req-ec01075e-f5f9-4fea-b86b-01539af0d470'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:46.746957 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-ec01075e-f5f9-4fea-b86b-01539af0d470 admin admin] The token cache is being invalidate because project c8b12d309fa7415e9311757cd67e814c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:06:46.747237 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-ec01075e-f5f9-4fea-b86b-01539af0d470 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:46.747897 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-ec01075e-f5f9-4fea-b86b-01539af0d470 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:46.749805 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1409/2812] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:06:46 2022] DELETE /identity/v3/projects/c8b12d309fa7415e9311757cd67e814c => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:06:46.754561 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143abd61-3479-46ea-909d-eae9328d7d5d admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:46.755986 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-143abd61-3479-46ea-909d-eae9328d7d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:06:46.770504 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143abd61-3479-46ea-909d-eae9328d7d5d admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:46.826501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b3e1c-32e4-49d2-bca6-961b96d08df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:46.827290 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b3e1c-32e4-49d2-bca6-961b96d08df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:46.827574 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b3e1c-32e4-49d2-bca6-961b96d08df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:46.827880 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b3e1c-32e4-49d2-bca6-961b96d08df7 admin admin] PATH_INFO: `/v3/users/eef3e6414f5c41e7b1fc1364d93adc27` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:46.829063 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b3e1c-32e4-49d2-bca6-961b96d08df7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eef3e6414f5c41e7b1fc1364d93adc27)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:46.831003 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b3e1c-32e4-49d2-bca6-961b96d08df7 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:46.971805 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ea5b3e1c-32e4-49d2-bca6-961b96d08df7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eef3e6414f5c41e7b1fc1364d93adc27'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:46.972522 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ea5b3e1c-32e4-49d2-bca6-961b96d08df7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eef3e6414f5c41e7b1fc1364d93adc27'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:46.979583 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ea5b3e1c-32e4-49d2-bca6-961b96d08df7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eef3e6414f5c41e7b1fc1364d93adc27'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:46.980301 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ea5b3e1c-32e4-49d2-bca6-961b96d08df7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eef3e6414f5c41e7b1fc1364d93adc27'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:47.026470 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ea5b3e1c-32e4-49d2-bca6-961b96d08df7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eef3e6414f5c41e7b1fc1364d93adc27'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:47.044977 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1404/2813] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:06:46 2022] DELETE /identity/v3/users/eef3e6414f5c41e7b1fc1364d93adc27 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:06:47.492148 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01075e-f5f9-4fea-b86b-01539af0d470 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:47.493672 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-ec01075e-f5f9-4fea-b86b-01539af0d470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:06:47.508380 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01075e-f5f9-4fea-b86b-01539af0d470 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:47.566717 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f074405-718f-46ad-a945-40051892aba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:47.567579 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f074405-718f-46ad-a945-40051892aba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:47.567895 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f074405-718f-46ad-a945-40051892aba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:47.568229 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f074405-718f-46ad-a945-40051892aba8 admin admin] PATH_INFO: `/v3/projects/b6c207bed28944d78c5508a100400091` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:47.569414 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f074405-718f-46ad-a945-40051892aba8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6c207bed28944d78c5508a100400091)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:47.571357 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f074405-718f-46ad-a945-40051892aba8 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:47.594194 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:06:47.702241 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-1f074405-718f-46ad-a945-40051892aba8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6c207bed28944d78c5508a100400091', 'request_id': 'req-1f074405-718f-46ad-a945-40051892aba8'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:47.714597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-1f074405-718f-46ad-a945-40051892aba8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6c207bed28944d78c5508a100400091', 'request_id': 'req-1f074405-718f-46ad-a945-40051892aba8'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:47.720128 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-1f074405-718f-46ad-a945-40051892aba8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6c207bed28944d78c5508a100400091', 'request_id': 'req-1f074405-718f-46ad-a945-40051892aba8'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:47.792256 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-1f074405-718f-46ad-a945-40051892aba8 admin admin] The token cache is being invalidate because project b6c207bed28944d78c5508a100400091 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:06:47.792488 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-1f074405-718f-46ad-a945-40051892aba8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:47.793102 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-1f074405-718f-46ad-a945-40051892aba8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:06:47.794639 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1410/2814] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:06:47 2022] DELETE /identity/v3/projects/b6c207bed28944d78c5508a100400091 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:06:47.801163 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87147147-6dcb-4730-9448-50bac700e117 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:47.801458 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87147147-6dcb-4730-9448-50bac700e117 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:47.801742 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87147147-6dcb-4730-9448-50bac700e117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:47.822689 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-87147147-6dcb-4730-9448-50bac700e117 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:06:47.823907 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-87147147-6dcb-4730-9448-50bac700e117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:06:47.828010 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:06:47.886768 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1405/2815] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:06:47.896072 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dc5f2-d381-486e-91fd-8c434469b6ab None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:47.896344 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dc5f2-d381-486e-91fd-8c434469b6ab None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:47.896620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dc5f2-d381-486e-91fd-8c434469b6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:47.916649 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-ab9dc5f2-d381-486e-91fd-8c434469b6ab None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:06:47.917886 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-ab9dc5f2-d381-486e-91fd-8c434469b6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:06:47.926562 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1411/2816] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:06:47.930932 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87147147-6dcb-4730-9448-50bac700e117 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:47.941635 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87147147-6dcb-4730-9448-50bac700e117 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:47.946231 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa07b06-51cf-4bb2-9984-d41cab2b7db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:47.946882 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa07b06-51cf-4bb2-9984-d41cab2b7db8 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:47.947165 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa07b06-51cf-4bb2-9984-d41cab2b7db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:47.947439 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa07b06-51cf-4bb2-9984-d41cab2b7db8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:47.948246 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa07b06-51cf-4bb2-9984-d41cab2b7db8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:06:47.948558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa07b06-51cf-4bb2-9984-d41cab2b7db8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:47.950129 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa07b06-51cf-4bb2-9984-d41cab2b7db8 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:47.962038 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1406/2817] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 09:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:06:47.966341 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9dc5f2-d381-486e-91fd-8c434469b6ab None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:47.976003 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9dc5f2-d381-486e-91fd-8c434469b6ab None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:47.980833 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e3927-9113-4468-9dbd-9630c5460ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:47.981478 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e3927-9113-4468-9dbd-9630c5460ba4 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:47.981759 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e3927-9113-4468-9dbd-9630c5460ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:47.982061 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e3927-9113-4468-9dbd-9630c5460ba4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:47.982753 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e3927-9113-4468-9dbd-9630c5460ba4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:47.984677 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e3927-9113-4468-9dbd-9630c5460ba4 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:48.091925 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1412/2818] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 09:06:47 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:06:48.095926 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa07b06-51cf-4bb2-9984-d41cab2b7db8 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:48.106155 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa07b06-51cf-4bb2-9984-d41cab2b7db8 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:48.163693 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be53a23-91da-48af-8993-86a31477a5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:48.164360 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be53a23-91da-48af-8993-86a31477a5e0 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:48.164648 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be53a23-91da-48af-8993-86a31477a5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:48.164940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be53a23-91da-48af-8993-86a31477a5e0 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:48.165647 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be53a23-91da-48af-8993-86a31477a5e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:48.167558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be53a23-91da-48af-8993-86a31477a5e0 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:48.227542 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1407/2819] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 09:06:48 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:06:48.232074 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e3927-9113-4468-9dbd-9630c5460ba4 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:48.242962 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e3927-9113-4468-9dbd-9630c5460ba4 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:48.247499 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd31bcdf-a5a5-4add-9de3-eb1fc8d96797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:48.249429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31bcdf-a5a5-4add-9de3-eb1fc8d96797 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:48.249429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31bcdf-a5a5-4add-9de3-eb1fc8d96797 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:48.249429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31bcdf-a5a5-4add-9de3-eb1fc8d96797 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:48.249429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd31bcdf-a5a5-4add-9de3-eb1fc8d96797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:48.251149 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd31bcdf-a5a5-4add-9de3-eb1fc8d96797 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:48.261478 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1413/2820] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 09:06:48.265483 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be53a23-91da-48af-8993-86a31477a5e0 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:48.276140 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be53a23-91da-48af-8993-86a31477a5e0 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:48.280772 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d099fb-aea3-4688-a039-9f63efff126f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:48.281423 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d099fb-aea3-4688-a039-9f63efff126f admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:48.281709 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d099fb-aea3-4688-a039-9f63efff126f admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:48.281988 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d099fb-aea3-4688-a039-9f63efff126f admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:48.283319 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d099fb-aea3-4688-a039-9f63efff126f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:48.284940 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d099fb-aea3-4688-a039-9f63efff126f admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:48.295958 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1408/2821] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 09:06:48.300874 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd31bcdf-a5a5-4add-9de3-eb1fc8d96797 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:48.311053 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd31bcdf-a5a5-4add-9de3-eb1fc8d96797 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:48.315810 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d108057-ecd7-4ed8-8d29-882328b5c75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:48.316689 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d108057-ecd7-4ed8-8d29-882328b5c75d admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:48.316970 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d108057-ecd7-4ed8-8d29-882328b5c75d admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:48.317247 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d108057-ecd7-4ed8-8d29-882328b5c75d admin admin] PATH_INFO: `/v3/projects/990877bba5824d9c83b5bb9170cb3990/users/6d04d70f0364414ebd544b216249c964/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:48.331667 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d108057-ecd7-4ed8-8d29-882328b5c75d admin admin] RBAC: Authorizing `identity:create_grant(project_id=990877bba5824d9c83b5bb9170cb3990, user_id=6d04d70f0364414ebd544b216249c964, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:48.334328 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d108057-ecd7-4ed8-8d29-882328b5c75d admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:48.386943 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1414/2822] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:06:48 2022] PUT /identity/v3/projects/990877bba5824d9c83b5bb9170cb3990/users/6d04d70f0364414ebd544b216249c964/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:06:48.398885 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fb473-cc01-4b25-ab23-e51dce08594f None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:48.399170 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fb473-cc01-4b25-ab23-e51dce08594f None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:48.399471 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fb473-cc01-4b25-ab23-e51dce08594f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:48.433445 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-fa5fb473-cc01-4b25-ab23-e51dce08594f None None] MFA Rules not processed for user `6d04d70f0364414ebd544b216249c964`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:06:48.434647 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-fa5fb473-cc01-4b25-ab23-e51dce08594f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:06:48.501094 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1409/2823] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:06:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:06:48.505606 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d108057-ecd7-4ed8-8d29-882328b5c75d admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:48.567588 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d108057-ecd7-4ed8-8d29-882328b5c75d admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:48.573499 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150ac54-53c7-40c1-9b2c-bab904b83a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:48.574164 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150ac54-53c7-40c1-9b2c-bab904b83a65 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:48.574454 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150ac54-53c7-40c1-9b2c-bab904b83a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:48.574736 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150ac54-53c7-40c1-9b2c-bab904b83a65 admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:48.575429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150ac54-53c7-40c1-9b2c-bab904b83a65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:48.577367 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150ac54-53c7-40c1-9b2c-bab904b83a65 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:48.651268 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1415/2824] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 09:06:48 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:06:48.655581 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5fb473-cc01-4b25-ab23-e51dce08594f None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:48.663060 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:06:48.667806 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5fb473-cc01-4b25-ab23-e51dce08594f None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:48.728587 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc4e6d-03c3-491b-9390-3fed83e217d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:48.729257 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc4e6d-03c3-491b-9390-3fed83e217d0 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:48.729577 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc4e6d-03c3-491b-9390-3fed83e217d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:48.729896 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc4e6d-03c3-491b-9390-3fed83e217d0 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:48.730627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc4e6d-03c3-491b-9390-3fed83e217d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:48.732602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc4e6d-03c3-491b-9390-3fed83e217d0 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:48.827366 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1410/2825] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 09:06:48 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:06:48.831683 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150ac54-53c7-40c1-9b2c-bab904b83a65 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:48.842135 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150ac54-53c7-40c1-9b2c-bab904b83a65 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:48.846895 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2569a-1194-4d3e-b708-29b70b5fafd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:48.847573 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2569a-1194-4d3e-b708-29b70b5fafd8 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:48.847879 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2569a-1194-4d3e-b708-29b70b5fafd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:48.848164 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2569a-1194-4d3e-b708-29b70b5fafd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:48.848894 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2569a-1194-4d3e-b708-29b70b5fafd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:48.850531 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2569a-1194-4d3e-b708-29b70b5fafd8 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:48.861772 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1416/2826] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:06:48.865935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc4e6d-03c3-491b-9390-3fed83e217d0 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:48.875977 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc4e6d-03c3-491b-9390-3fed83e217d0 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:48.881243 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93450508-1db7-4d3b-a20b-f06d0272dd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:48.882112 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93450508-1db7-4d3b-a20b-f06d0272dd13 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:48.882392 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93450508-1db7-4d3b-a20b-f06d0272dd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:48.882664 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93450508-1db7-4d3b-a20b-f06d0272dd13 admin admin] PATH_INFO: `/v3/projects/589b3cef05e74a8fa3eda541773125d0/users/faf0b85879e242d79c104003131cac42/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:48.897457 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93450508-1db7-4d3b-a20b-f06d0272dd13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=589b3cef05e74a8fa3eda541773125d0, user_id=faf0b85879e242d79c104003131cac42, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:48.900184 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93450508-1db7-4d3b-a20b-f06d0272dd13 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:48.969594 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1411/2827] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:06:48 2022] PUT /identity/v3/projects/589b3cef05e74a8fa3eda541773125d0/users/faf0b85879e242d79c104003131cac42/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:06:48.974438 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2569a-1194-4d3e-b708-29b70b5fafd8 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:48.984610 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2569a-1194-4d3e-b708-29b70b5fafd8 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:49.001124 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:06:49.041360 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412a0f0-d41b-4cc4-a72e-3de270722811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:49.042052 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412a0f0-d41b-4cc4-a72e-3de270722811 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:49.042339 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412a0f0-d41b-4cc4-a72e-3de270722811 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:49.042631 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412a0f0-d41b-4cc4-a72e-3de270722811 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:49.043603 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412a0f0-d41b-4cc4-a72e-3de270722811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:49.045599 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412a0f0-d41b-4cc4-a72e-3de270722811 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:49.056359 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1417/2828] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:06:49.060529 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93450508-1db7-4d3b-a20b-f06d0272dd13 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:49.071571 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93450508-1db7-4d3b-a20b-f06d0272dd13 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:49.076351 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6046a-48b3-4ab9-b8c8-c306c8dcf764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:49.077229 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6046a-48b3-4ab9-b8c8-c306c8dcf764 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:49.077508 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6046a-48b3-4ab9-b8c8-c306c8dcf764 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:49.077781 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6046a-48b3-4ab9-b8c8-c306c8dcf764 admin admin] PATH_INFO: `/v3/projects/589b3cef05e74a8fa3eda541773125d0/users/faf0b85879e242d79c104003131cac42/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:49.080414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6046a-48b3-4ab9-b8c8-c306c8dcf764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=589b3cef05e74a8fa3eda541773125d0, user_id=faf0b85879e242d79c104003131cac42, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:49.083092 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6046a-48b3-4ab9-b8c8-c306c8dcf764 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:49.093490 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1412/2829] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:06:49 2022] PUT /identity/v3/projects/589b3cef05e74a8fa3eda541773125d0/users/faf0b85879e242d79c104003131cac42/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:06:49.105052 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbce74b-0c51-4a65-985a-fdc56749f221 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:49.105347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbce74b-0c51-4a65-985a-fdc56749f221 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:49.105628 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbce74b-0c51-4a65-985a-fdc56749f221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:49.135148 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-6fbce74b-0c51-4a65-985a-fdc56749f221 None None] MFA Rules not processed for user `faf0b85879e242d79c104003131cac42`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:06:49.136411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-6fbce74b-0c51-4a65-985a-fdc56749f221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:06:49.203386 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1418/2830] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:06:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:06:49.214646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6046a-48b3-4ab9-b8c8-c306c8dcf764 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:49.216314 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-47e6046a-48b3-4ab9-b8c8-c306c8dcf764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:06:49.274229 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6046a-48b3-4ab9-b8c8-c306c8dcf764 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:49.277888 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949167dc-de41-441c-a8cf-fa44f0ef14ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:49.278523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949167dc-de41-441c-a8cf-fa44f0ef14ff service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:49.278804 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949167dc-de41-441c-a8cf-fa44f0ef14ff service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:49.279080 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949167dc-de41-441c-a8cf-fa44f0ef14ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:49.334952 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949167dc-de41-441c-a8cf-fa44f0ef14ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:49.336423 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949167dc-de41-441c-a8cf-fa44f0ef14ff service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:49.345314 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1413/2831] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:06:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:06:54.596100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbce74b-0c51-4a65-985a-fdc56749f221 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:06:54.597526 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-6fbce74b-0c51-4a65-985a-fdc56749f221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:06:54.609569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbce74b-0c51-4a65-985a-fdc56749f221 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:06:54.613952 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1fc7a-79d2-4a18-8b6b-ff356134bc49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:06:54.614595 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1fc7a-79d2-4a18-8b6b-ff356134bc49 service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:06:54.614883 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1fc7a-79d2-4a18-8b6b-ff356134bc49 service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:06:54.615162 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1fc7a-79d2-4a18-8b6b-ff356134bc49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:06:54.624455 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1fc7a-79d2-4a18-8b6b-ff356134bc49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:06:54.625966 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1fc7a-79d2-4a18-8b6b-ff356134bc49 service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:06:54.636389 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1419/2832] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:06:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:06:59.341299 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=90,keystone:INSERT=5 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:07:00.227403 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949167dc-de41-441c-a8cf-fa44f0ef14ff service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:00.290421 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949167dc-de41-441c-a8cf-fa44f0ef14ff service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:00.295056 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce8a5a-7fa6-4780-8ff3-d9cfae2573f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:00.295968 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce8a5a-7fa6-4780-8ff3-d9cfae2573f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:00.296248 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce8a5a-7fa6-4780-8ff3-d9cfae2573f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:00.296530 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce8a5a-7fa6-4780-8ff3-d9cfae2573f5 admin admin] PATH_INFO: `/v3/users/6d04d70f0364414ebd544b216249c964` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:00.297771 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce8a5a-7fa6-4780-8ff3-d9cfae2573f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d04d70f0364414ebd544b216249c964)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:00.299737 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce8a5a-7fa6-4780-8ff3-d9cfae2573f5 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:00.447114 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-65ce8a5a-7fa6-4780-8ff3-d9cfae2573f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d04d70f0364414ebd544b216249c964'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:00.447842 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-65ce8a5a-7fa6-4780-8ff3-d9cfae2573f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d04d70f0364414ebd544b216249c964'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:00.454997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-65ce8a5a-7fa6-4780-8ff3-d9cfae2573f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d04d70f0364414ebd544b216249c964'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:00.463169 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-65ce8a5a-7fa6-4780-8ff3-d9cfae2573f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d04d70f0364414ebd544b216249c964'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:00.523632 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-65ce8a5a-7fa6-4780-8ff3-d9cfae2573f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d04d70f0364414ebd544b216249c964'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:00.541778 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1414/2833] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:07:00 2022] DELETE /identity/v3/users/6d04d70f0364414ebd544b216249c964 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:07:00.546579 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e52af9-f665-4a2c-b5de-2498fdbd0374 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:00.547100 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e52af9-f665-4a2c-b5de-2498fdbd0374 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:00.547218 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e52af9-f665-4a2c-b5de-2498fdbd0374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:00.568057 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-d0e52af9-f665-4a2c-b5de-2498fdbd0374 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:07:00.569279 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-d0e52af9-f665-4a2c-b5de-2498fdbd0374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:00.633282 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1420/2834] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:07:00.643096 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce8a5a-7fa6-4780-8ff3-d9cfae2573f5 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:00.644946 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-65ce8a5a-7fa6-4780-8ff3-d9cfae2573f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:00.701798 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce8a5a-7fa6-4780-8ff3-d9cfae2573f5 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:00.705470 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e13ad-1fb5-4edc-9916-f59434b26a8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:00.706128 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e13ad-1fb5-4edc-9916-f59434b26a8b service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:00.706450 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e13ad-1fb5-4edc-9916-f59434b26a8b service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:00.706742 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e13ad-1fb5-4edc-9916-f59434b26a8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:00.716448 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e13ad-1fb5-4edc-9916-f59434b26a8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:00.717817 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e13ad-1fb5-4edc-9916-f59434b26a8b service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:00.728306 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1415/2835] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:07:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:07:01.125805 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e52af9-f665-4a2c-b5de-2498fdbd0374 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:01.127309 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-d0e52af9-f665-4a2c-b5de-2498fdbd0374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:01.140752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e52af9-f665-4a2c-b5de-2498fdbd0374 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:01.146729 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4456dc5-c5d1-435a-93b7-55a3148a44d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:01.147589 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4456dc5-c5d1-435a-93b7-55a3148a44d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:01.147904 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4456dc5-c5d1-435a-93b7-55a3148a44d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:01.148232 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4456dc5-c5d1-435a-93b7-55a3148a44d2 admin admin] PATH_INFO: `/v3/projects/990877bba5824d9c83b5bb9170cb3990` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:01.149423 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4456dc5-c5d1-435a-93b7-55a3148a44d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=990877bba5824d9c83b5bb9170cb3990)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:01.151444 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4456dc5-c5d1-435a-93b7-55a3148a44d2 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:01.177421 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:07:01.261847 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-e4456dc5-c5d1-435a-93b7-55a3148a44d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '990877bba5824d9c83b5bb9170cb3990', 'request_id': 'req-e4456dc5-c5d1-435a-93b7-55a3148a44d2'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:01.267896 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-e4456dc5-c5d1-435a-93b7-55a3148a44d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '990877bba5824d9c83b5bb9170cb3990', 'request_id': 'req-e4456dc5-c5d1-435a-93b7-55a3148a44d2'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:01.274901 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-e4456dc5-c5d1-435a-93b7-55a3148a44d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '990877bba5824d9c83b5bb9170cb3990', 'request_id': 'req-e4456dc5-c5d1-435a-93b7-55a3148a44d2'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:01.362415 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-e4456dc5-c5d1-435a-93b7-55a3148a44d2 admin admin] The token cache is being invalidate because project 990877bba5824d9c83b5bb9170cb3990 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:07:01.362704 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-e4456dc5-c5d1-435a-93b7-55a3148a44d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:01.363324 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-e4456dc5-c5d1-435a-93b7-55a3148a44d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:01.365651 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1421/2836] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:07:01 2022] DELETE /identity/v3/projects/990877bba5824d9c83b5bb9170cb3990 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:07:01.372520 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e13ad-1fb5-4edc-9916-f59434b26a8b service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:01.379900 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e13ad-1fb5-4edc-9916-f59434b26a8b service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:01.399526 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:07:01.441191 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44100fe-7865-48a2-9426-6a4dd796956e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:01.442107 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44100fe-7865-48a2-9426-6a4dd796956e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:01.442461 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44100fe-7865-48a2-9426-6a4dd796956e admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:01.442794 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44100fe-7865-48a2-9426-6a4dd796956e admin admin] PATH_INFO: `/v3/users/faf0b85879e242d79c104003131cac42` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:01.444811 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44100fe-7865-48a2-9426-6a4dd796956e admin admin] RBAC: Authorizing `identity:delete_user(user_id=faf0b85879e242d79c104003131cac42)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:01.446764 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44100fe-7865-48a2-9426-6a4dd796956e admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:01.649045 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a44100fe-7865-48a2-9426-6a4dd796956e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faf0b85879e242d79c104003131cac42'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:01.649697 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a44100fe-7865-48a2-9426-6a4dd796956e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faf0b85879e242d79c104003131cac42'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:01.656724 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a44100fe-7865-48a2-9426-6a4dd796956e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faf0b85879e242d79c104003131cac42'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:01.657407 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a44100fe-7865-48a2-9426-6a4dd796956e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faf0b85879e242d79c104003131cac42'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:01.718177 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a44100fe-7865-48a2-9426-6a4dd796956e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faf0b85879e242d79c104003131cac42'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:01.738657 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1416/2837] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:07:01 2022] DELETE /identity/v3/users/faf0b85879e242d79c104003131cac42 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:07:02.126941 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4456dc5-c5d1-435a-93b7-55a3148a44d2 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:02.128498 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-e4456dc5-c5d1-435a-93b7-55a3148a44d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:02.142640 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4456dc5-c5d1-435a-93b7-55a3148a44d2 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:02.200535 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61868acf-5185-4e13-91a1-0fa4bde1b118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:02.201298 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61868acf-5185-4e13-91a1-0fa4bde1b118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:02.201579 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61868acf-5185-4e13-91a1-0fa4bde1b118 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:02.201854 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61868acf-5185-4e13-91a1-0fa4bde1b118 admin admin] PATH_INFO: `/v3/projects/589b3cef05e74a8fa3eda541773125d0` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:02.203035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61868acf-5185-4e13-91a1-0fa4bde1b118 admin admin] RBAC: Authorizing `identity:delete_project(project_id=589b3cef05e74a8fa3eda541773125d0)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:02.204982 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61868acf-5185-4e13-91a1-0fa4bde1b118 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:02.290824 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-61868acf-5185-4e13-91a1-0fa4bde1b118 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '589b3cef05e74a8fa3eda541773125d0', 'request_id': 'req-61868acf-5185-4e13-91a1-0fa4bde1b118'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:02.297374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-61868acf-5185-4e13-91a1-0fa4bde1b118 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '589b3cef05e74a8fa3eda541773125d0', 'request_id': 'req-61868acf-5185-4e13-91a1-0fa4bde1b118'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:02.303424 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-61868acf-5185-4e13-91a1-0fa4bde1b118 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '589b3cef05e74a8fa3eda541773125d0', 'request_id': 'req-61868acf-5185-4e13-91a1-0fa4bde1b118'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:02.351494 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-61868acf-5185-4e13-91a1-0fa4bde1b118 admin admin] The token cache is being invalidate because project 589b3cef05e74a8fa3eda541773125d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:07:02.351807 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-61868acf-5185-4e13-91a1-0fa4bde1b118 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:02.352428 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-61868acf-5185-4e13-91a1-0fa4bde1b118 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:02.354080 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1422/2838] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:07:02 2022] DELETE /identity/v3/projects/589b3cef05e74a8fa3eda541773125d0 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:07:02.360217 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05f858-8dc4-4855-bf28-b43da83542ce None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:02.365177 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05f858-8dc4-4855-bf28-b43da83542ce None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:02.365177 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05f858-8dc4-4855-bf28-b43da83542ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:02.381939 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-ed05f858-8dc4-4855-bf28-b43da83542ce None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:07:02.383155 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-ed05f858-8dc4-4855-bf28-b43da83542ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:02.444713 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1417/2839] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:07:02.453130 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9bf44-803d-4134-9005-42266b0dbfec None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:02.453355 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9bf44-803d-4134-9005-42266b0dbfec None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:02.453636 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9bf44-803d-4134-9005-42266b0dbfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:02.473044 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-76e9bf44-803d-4134-9005-42266b0dbfec None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:07:02.474448 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-76e9bf44-803d-4134-9005-42266b0dbfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:02.482323 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1423/2840] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:07:02.486551 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05f858-8dc4-4855-bf28-b43da83542ce None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:02.496915 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05f858-8dc4-4855-bf28-b43da83542ce None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:02.501482 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f60c98-6dff-4337-a008-0d041703f7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:02.502128 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f60c98-6dff-4337-a008-0d041703f7d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:02.502412 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f60c98-6dff-4337-a008-0d041703f7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:02.502692 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f60c98-6dff-4337-a008-0d041703f7d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:02.503419 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f60c98-6dff-4337-a008-0d041703f7d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:07:02.503780 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f60c98-6dff-4337-a008-0d041703f7d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:02.506090 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f60c98-6dff-4337-a008-0d041703f7d8 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:02.518104 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1418/2841] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 09:07:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:07:02.525690 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9bf44-803d-4134-9005-42266b0dbfec None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:02.534874 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9bf44-803d-4134-9005-42266b0dbfec None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:02.539797 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f033d0-661e-4418-8ecb-fc2132ff229d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:02.540446 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f033d0-661e-4418-8ecb-fc2132ff229d admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:02.540731 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f033d0-661e-4418-8ecb-fc2132ff229d admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:02.541008 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f033d0-661e-4418-8ecb-fc2132ff229d admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:02.541701 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f033d0-661e-4418-8ecb-fc2132ff229d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:02.543594 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f033d0-661e-4418-8ecb-fc2132ff229d admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:02.651683 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1424/2842] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 09:07:02 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:07:02.655965 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f60c98-6dff-4337-a008-0d041703f7d8 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:02.666990 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f60c98-6dff-4337-a008-0d041703f7d8 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:02.695369 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:07:02.727959 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca0b48-bd81-4184-a9b8-64f0b3ad2962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:02.728635 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca0b48-bd81-4184-a9b8-64f0b3ad2962 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:02.728947 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca0b48-bd81-4184-a9b8-64f0b3ad2962 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:02.729220 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca0b48-bd81-4184-a9b8-64f0b3ad2962 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:02.729926 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca0b48-bd81-4184-a9b8-64f0b3ad2962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:02.731928 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca0b48-bd81-4184-a9b8-64f0b3ad2962 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:02.795361 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1419/2843] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 09:07:02 2022] POST /identity/v3/users => generated 288 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:07:02.799785 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f033d0-661e-4418-8ecb-fc2132ff229d admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:02.810978 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f033d0-661e-4418-8ecb-fc2132ff229d admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:02.815693 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0f0e8-a9bb-4f12-9b77-3f5971a22600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:02.816355 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0f0e8-a9bb-4f12-9b77-3f5971a22600 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:02.816636 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0f0e8-a9bb-4f12-9b77-3f5971a22600 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:02.816913 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0f0e8-a9bb-4f12-9b77-3f5971a22600 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:02.817657 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0f0e8-a9bb-4f12-9b77-3f5971a22600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:02.819382 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0f0e8-a9bb-4f12-9b77-3f5971a22600 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:02.829258 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1425/2844] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:07:02.833185 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca0b48-bd81-4184-a9b8-64f0b3ad2962 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:02.843325 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca0b48-bd81-4184-a9b8-64f0b3ad2962 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:02.847889 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18dd36-e247-4fed-8881-d22074c27f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:02.848537 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18dd36-e247-4fed-8881-d22074c27f71 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:02.848822 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18dd36-e247-4fed-8881-d22074c27f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:02.849614 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18dd36-e247-4fed-8881-d22074c27f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:02.850341 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18dd36-e247-4fed-8881-d22074c27f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:02.851943 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18dd36-e247-4fed-8881-d22074c27f71 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:02.862871 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1420/2845] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:07:02.867841 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0f0e8-a9bb-4f12-9b77-3f5971a22600 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:02.873263 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:07:02.878572 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0f0e8-a9bb-4f12-9b77-3f5971a22600 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:02.884036 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd223738-37f9-45e7-9a48-ba6cd267630e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:02.885782 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd223738-37f9-45e7-9a48-ba6cd267630e admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:02.885782 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd223738-37f9-45e7-9a48-ba6cd267630e admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:02.885782 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd223738-37f9-45e7-9a48-ba6cd267630e admin admin] PATH_INFO: `/v3/projects/c29508532ef246d3837d15b54a6f4e83/users/00f703cb108c44ac848be41379146143/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:02.901675 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd223738-37f9-45e7-9a48-ba6cd267630e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c29508532ef246d3837d15b54a6f4e83, user_id=00f703cb108c44ac848be41379146143, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:02.904370 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd223738-37f9-45e7-9a48-ba6cd267630e admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:02.998473 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1426/2846] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:07:02 2022] PUT /identity/v3/projects/c29508532ef246d3837d15b54a6f4e83/users/00f703cb108c44ac848be41379146143/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:07:03.014644 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22641f-9a9a-4034-80af-a0fcef9c5d24 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:03.014933 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22641f-9a9a-4034-80af-a0fcef9c5d24 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:03.015214 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22641f-9a9a-4034-80af-a0fcef9c5d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:03.045304 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-3e22641f-9a9a-4034-80af-a0fcef9c5d24 None None] MFA Rules not processed for user `00f703cb108c44ac848be41379146143`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:07:03.046513 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-3e22641f-9a9a-4034-80af-a0fcef9c5d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:03.117158 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1421/2847] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:07:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:07:03.128326 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd223738-37f9-45e7-9a48-ba6cd267630e admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:03.129986 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-cd223738-37f9-45e7-9a48-ba6cd267630e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:03.186161 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd223738-37f9-45e7-9a48-ba6cd267630e admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:03.190060 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdba445-f8f8-4903-a75b-ad384d5ed1ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:03.190777 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdba445-f8f8-4903-a75b-ad384d5ed1ce service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:03.191057 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdba445-f8f8-4903-a75b-ad384d5ed1ce service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:03.191332 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdba445-f8f8-4903-a75b-ad384d5ed1ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:03.200429 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdba445-f8f8-4903-a75b-ad384d5ed1ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:03.201852 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdba445-f8f8-4903-a75b-ad384d5ed1ce service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:03.210830 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1427/2848] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:07:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:07:07.062937 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22641f-9a9a-4034-80af-a0fcef9c5d24 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:07.126140 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22641f-9a9a-4034-80af-a0fcef9c5d24 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:07.130982 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf02708-da76-45fd-9f52-72bdf17fd862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:07.131996 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf02708-da76-45fd-9f52-72bdf17fd862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:07.132280 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf02708-da76-45fd-9f52-72bdf17fd862 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:07.132607 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf02708-da76-45fd-9f52-72bdf17fd862 admin admin] PATH_INFO: `/v3/users/00f703cb108c44ac848be41379146143` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:07.133779 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf02708-da76-45fd-9f52-72bdf17fd862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00f703cb108c44ac848be41379146143)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:07.135763 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf02708-da76-45fd-9f52-72bdf17fd862 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:07.292808 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:07:07.298703 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-abf02708-da76-45fd-9f52-72bdf17fd862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00f703cb108c44ac848be41379146143'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:07.299394 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-abf02708-da76-45fd-9f52-72bdf17fd862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00f703cb108c44ac848be41379146143'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:07.306440 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-abf02708-da76-45fd-9f52-72bdf17fd862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00f703cb108c44ac848be41379146143'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:07.307128 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-abf02708-da76-45fd-9f52-72bdf17fd862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00f703cb108c44ac848be41379146143'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:07.352088 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-abf02708-da76-45fd-9f52-72bdf17fd862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00f703cb108c44ac848be41379146143'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:07.369845 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1422/2849] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:07:07 2022] DELETE /identity/v3/users/00f703cb108c44ac848be41379146143 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:07:07.374528 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c948926-5e24-4345-b7e5-b61c7ae75ddc None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:07.375018 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c948926-5e24-4345-b7e5-b61c7ae75ddc None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:07.375130 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c948926-5e24-4345-b7e5-b61c7ae75ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:07.397479 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-0c948926-5e24-4345-b7e5-b61c7ae75ddc None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:07:07.400111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-0c948926-5e24-4345-b7e5-b61c7ae75ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:07.460810 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1428/2850] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:07:07.470689 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf02708-da76-45fd-9f52-72bdf17fd862 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:07.472179 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-abf02708-da76-45fd-9f52-72bdf17fd862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:07.531524 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf02708-da76-45fd-9f52-72bdf17fd862 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:07.535203 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc46b1-b097-4125-bd28-713bd76ed5dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:07.535885 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc46b1-b097-4125-bd28-713bd76ed5dc service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:07.536174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc46b1-b097-4125-bd28-713bd76ed5dc service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:07.536459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc46b1-b097-4125-bd28-713bd76ed5dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:07.545976 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc46b1-b097-4125-bd28-713bd76ed5dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:07.547331 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc46b1-b097-4125-bd28-713bd76ed5dc service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:07.557537 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1423/2851] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:07:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:07:07.977292 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c948926-5e24-4345-b7e5-b61c7ae75ddc None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:07.978797 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-0c948926-5e24-4345-b7e5-b61c7ae75ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:07.992767 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c948926-5e24-4345-b7e5-b61c7ae75ddc None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:07.997539 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ba26d-7c88-45fe-b223-155b73ff5b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:07.998583 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ba26d-7c88-45fe-b223-155b73ff5b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:07.998894 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ba26d-7c88-45fe-b223-155b73ff5b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:07.999187 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ba26d-7c88-45fe-b223-155b73ff5b48 admin admin] PATH_INFO: `/v3/projects/c29508532ef246d3837d15b54a6f4e83` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:08.000538 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ba26d-7c88-45fe-b223-155b73ff5b48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c29508532ef246d3837d15b54a6f4e83)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:08.002724 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ba26d-7c88-45fe-b223-155b73ff5b48 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:08.101038 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-209ba26d-7c88-45fe-b223-155b73ff5b48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c29508532ef246d3837d15b54a6f4e83', 'request_id': 'req-209ba26d-7c88-45fe-b223-155b73ff5b48'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:08.107178 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-209ba26d-7c88-45fe-b223-155b73ff5b48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c29508532ef246d3837d15b54a6f4e83', 'request_id': 'req-209ba26d-7c88-45fe-b223-155b73ff5b48'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:08.112722 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-209ba26d-7c88-45fe-b223-155b73ff5b48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c29508532ef246d3837d15b54a6f4e83', 'request_id': 'req-209ba26d-7c88-45fe-b223-155b73ff5b48'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:08.209322 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-209ba26d-7c88-45fe-b223-155b73ff5b48 admin admin] The token cache is being invalidate because project c29508532ef246d3837d15b54a6f4e83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:07:08.209638 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-209ba26d-7c88-45fe-b223-155b73ff5b48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:08.210330 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-209ba26d-7c88-45fe-b223-155b73ff5b48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:08.212683 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1429/2852] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:07:07 2022] DELETE /identity/v3/projects/c29508532ef246d3837d15b54a6f4e83 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:07:08.217956 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a2092-0e0d-4a29-8740-e364a67f8a98 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:08.218473 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a2092-0e0d-4a29-8740-e364a67f8a98 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:08.218590 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a2092-0e0d-4a29-8740-e364a67f8a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:08.241138 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-3b5a2092-0e0d-4a29-8740-e364a67f8a98 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:07:08.243835 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-3b5a2092-0e0d-4a29-8740-e364a67f8a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:08.307848 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1424/2853] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:07:08.315595 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca173f63-5df6-44f8-91c0-d9f97eadeebd None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:08.315917 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca173f63-5df6-44f8-91c0-d9f97eadeebd None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:08.316194 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca173f63-5df6-44f8-91c0-d9f97eadeebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:08.326691 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:07:08.339291 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-ca173f63-5df6-44f8-91c0-d9f97eadeebd None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:07:08.340693 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-ca173f63-5df6-44f8-91c0-d9f97eadeebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:08.349418 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1430/2854] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:07:08.354655 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a2092-0e0d-4a29-8740-e364a67f8a98 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:08.365468 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a2092-0e0d-4a29-8740-e364a67f8a98 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:08.371936 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d10f71-97f0-4f3a-83d3-976a88efa332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:08.371936 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d10f71-97f0-4f3a-83d3-976a88efa332 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:08.371936 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d10f71-97f0-4f3a-83d3-976a88efa332 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:08.371936 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d10f71-97f0-4f3a-83d3-976a88efa332 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:08.372782 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d10f71-97f0-4f3a-83d3-976a88efa332 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:07:08.373095 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d10f71-97f0-4f3a-83d3-976a88efa332 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:08.374734 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d10f71-97f0-4f3a-83d3-976a88efa332 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:08.386954 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1425/2855] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 09:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:07:08.391546 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca173f63-5df6-44f8-91c0-d9f97eadeebd None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:08.403730 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca173f63-5df6-44f8-91c0-d9f97eadeebd None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:08.408936 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870ed05-5798-477d-9998-28681dd68699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:08.409128 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870ed05-5798-477d-9998-28681dd68699 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:08.409369 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870ed05-5798-477d-9998-28681dd68699 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:08.409671 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870ed05-5798-477d-9998-28681dd68699 admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:08.410388 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870ed05-5798-477d-9998-28681dd68699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:08.412328 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870ed05-5798-477d-9998-28681dd68699 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:08.526682 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1431/2856] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 09:07:08 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:07:08.530451 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d10f71-97f0-4f3a-83d3-976a88efa332 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:08.542439 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d10f71-97f0-4f3a-83d3-976a88efa332 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:08.589482 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:07:08.603822 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3152a-e1bb-49a2-b1bd-44004d76d4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:08.604501 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3152a-e1bb-49a2-b1bd-44004d76d4df admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:08.604840 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3152a-e1bb-49a2-b1bd-44004d76d4df admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:08.605065 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3152a-e1bb-49a2-b1bd-44004d76d4df admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:08.605761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a3152a-e1bb-49a2-b1bd-44004d76d4df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:08.607868 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a3152a-e1bb-49a2-b1bd-44004d76d4df admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:08.730382 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1426/2857] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 09:07:08 2022] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:07:08.734640 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870ed05-5798-477d-9998-28681dd68699 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:08.745755 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870ed05-5798-477d-9998-28681dd68699 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:08.750522 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2eefb-49fe-4809-aadb-460925498dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:08.751167 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2eefb-49fe-4809-aadb-460925498dff admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:08.751454 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2eefb-49fe-4809-aadb-460925498dff admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:08.751770 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2eefb-49fe-4809-aadb-460925498dff admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:08.752510 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2eefb-49fe-4809-aadb-460925498dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:08.754109 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2eefb-49fe-4809-aadb-460925498dff admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:08.764509 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1432/2858] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:07:08.769066 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3152a-e1bb-49a2-b1bd-44004d76d4df admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:08.780459 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3152a-e1bb-49a2-b1bd-44004d76d4df admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:08.785533 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10e34a-7fff-4806-8e07-45f677039f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:08.790635 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10e34a-7fff-4806-8e07-45f677039f96 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:08.790635 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10e34a-7fff-4806-8e07-45f677039f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:08.790635 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10e34a-7fff-4806-8e07-45f677039f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:08.790635 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10e34a-7fff-4806-8e07-45f677039f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:08.790635 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10e34a-7fff-4806-8e07-45f677039f96 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:08.800952 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1427/2859] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:07:08.805812 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2eefb-49fe-4809-aadb-460925498dff admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:08.816431 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2eefb-49fe-4809-aadb-460925498dff admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:08.821191 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b906c36-09f2-4184-8272-9db78018e794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:08.822072 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b906c36-09f2-4184-8272-9db78018e794 admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:08.822353 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b906c36-09f2-4184-8272-9db78018e794 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:08.822631 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b906c36-09f2-4184-8272-9db78018e794 admin admin] PATH_INFO: `/v3/projects/11f64413992b4a36bf318a87beb4d784/users/c5ee90870d7b49a2889f93dc40db8b88/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:08.837349 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b906c36-09f2-4184-8272-9db78018e794 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11f64413992b4a36bf318a87beb4d784, user_id=c5ee90870d7b49a2889f93dc40db8b88, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:08.840024 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b906c36-09f2-4184-8272-9db78018e794 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:08.906689 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1433/2860] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:07:08 2022] PUT /identity/v3/projects/11f64413992b4a36bf318a87beb4d784/users/c5ee90870d7b49a2889f93dc40db8b88/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 09:07:08.926061 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87500c9-149d-4cd3-af75-bd63f7656ba5 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:08.926351 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87500c9-149d-4cd3-af75-bd63f7656ba5 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:08.926630 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87500c9-149d-4cd3-af75-bd63f7656ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:08.958186 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-f87500c9-149d-4cd3-af75-bd63f7656ba5 None None] MFA Rules not processed for user `c5ee90870d7b49a2889f93dc40db8b88`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:07:08.959428 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f87500c9-149d-4cd3-af75-bd63f7656ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:09.023380 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1428/2861] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:07:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:07:09.028240 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b906c36-09f2-4184-8272-9db78018e794 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:09.092812 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b906c36-09f2-4184-8272-9db78018e794 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:09.098131 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60595058-8351-4d78-8d4a-2922f37fd63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:09.098888 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60595058-8351-4d78-8d4a-2922f37fd63f admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:09.099218 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60595058-8351-4d78-8d4a-2922f37fd63f admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:09.099556 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60595058-8351-4d78-8d4a-2922f37fd63f admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:09.100390 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60595058-8351-4d78-8d4a-2922f37fd63f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:09.104750 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60595058-8351-4d78-8d4a-2922f37fd63f admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:09.204865 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1434/2862] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 09:07:09 2022] POST /identity/v3/projects => generated 375 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:07:09.208886 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87500c9-149d-4cd3-af75-bd63f7656ba5 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:09.220346 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87500c9-149d-4cd3-af75-bd63f7656ba5 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:09.277929 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72462bb8-de0a-4feb-8793-9d6517668414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:09.278607 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72462bb8-de0a-4feb-8793-9d6517668414 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:09.278897 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72462bb8-de0a-4feb-8793-9d6517668414 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:09.279181 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72462bb8-de0a-4feb-8793-9d6517668414 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:09.279930 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72462bb8-de0a-4feb-8793-9d6517668414 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:09.281849 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72462bb8-de0a-4feb-8793-9d6517668414 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:09.376584 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1429/2863] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 09:07:09 2022] POST /identity/v3/users => generated 288 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:07:09.379368 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60595058-8351-4d78-8d4a-2922f37fd63f admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:09.390681 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60595058-8351-4d78-8d4a-2922f37fd63f admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:09.395861 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82135623-8460-499e-be90-a00c1a361b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:09.396569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82135623-8460-499e-be90-a00c1a361b85 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:09.396854 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82135623-8460-499e-be90-a00c1a361b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:09.397132 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82135623-8460-499e-be90-a00c1a361b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:09.397898 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82135623-8460-499e-be90-a00c1a361b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:09.400134 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82135623-8460-499e-be90-a00c1a361b85 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:09.410621 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1435/2864] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:07:09.415050 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72462bb8-de0a-4feb-8793-9d6517668414 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:09.424946 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72462bb8-de0a-4feb-8793-9d6517668414 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:09.430176 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7dc24a-c01f-4297-8435-7ae7d6cf67a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:09.430823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7dc24a-c01f-4297-8435-7ae7d6cf67a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:09.431107 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7dc24a-c01f-4297-8435-7ae7d6cf67a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:09.431384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7dc24a-c01f-4297-8435-7ae7d6cf67a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:09.432144 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7dc24a-c01f-4297-8435-7ae7d6cf67a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:09.433730 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7dc24a-c01f-4297-8435-7ae7d6cf67a3 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:09.443764 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1430/2865] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:07:09.448392 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82135623-8460-499e-be90-a00c1a361b85 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:09.459121 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82135623-8460-499e-be90-a00c1a361b85 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:09.464009 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0f186-0956-4dad-96a4-80f26bb005ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:09.464968 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0f186-0956-4dad-96a4-80f26bb005ec admin admin] REQUEST_METHOD: `PUT` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:09.465277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0f186-0956-4dad-96a4-80f26bb005ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:09.465569 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0f186-0956-4dad-96a4-80f26bb005ec admin admin] PATH_INFO: `/v3/projects/eafea843e6ab4ccb88f7a228c16351b9/users/619d311ff5b84b16acfe3d819823e878/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:09.482093 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0f186-0956-4dad-96a4-80f26bb005ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=eafea843e6ab4ccb88f7a228c16351b9, user_id=619d311ff5b84b16acfe3d819823e878, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:09.485015 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0f186-0956-4dad-96a4-80f26bb005ec admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:09.559599 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1436/2866] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:07:09 2022] PUT /identity/v3/projects/eafea843e6ab4ccb88f7a228c16351b9/users/619d311ff5b84b16acfe3d819823e878/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:07:09.571951 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35b5c5-3295-46e1-b505-069fe6d90384 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:09.572248 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35b5c5-3295-46e1-b505-069fe6d90384 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:09.572534 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35b5c5-3295-46e1-b505-069fe6d90384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:09.600774 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-3f35b5c5-3295-46e1-b505-069fe6d90384 None None] MFA Rules not processed for user `619d311ff5b84b16acfe3d819823e878`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:07:09.602676 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-3f35b5c5-3295-46e1-b505-069fe6d90384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:09.623065 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:07:09.676465 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1431/2867] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:07:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:07:09.681111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0f186-0956-4dad-96a4-80f26bb005ec admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:09.735686 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:07:09.747713 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0f186-0956-4dad-96a4-80f26bb005ec admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:09.752554 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e171ea4-d372-4692-9cf8-12f403782432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:09.753212 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e171ea4-d372-4692-9cf8-12f403782432 admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:09.753498 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e171ea4-d372-4692-9cf8-12f403782432 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:09.753778 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e171ea4-d372-4692-9cf8-12f403782432 admin admin] PATH_INFO: `/v3/projects` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:09.754479 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e171ea4-d372-4692-9cf8-12f403782432 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:09.756477 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e171ea4-d372-4692-9cf8-12f403782432 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:09.844458 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1437/2868] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 09:07:09 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:07:09.845646 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35b5c5-3295-46e1-b505-069fe6d90384 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:09.858761 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35b5c5-3295-46e1-b505-069fe6d90384 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:09.921519 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce96c09-237a-4161-9603-5b1b1c85957a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:09.922427 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce96c09-237a-4161-9603-5b1b1c85957a admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:09.922806 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce96c09-237a-4161-9603-5b1b1c85957a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:09.923093 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce96c09-237a-4161-9603-5b1b1c85957a admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:09.923833 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce96c09-237a-4161-9603-5b1b1c85957a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:09.925750 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce96c09-237a-4161-9603-5b1b1c85957a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:10.038592 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1432/2869] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 09:07:09 2022] POST /identity/v3/users => generated 295 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:07:10.043536 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e171ea4-d372-4692-9cf8-12f403782432 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:10.054833 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e171ea4-d372-4692-9cf8-12f403782432 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:10.059949 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a605d3b-d643-439b-be6d-ee42798a1744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:10.060606 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a605d3b-d643-439b-be6d-ee42798a1744 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:10.060892 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a605d3b-d643-439b-be6d-ee42798a1744 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:10.061242 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a605d3b-d643-439b-be6d-ee42798a1744 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:10.062111 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a605d3b-d643-439b-be6d-ee42798a1744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:10.063860 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a605d3b-d643-439b-be6d-ee42798a1744 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:10.074666 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1438/2870] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 09:07:10.078799 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce96c09-237a-4161-9603-5b1b1c85957a admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:10.090485 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce96c09-237a-4161-9603-5b1b1c85957a admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:10.095627 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3775a9-0070-4291-92cf-036a68165c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:10.096539 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3775a9-0070-4291-92cf-036a68165c13 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:10.096848 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3775a9-0070-4291-92cf-036a68165c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:10.097125 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3775a9-0070-4291-92cf-036a68165c13 admin admin] PATH_INFO: `/v3/projects/a92ad93762c84f0dbc76cb9419f3168d/users/8c1f5c7e2e54427a8cfb017a74183a98/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:10.115068 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3775a9-0070-4291-92cf-036a68165c13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a92ad93762c84f0dbc76cb9419f3168d, user_id=8c1f5c7e2e54427a8cfb017a74183a98, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:10.118636 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3775a9-0070-4291-92cf-036a68165c13 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:10.188054 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1433/2871] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:07:10 2022] PUT /identity/v3/projects/a92ad93762c84f0dbc76cb9419f3168d/users/8c1f5c7e2e54427a8cfb017a74183a98/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 09:07:10.192098 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a605d3b-d643-439b-be6d-ee42798a1744 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:10.202452 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a605d3b-d643-439b-be6d-ee42798a1744 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:10.260202 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc226cf9-509d-40f5-8d49-0a89d859a8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:10.260906 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc226cf9-509d-40f5-8d49-0a89d859a8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:10.261165 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc226cf9-509d-40f5-8d49-0a89d859a8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:10.261448 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc226cf9-509d-40f5-8d49-0a89d859a8c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:10.262174 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc226cf9-509d-40f5-8d49-0a89d859a8c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:10.263819 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc226cf9-509d-40f5-8d49-0a89d859a8c1 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:10.277355 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1439/2872] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:07:10.281928 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3775a9-0070-4291-92cf-036a68165c13 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:10.294171 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3775a9-0070-4291-92cf-036a68165c13 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:10.298898 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff898eeb-9d1d-4d9e-a828-39cb4a0b7d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:10.300014 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff898eeb-9d1d-4d9e-a828-39cb4a0b7d39 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:10.300368 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff898eeb-9d1d-4d9e-a828-39cb4a0b7d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:10.300645 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff898eeb-9d1d-4d9e-a828-39cb4a0b7d39 admin admin] PATH_INFO: `/v3/projects/a92ad93762c84f0dbc76cb9419f3168d/users/8c1f5c7e2e54427a8cfb017a74183a98/roles/25b0f48c10474bf6b98aad8f093868ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:10.302931 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff898eeb-9d1d-4d9e-a828-39cb4a0b7d39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a92ad93762c84f0dbc76cb9419f3168d, user_id=8c1f5c7e2e54427a8cfb017a74183a98, role_id=25b0f48c10474bf6b98aad8f093868ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:10.306076 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff898eeb-9d1d-4d9e-a828-39cb4a0b7d39 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:10.317155 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1434/2873] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:07:10 2022] PUT /identity/v3/projects/a92ad93762c84f0dbc76cb9419f3168d/users/8c1f5c7e2e54427a8cfb017a74183a98/roles/25b0f48c10474bf6b98aad8f093868ee => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 09:07:10.328176 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a45849-939c-418c-9b40-214942a1e686 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:10.328470 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a45849-939c-418c-9b40-214942a1e686 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:10.328873 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a45849-939c-418c-9b40-214942a1e686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:10.356633 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-d8a45849-939c-418c-9b40-214942a1e686 None None] MFA Rules not processed for user `8c1f5c7e2e54427a8cfb017a74183a98`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:07:10.357876 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-d8a45849-939c-418c-9b40-214942a1e686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:10.428754 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1440/2874] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:07:10 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:07:10.440777 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff898eeb-9d1d-4d9e-a828-39cb4a0b7d39 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:10.442466 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-ff898eeb-9d1d-4d9e-a828-39cb4a0b7d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:10.500418 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff898eeb-9d1d-4d9e-a828-39cb4a0b7d39 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:10.504174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40ed9c-cca8-43b1-b3f4-4908f5932bbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:10.504823 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40ed9c-cca8-43b1-b3f4-4908f5932bbc service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:10.505103 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40ed9c-cca8-43b1-b3f4-4908f5932bbc service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:10.505384 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40ed9c-cca8-43b1-b3f4-4908f5932bbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:10.534925 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:07:10.564558 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca40ed9c-cca8-43b1-b3f4-4908f5932bbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:10.566038 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca40ed9c-cca8-43b1-b3f4-4908f5932bbc service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:10.577921 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1435/2875] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:07:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:07:12.411471 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a45849-939c-418c-9b40-214942a1e686 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:12.412967 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-d8a45849-939c-418c-9b40-214942a1e686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:12.425403 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a45849-939c-418c-9b40-214942a1e686 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:12.429007 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b84d22-b60a-43e5-bdb1-6b89cad599aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:12.429654 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b84d22-b60a-43e5-bdb1-6b89cad599aa service cinder] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:12.429937 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b84d22-b60a-43e5-bdb1-6b89cad599aa service cinder] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:12.430365 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b84d22-b60a-43e5-bdb1-6b89cad599aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:12.475474 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:07:12.488208 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b84d22-b60a-43e5-bdb1-6b89cad599aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:12.489670 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b84d22-b60a-43e5-bdb1-6b89cad599aa service cinder] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:12.499033 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1441/2876] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:07:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:07:13.707576 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40ed9c-cca8-43b1-b3f4-4908f5932bbc service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:13.716662 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40ed9c-cca8-43b1-b3f4-4908f5932bbc service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:13.720277 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65229747-4def-4cc9-92b0-b815936d9ee8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:13.720911 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65229747-4def-4cc9-92b0-b815936d9ee8 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:13.721191 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65229747-4def-4cc9-92b0-b815936d9ee8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:13.721467 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65229747-4def-4cc9-92b0-b815936d9ee8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:13.730480 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65229747-4def-4cc9-92b0-b815936d9ee8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:13.731992 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65229747-4def-4cc9-92b0-b815936d9ee8 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:13.741344 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1436/2877] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:07:13 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:07:18.275168 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b84d22-b60a-43e5-bdb1-6b89cad599aa service cinder] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:18.337807 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b84d22-b60a-43e5-bdb1-6b89cad599aa service cinder] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:18.342884 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c92d72-65ce-4b36-b903-a24d6ea303c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:18.343929 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c92d72-65ce-4b36-b903-a24d6ea303c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:18.344212 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c92d72-65ce-4b36-b903-a24d6ea303c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:18.344483 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c92d72-65ce-4b36-b903-a24d6ea303c2 admin admin] PATH_INFO: `/v3/users/c5ee90870d7b49a2889f93dc40db8b88` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:18.345672 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c92d72-65ce-4b36-b903-a24d6ea303c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5ee90870d7b49a2889f93dc40db8b88)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:18.347589 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c92d72-65ce-4b36-b903-a24d6ea303c2 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:18.502899 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-c1c92d72-65ce-4b36-b903-a24d6ea303c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5ee90870d7b49a2889f93dc40db8b88'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:18.503546 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-c1c92d72-65ce-4b36-b903-a24d6ea303c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5ee90870d7b49a2889f93dc40db8b88'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:18.504210 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-c1c92d72-65ce-4b36-b903-a24d6ea303c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5ee90870d7b49a2889f93dc40db8b88'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:18.511041 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-c1c92d72-65ce-4b36-b903-a24d6ea303c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5ee90870d7b49a2889f93dc40db8b88'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:18.648687 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-c1c92d72-65ce-4b36-b903-a24d6ea303c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5ee90870d7b49a2889f93dc40db8b88'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:18.667912 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1442/2878] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:07:18 2022] DELETE /identity/v3/users/c5ee90870d7b49a2889f93dc40db8b88 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:07:18.672787 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180c0e7-918b-4c5f-85c9-2814bf751e8d None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:18.673328 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180c0e7-918b-4c5f-85c9-2814bf751e8d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:18.673433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180c0e7-918b-4c5f-85c9-2814bf751e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:18.693170 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-c180c0e7-918b-4c5f-85c9-2814bf751e8d None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:07:18.694376 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c180c0e7-918b-4c5f-85c9-2814bf751e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:18.763433 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1437/2879] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:07:18.773324 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c92d72-65ce-4b36-b903-a24d6ea303c2 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:18.774756 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-c1c92d72-65ce-4b36-b903-a24d6ea303c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:18.832104 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c92d72-65ce-4b36-b903-a24d6ea303c2 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:18.836140 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b886147-1348-48ab-94dc-72c0227cb644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:18.836790 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b886147-1348-48ab-94dc-72c0227cb644 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:18.837072 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b886147-1348-48ab-94dc-72c0227cb644 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:18.837343 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b886147-1348-48ab-94dc-72c0227cb644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:18.847680 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b886147-1348-48ab-94dc-72c0227cb644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:18.849099 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b886147-1348-48ab-94dc-72c0227cb644 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:18.862342 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1443/2880] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:07:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:07:19.222662 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180c0e7-918b-4c5f-85c9-2814bf751e8d None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:19.224164 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c180c0e7-918b-4c5f-85c9-2814bf751e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:19.237050 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180c0e7-918b-4c5f-85c9-2814bf751e8d None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:19.241963 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94decf46-9f10-4888-a9d8-787594e29b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:19.242826 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94decf46-9f10-4888-a9d8-787594e29b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:19.243174 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94decf46-9f10-4888-a9d8-787594e29b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:19.243528 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94decf46-9f10-4888-a9d8-787594e29b0d admin admin] PATH_INFO: `/v3/projects/11f64413992b4a36bf318a87beb4d784` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:19.244855 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94decf46-9f10-4888-a9d8-787594e29b0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=11f64413992b4a36bf318a87beb4d784)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:19.246944 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94decf46-9f10-4888-a9d8-787594e29b0d admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:19.335755 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-94decf46-9f10-4888-a9d8-787594e29b0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11f64413992b4a36bf318a87beb4d784', 'request_id': 'req-94decf46-9f10-4888-a9d8-787594e29b0d'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:19.342675 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-94decf46-9f10-4888-a9d8-787594e29b0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11f64413992b4a36bf318a87beb4d784', 'request_id': 'req-94decf46-9f10-4888-a9d8-787594e29b0d'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:19.348134 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-94decf46-9f10-4888-a9d8-787594e29b0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11f64413992b4a36bf318a87beb4d784', 'request_id': 'req-94decf46-9f10-4888-a9d8-787594e29b0d'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:19.397230 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-94decf46-9f10-4888-a9d8-787594e29b0d admin admin] The token cache is being invalidate because project 11f64413992b4a36bf318a87beb4d784 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:07:19.397523 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-94decf46-9f10-4888-a9d8-787594e29b0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:19.398148 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-94decf46-9f10-4888-a9d8-787594e29b0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:19.399717 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1438/2881] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:07:19 2022] DELETE /identity/v3/projects/11f64413992b4a36bf318a87beb4d784 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:07:19.405053 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b886147-1348-48ab-94dc-72c0227cb644 service neutron] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:19.414645 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b886147-1348-48ab-94dc-72c0227cb644 service neutron] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:19.418243 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:07:19.472072 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb856d42-3733-4a27-8c11-364cf90bfb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:19.472950 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb856d42-3733-4a27-8c11-364cf90bfb98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:19.473236 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb856d42-3733-4a27-8c11-364cf90bfb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:19.473514 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb856d42-3733-4a27-8c11-364cf90bfb98 admin admin] PATH_INFO: `/v3/users/619d311ff5b84b16acfe3d819823e878` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:19.474766 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb856d42-3733-4a27-8c11-364cf90bfb98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=619d311ff5b84b16acfe3d819823e878)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:19.476808 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb856d42-3733-4a27-8c11-364cf90bfb98 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:19.668499 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-cb856d42-3733-4a27-8c11-364cf90bfb98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '619d311ff5b84b16acfe3d819823e878'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:19.669114 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-cb856d42-3733-4a27-8c11-364cf90bfb98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '619d311ff5b84b16acfe3d819823e878'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:19.669752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-cb856d42-3733-4a27-8c11-364cf90bfb98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '619d311ff5b84b16acfe3d819823e878'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:19.676636 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-cb856d42-3733-4a27-8c11-364cf90bfb98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '619d311ff5b84b16acfe3d819823e878'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:19.780900 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-cb856d42-3733-4a27-8c11-364cf90bfb98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '619d311ff5b84b16acfe3d819823e878'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:19.799620 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1444/2882] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:07:19 2022] DELETE /identity/v3/users/619d311ff5b84b16acfe3d819823e878 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 09:07:20.199325 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94decf46-9f10-4888-a9d8-787594e29b0d admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:20.201000 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-94decf46-9f10-4888-a9d8-787594e29b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:20.215409 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94decf46-9f10-4888-a9d8-787594e29b0d admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:20.258225 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:07:20.277824 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d5534-9a9f-4c2a-978e-c5be1dbe48cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:20.278710 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d5534-9a9f-4c2a-978e-c5be1dbe48cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:20.279051 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d5534-9a9f-4c2a-978e-c5be1dbe48cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:20.279362 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d5534-9a9f-4c2a-978e-c5be1dbe48cf admin admin] PATH_INFO: `/v3/projects/eafea843e6ab4ccb88f7a228c16351b9` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:20.280565 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d5534-9a9f-4c2a-978e-c5be1dbe48cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=eafea843e6ab4ccb88f7a228c16351b9)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:20.282516 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d5534-9a9f-4c2a-978e-c5be1dbe48cf admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:20.444950 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f16d5534-9a9f-4c2a-978e-c5be1dbe48cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eafea843e6ab4ccb88f7a228c16351b9', 'request_id': 'req-f16d5534-9a9f-4c2a-978e-c5be1dbe48cf'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:20.451449 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f16d5534-9a9f-4c2a-978e-c5be1dbe48cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eafea843e6ab4ccb88f7a228c16351b9', 'request_id': 'req-f16d5534-9a9f-4c2a-978e-c5be1dbe48cf'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:20.457079 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f16d5534-9a9f-4c2a-978e-c5be1dbe48cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eafea843e6ab4ccb88f7a228c16351b9', 'request_id': 'req-f16d5534-9a9f-4c2a-978e-c5be1dbe48cf'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:20.533807 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f16d5534-9a9f-4c2a-978e-c5be1dbe48cf admin admin] The token cache is being invalidate because project eafea843e6ab4ccb88f7a228c16351b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:07:20.534023 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f16d5534-9a9f-4c2a-978e-c5be1dbe48cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:20.534633 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f16d5534-9a9f-4c2a-978e-c5be1dbe48cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:20.536187 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1439/2883] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:07:20 2022] DELETE /identity/v3/projects/eafea843e6ab4ccb88f7a228c16351b9 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:07:20.540298 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb856d42-3733-4a27-8c11-364cf90bfb98 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:20.541752 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-cb856d42-3733-4a27-8c11-364cf90bfb98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:20.555814 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb856d42-3733-4a27-8c11-364cf90bfb98 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:20.613735 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f591959-032f-49b5-a2d8-fd0d9899899e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:20.614599 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f591959-032f-49b5-a2d8-fd0d9899899e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:20.614882 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f591959-032f-49b5-a2d8-fd0d9899899e admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:20.615159 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f591959-032f-49b5-a2d8-fd0d9899899e admin admin] PATH_INFO: `/v3/users/8c1f5c7e2e54427a8cfb017a74183a98` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:20.616347 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f591959-032f-49b5-a2d8-fd0d9899899e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c1f5c7e2e54427a8cfb017a74183a98)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:20.618367 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f591959-032f-49b5-a2d8-fd0d9899899e admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:20.793878 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:07:20.885567 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-2f591959-032f-49b5-a2d8-fd0d9899899e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c1f5c7e2e54427a8cfb017a74183a98'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:20.887037 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-2f591959-032f-49b5-a2d8-fd0d9899899e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c1f5c7e2e54427a8cfb017a74183a98'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:20.887696 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-2f591959-032f-49b5-a2d8-fd0d9899899e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c1f5c7e2e54427a8cfb017a74183a98'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:20.894618 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-2f591959-032f-49b5-a2d8-fd0d9899899e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c1f5c7e2e54427a8cfb017a74183a98'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:20.962986 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-2f591959-032f-49b5-a2d8-fd0d9899899e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c1f5c7e2e54427a8cfb017a74183a98'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:20.980859 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1445/2884] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:07:20 2022] DELETE /identity/v3/users/8c1f5c7e2e54427a8cfb017a74183a98 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:07:21.394008 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d5534-9a9f-4c2a-978e-c5be1dbe48cf admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:21.395534 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f16d5534-9a9f-4c2a-978e-c5be1dbe48cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:21.409122 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d5534-9a9f-4c2a-978e-c5be1dbe48cf admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:21.466787 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19cce45-92a1-4513-98f7-611f3fb9b319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:21.467670 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cce45-92a1-4513-98f7-611f3fb9b319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:21.467957 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cce45-92a1-4513-98f7-611f3fb9b319 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:21.468237 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cce45-92a1-4513-98f7-611f3fb9b319 admin admin] PATH_INFO: `/v3/projects/a92ad93762c84f0dbc76cb9419f3168d` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:21.469436 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19cce45-92a1-4513-98f7-611f3fb9b319 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a92ad93762c84f0dbc76cb9419f3168d)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:21.471328 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19cce45-92a1-4513-98f7-611f3fb9b319 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:21.580694 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-e19cce45-92a1-4513-98f7-611f3fb9b319 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a92ad93762c84f0dbc76cb9419f3168d', 'request_id': 'req-e19cce45-92a1-4513-98f7-611f3fb9b319'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:21.586904 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-e19cce45-92a1-4513-98f7-611f3fb9b319 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a92ad93762c84f0dbc76cb9419f3168d', 'request_id': 'req-e19cce45-92a1-4513-98f7-611f3fb9b319'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:21.593675 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-e19cce45-92a1-4513-98f7-611f3fb9b319 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a92ad93762c84f0dbc76cb9419f3168d', 'request_id': 'req-e19cce45-92a1-4513-98f7-611f3fb9b319'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:21.668385 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:07:21.672189 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-e19cce45-92a1-4513-98f7-611f3fb9b319 admin admin] The token cache is being invalidate because project a92ad93762c84f0dbc76cb9419f3168d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:07:21.672476 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-e19cce45-92a1-4513-98f7-611f3fb9b319 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:21.673118 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-e19cce45-92a1-4513-98f7-611f3fb9b319 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:07:21.674651 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1440/2885] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:07:21 2022] DELETE /identity/v3/projects/a92ad93762c84f0dbc76cb9419f3168d => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 09:07:21.679805 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bae12-c7d5-4ea8-ba95-e7f6efdc4301 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:21.680277 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bae12-c7d5-4ea8-ba95-e7f6efdc4301 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:21.680400 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bae12-c7d5-4ea8-ba95-e7f6efdc4301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:21.700834 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-300bae12-c7d5-4ea8-ba95-e7f6efdc4301 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:07:21.702135 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-300bae12-c7d5-4ea8-ba95-e7f6efdc4301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:21.765977 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1446/2886] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:07:21.774283 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d350a3b-8f1a-414c-b978-ac0aaa782123 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:21.774573 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d350a3b-8f1a-414c-b978-ac0aaa782123 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:21.774857 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d350a3b-8f1a-414c-b978-ac0aaa782123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:21.795849 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-1d350a3b-8f1a-414c-b978-ac0aaa782123 None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:07:21.797065 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-1d350a3b-8f1a-414c-b978-ac0aaa782123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:21.805150 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1441/2887] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:07:21.809650 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bae12-c7d5-4ea8-ba95-e7f6efdc4301 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:21.819371 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bae12-c7d5-4ea8-ba95-e7f6efdc4301 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:21.824247 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df95ed-1e8c-49f3-8455-73b2f58d3c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:21.825061 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df95ed-1e8c-49f3-8455-73b2f58d3c44 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:21.825354 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df95ed-1e8c-49f3-8455-73b2f58d3c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:21.825668 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df95ed-1e8c-49f3-8455-73b2f58d3c44 admin admin] PATH_INFO: `/v3/domains` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:21.826436 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df95ed-1e8c-49f3-8455-73b2f58d3c44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:07:21.826749 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df95ed-1e8c-49f3-8455-73b2f58d3c44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:21.828446 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df95ed-1e8c-49f3-8455-73b2f58d3c44 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:21.840675 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1447/2888] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 09:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:07:21.845222 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d350a3b-8f1a-414c-b978-ac0aaa782123 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:21.855084 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d350a3b-8f1a-414c-b978-ac0aaa782123 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:21.859842 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f2e45-3395-4b7c-84a7-03bd216a4201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:21.860494 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f2e45-3395-4b7c-84a7-03bd216a4201 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:21.860778 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f2e45-3395-4b7c-84a7-03bd216a4201 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:21.861056 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f2e45-3395-4b7c-84a7-03bd216a4201 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:21.861751 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f2e45-3395-4b7c-84a7-03bd216a4201 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:21.863659 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f2e45-3395-4b7c-84a7-03bd216a4201 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:21.936142 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1442/2889] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 09:07:21 2022] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:07:21.941881 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df95ed-1e8c-49f3-8455-73b2f58d3c44 admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:21.952232 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df95ed-1e8c-49f3-8455-73b2f58d3c44 admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:22.010035 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36740e-49d9-49b4-9744-173ee451cf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:22.010727 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36740e-49d9-49b4-9744-173ee451cf9b admin admin] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:22.011013 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36740e-49d9-49b4-9744-173ee451cf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:22.011332 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36740e-49d9-49b4-9744-173ee451cf9b admin admin] PATH_INFO: `/v3/users` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:22.012023 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36740e-49d9-49b4-9744-173ee451cf9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:22.013929 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36740e-49d9-49b4-9744-173ee451cf9b admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:22.072344 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1448/2890] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 09:07:21 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:07:22.077421 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f2e45-3395-4b7c-84a7-03bd216a4201 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:22.087999 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f2e45-3395-4b7c-84a7-03bd216a4201 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:22.093750 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3880b5-ca69-4b7d-b40b-9e0e706356e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:22.094406 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3880b5-ca69-4b7d-b40b-9e0e706356e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:22.094690 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3880b5-ca69-4b7d-b40b-9e0e706356e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:22.094964 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3880b5-ca69-4b7d-b40b-9e0e706356e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:22.095724 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3880b5-ca69-4b7d-b40b-9e0e706356e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:22.097297 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3880b5-ca69-4b7d-b40b-9e0e706356e1 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:22.107167 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1443/2891] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:07:22.111512 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36740e-49d9-49b4-9744-173ee451cf9b admin admin] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:22.121835 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36740e-49d9-49b4-9744-173ee451cf9b admin admin] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:22.126411 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a5643-31a7-4d3a-979b-d4b9988bb201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:22.127064 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a5643-31a7-4d3a-979b-d4b9988bb201 admin admin] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:22.127344 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a5643-31a7-4d3a-979b-d4b9988bb201 admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:22.127644 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a5643-31a7-4d3a-979b-d4b9988bb201 admin admin] PATH_INFO: `/v3/roles` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:22.128374 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a5643-31a7-4d3a-979b-d4b9988bb201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:22.129952 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a5643-31a7-4d3a-979b-d4b9988bb201 admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:22.142308 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1449/2892] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 09:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:07:22.146599 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3880b5-ca69-4b7d-b40b-9e0e706356e1 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:22.157335 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3880b5-ca69-4b7d-b40b-9e0e706356e1 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:22.161856 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a682e-0f60-467c-9a24-825a4ded7197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:22.162723 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a682e-0f60-467c-9a24-825a4ded7197 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:22.163003 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a682e-0f60-467c-9a24-825a4ded7197 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:22.163277 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a682e-0f60-467c-9a24-825a4ded7197 admin admin] PATH_INFO: `/v3/projects/6b4f1a90f556425c95aaeb7de81b2dab/users/f127251c08e142969950c2dff8544ef3/roles/2cb5ed3eb0484858a5f7cbdce69092ed` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:22.177681 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a682e-0f60-467c-9a24-825a4ded7197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b4f1a90f556425c95aaeb7de81b2dab, user_id=f127251c08e142969950c2dff8544ef3, role_id=2cb5ed3eb0484858a5f7cbdce69092ed)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:22.180407 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a682e-0f60-467c-9a24-825a4ded7197 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:22.238011 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1444/2893] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 09:07:22 2022] PUT /identity/v3/projects/6b4f1a90f556425c95aaeb7de81b2dab/users/f127251c08e142969950c2dff8544ef3/roles/2cb5ed3eb0484858a5f7cbdce69092ed => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:07:22.243028 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efe78f-751f-425d-b5aa-5d0d3873899c None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:22.251740 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efe78f-751f-425d-b5aa-5d0d3873899c None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:22.251740 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efe78f-751f-425d-b5aa-5d0d3873899c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:22.262319 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-76efe78f-751f-425d-b5aa-5d0d3873899c None None] MFA Rules not processed for user `d3e81ab686314e4bafebf32342e3e7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:07:22.263509 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-76efe78f-751f-425d-b5aa-5d0d3873899c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:22.268444 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:07:22.321338 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1450/2894] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:07:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:07:22.331807 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a682e-0f60-467c-9a24-825a4ded7197 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:22.333513 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-701a682e-0f60-467c-9a24-825a4ded7197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:22.394474 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a682e-0f60-467c-9a24-825a4ded7197 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:22.398140 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208e3c1-e056-4303-9869-d7db8a1d5e4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:22.398787 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208e3c1-e056-4303-9869-d7db8a1d5e4d service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:22.399064 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208e3c1-e056-4303-9869-d7db8a1d5e4d service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:22.399338 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208e3c1-e056-4303-9869-d7db8a1d5e4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:22.409103 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208e3c1-e056-4303-9869-d7db8a1d5e4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:22.410530 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208e3c1-e056-4303-9869-d7db8a1d5e4d service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:22.435142 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1445/2895] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:07:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:07:23.678714 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8acf02-e81d-4487-a576-0d149e7ead33 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:23.679309 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8acf02-e81d-4487-a576-0d149e7ead33 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:23.679309 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8acf02-e81d-4487-a576-0d149e7ead33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:23.711350 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-1b8acf02-e81d-4487-a576-0d149e7ead33 None None] MFA Rules not processed for user `f127251c08e142969950c2dff8544ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:07:23.713185 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-1b8acf02-e81d-4487-a576-0d149e7ead33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:23.782082 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1451/2896] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:07:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:07:23.794066 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208e3c1-e056-4303-9869-d7db8a1d5e4d service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:23.795602 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0208e3c1-e056-4303-9869-d7db8a1d5e4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:23.856813 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208e3c1-e056-4303-9869-d7db8a1d5e4d service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:23.860849 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92aec9-af8c-44cc-95dc-db723cb7ca21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53b69c61d9a46bc9e8aa1b4a9fd5fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:23.861386 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92aec9-af8c-44cc-95dc-db723cb7ca21 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:23.861671 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92aec9-af8c-44cc-95dc-db723cb7ca21 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:23.861944 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92aec9-af8c-44cc-95dc-db723cb7ca21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:23.870326 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92aec9-af8c-44cc-95dc-db723cb7ca21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:23.872428 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92aec9-af8c-44cc-95dc-db723cb7ca21 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:23.881609 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1446/2897] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:07:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:07:25.739652 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9022e-aa7c-4890-9354-8f42d6cb8311 None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:25.740194 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9022e-aa7c-4890-9354-8f42d6cb8311 None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:25.740194 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9022e-aa7c-4890-9354-8f42d6cb8311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:25.759284 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-adb9022e-aa7c-4890-9354-8f42d6cb8311 None None] MFA Rules not processed for user `f127251c08e142969950c2dff8544ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:07:25.760522 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-adb9022e-aa7c-4890-9354-8f42d6cb8311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:25.768243 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1452/2898] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:07:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:07:26.369898 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92aec9-af8c-44cc-95dc-db723cb7ca21 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:26.376565 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-cd92aec9-af8c-44cc-95dc-db723cb7ca21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:26.426414 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:07:26.450568 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92aec9-af8c-44cc-95dc-db723cb7ca21 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:26.455889 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378d2e6-174e-439a-8fe6-89f201091e6a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfb4be75496444dd897b880c2ac3e67e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:26.456538 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378d2e6-174e-439a-8fe6-89f201091e6a service placement] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:26.456932 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378d2e6-174e-439a-8fe6-89f201091e6a service placement] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:26.457223 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378d2e6-174e-439a-8fe6-89f201091e6a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:26.459244 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0378d2e6-174e-439a-8fe6-89f201091e6a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:26.472078 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0378d2e6-174e-439a-8fe6-89f201091e6a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:26.473565 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0378d2e6-174e-439a-8fe6-89f201091e6a service placement] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:26.484600 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1447/2899] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:07:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:07:29.299743 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9022e-aa7c-4890-9354-8f42d6cb8311 None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:29.301276 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-adb9022e-aa7c-4890-9354-8f42d6cb8311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:29.313570 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9022e-aa7c-4890-9354-8f42d6cb8311 None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:29.317211 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10ad00-b698-439c-a5fd-601f39efa913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:29.317859 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10ad00-b698-439c-a5fd-601f39efa913 service neutron] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:29.318142 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10ad00-b698-439c-a5fd-601f39efa913 service neutron] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:29.318417 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10ad00-b698-439c-a5fd-601f39efa913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:29.320189 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-db10ad00-b698-439c-a5fd-601f39efa913 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:29.330270 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db10ad00-b698-439c-a5fd-601f39efa913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:29.331724 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db10ad00-b698-439c-a5fd-601f39efa913 service neutron] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:29.340333 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1453/2900] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:07:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:07:36.413349 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378d2e6-174e-439a-8fe6-89f201091e6a service placement] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:07:36.414871 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0378d2e6-174e-439a-8fe6-89f201091e6a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:36.493413 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378d2e6-174e-439a-8fe6-89f201091e6a service placement] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:07:36.499042 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d38e0-dae3-47e4-a2f7-a527661494f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c1a08d3a76643a9996dc0daa8714ac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:07:36.501270 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d38e0-dae3-47e4-a2f7-a527661494f7 service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:07:36.501270 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d38e0-dae3-47e4-a2f7-a527661494f7 service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:07:36.501270 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d38e0-dae3-47e4-a2f7-a527661494f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:07:36.503092 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-e46d38e0-dae3-47e4-a2f7-a527661494f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:07:36.516347 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d38e0-dae3-47e4-a2f7-a527661494f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:07:36.517935 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d38e0-dae3-47e4-a2f7-a527661494f7 service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:07:36.529253 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1448/2901] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:07:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:07:39.336004 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=63 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:07:46.524555 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=47 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:08:46.423063 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39265b5e-b2cd-418d-8067-b110802002ed None None] REQUEST_METHOD: `POST` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:08:46.423590 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39265b5e-b2cd-418d-8067-b110802002ed None None] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:08:46.423590 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39265b5e-b2cd-418d-8067-b110802002ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:08:46.442651 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.auth.core [None req-39265b5e-b2cd-418d-8067-b110802002ed None None] MFA Rules not processed for user `f127251c08e142969950c2dff8544ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=86941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:08:46.443999 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-39265b5e-b2cd-418d-8067-b110802002ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:08:46.450881 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1454/2902] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 09:08:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:08:46.693059 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d38e0-dae3-47e4-a2f7-a527661494f7 service nova] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:08:46.702812 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d38e0-dae3-47e4-a2f7-a527661494f7 service nova] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:08:46.707313 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107e054-3aaf-4a04-8d82-d5201ae6608e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08bd52110074f11ba56b2f02397062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:08:46.707997 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107e054-3aaf-4a04-8d82-d5201ae6608e service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:08:46.708288 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107e054-3aaf-4a04-8d82-d5201ae6608e service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:08:46.708571 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107e054-3aaf-4a04-8d82-d5201ae6608e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:08:46.710358 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a107e054-3aaf-4a04-8d82-d5201ae6608e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:08:46.721511 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107e054-3aaf-4a04-8d82-d5201ae6608e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:08:46.722958 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107e054-3aaf-4a04-8d82-d5201ae6608e service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:08:46.731150 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1449/2903] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:08:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:08:56.437021 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=3 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:08:56.727431 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=6 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:09:29.089789 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39265b5e-b2cd-418d-8067-b110802002ed None None] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:09:29.091225 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-39265b5e-b2cd-418d-8067-b110802002ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:09:29.183804 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39265b5e-b2cd-418d-8067-b110802002ed None None] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:09:29.189615 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79b6d7-0233-492b-8190-cdba55acc868 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfb4be75496444dd897b880c2ac3e67e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:09:29.190264 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79b6d7-0233-492b-8190-cdba55acc868 service placement] REQUEST_METHOD: `GET` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:09:29.190546 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79b6d7-0233-492b-8190-cdba55acc868 service placement] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:09:29.190818 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79b6d7-0233-492b-8190-cdba55acc868 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:09:29.192597 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.fernet_utils [None req-df79b6d7-0233-492b-8190-cdba55acc868 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:09:29.205991 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df79b6d7-0233-492b-8190-cdba55acc868 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:09:29.207584 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df79b6d7-0233-492b-8190-cdba55acc868 service placement] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:09:29.217905 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1455/2904] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:09:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:09:39.213596 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=37 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:09:57.491684 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107e054-3aaf-4a04-8d82-d5201ae6608e service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:09:57.526699 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107e054-3aaf-4a04-8d82-d5201ae6608e service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:09:57.531423 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5e685-ad75-4b43-975b-db76950f0e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:09:57.533024 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5e685-ad75-4b43-975b-db76950f0e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:09:57.537350 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5e685-ad75-4b43-975b-db76950f0e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:09:57.537350 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5e685-ad75-4b43-975b-db76950f0e69 admin admin] PATH_INFO: `/v3/users/f127251c08e142969950c2dff8544ef3` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:09:57.537350 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5e685-ad75-4b43-975b-db76950f0e69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f127251c08e142969950c2dff8544ef3)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:09:57.537674 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5e685-ad75-4b43-975b-db76950f0e69 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:09:57.693212 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b9f5e685-ad75-4b43-975b-db76950f0e69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f127251c08e142969950c2dff8544ef3'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:09:57.693866 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b9f5e685-ad75-4b43-975b-db76950f0e69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f127251c08e142969950c2dff8544ef3'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:09:57.705582 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b9f5e685-ad75-4b43-975b-db76950f0e69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f127251c08e142969950c2dff8544ef3'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:09:57.706256 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b9f5e685-ad75-4b43-975b-db76950f0e69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f127251c08e142969950c2dff8544ef3'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:09:57.799977 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b9f5e685-ad75-4b43-975b-db76950f0e69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f127251c08e142969950c2dff8544ef3'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:09:57.818569 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1450/2905] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 09:09:57 2022] DELETE /identity/v3/users/f127251c08e142969950c2dff8544ef3 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:09:58.168957 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79b6d7-0233-492b-8190-cdba55acc868 service placement] Authenticating user token {{(pid=86941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:09:58.184084 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79b6d7-0233-492b-8190-cdba55acc868 service placement] Validating token access rules against request {{(pid=86941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:09:58.243716 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a91508-c5a0-46bd-8697-8807e542443c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e81ab686314e4bafebf32342e3e7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc9626b4086645e5810dd68fb6d20d03', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:09:58.244573 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a91508-c5a0-46bd-8697-8807e542443c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:09:58.244859 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a91508-c5a0-46bd-8697-8807e542443c admin admin] SCRIPT_NAME: `/identity` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:09:58.245136 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a91508-c5a0-46bd-8697-8807e542443c admin admin] PATH_INFO: `/v3/projects/6b4f1a90f556425c95aaeb7de81b2dab` {{(pid=86941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:09:58.246312 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a91508-c5a0-46bd-8697-8807e542443c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b4f1a90f556425c95aaeb7de81b2dab)` {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:09:58.248274 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a91508-c5a0-46bd-8697-8807e542443c admin admin] RBAC: Authorization granted {{(pid=86941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:09:58.354135 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-e7a91508-c5a0-46bd-8697-8807e542443c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b4f1a90f556425c95aaeb7de81b2dab', 'request_id': 'req-e7a91508-c5a0-46bd-8697-8807e542443c'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:09:58.361058 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-e7a91508-c5a0-46bd-8697-8807e542443c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b4f1a90f556425c95aaeb7de81b2dab', 'request_id': 'req-e7a91508-c5a0-46bd-8697-8807e542443c'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:09:58.366706 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-e7a91508-c5a0-46bd-8697-8807e542443c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b4f1a90f556425c95aaeb7de81b2dab', 'request_id': 'req-e7a91508-c5a0-46bd-8697-8807e542443c'} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:09:58.463361 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-e7a91508-c5a0-46bd-8697-8807e542443c admin admin] The token cache is being invalidate because project 6b4f1a90f556425c95aaeb7de81b2dab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86941) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:09:58.463698 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-e7a91508-c5a0-46bd-8697-8807e542443c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:09:58.464331 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG keystone.notifications [None req-e7a91508-c5a0-46bd-8697-8807e542443c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:09:58.465872 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: [pid: 86941|app: 0|req: 1456/2906] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 09:09:58 2022] DELETE /identity/v3/projects/6b4f1a90f556425c95aaeb7de81b2dab => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:10:07.814465 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=38,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:10:08.461085 dv-cinder-850858-1-iscsi devstack@keystone.service[86941]: DEBUG dbcounter [-] [86941] Writing DB stats keystone:SELECT=56,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:14:42.439831 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5e685-ad75-4b43-975b-db76950f0e69 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:14:42.441478 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b9f5e685-ad75-4b43-975b-db76950f0e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:14:42.518141 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5e685-ad75-4b43-975b-db76950f0e69 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:14:42.580993 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630703b-59e3-42f2-9e5c-f03f08154078 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfb4be75496444dd897b880c2ac3e67e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be349194440449209f19f6b535ffd4f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:14:42.581661 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630703b-59e3-42f2-9e5c-f03f08154078 service placement] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:14:42.581950 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630703b-59e3-42f2-9e5c-f03f08154078 service placement] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:14:42.582232 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630703b-59e3-42f2-9e5c-f03f08154078 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:14:42.584100 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-2630703b-59e3-42f2-9e5c-f03f08154078 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:14:42.596670 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630703b-59e3-42f2-9e5c-f03f08154078 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:14:42.598333 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630703b-59e3-42f2-9e5c-f03f08154078 service placement] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:14:42.610279 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1451/2907] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 09:14:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:14:52.604520 dv-cinder-850858-1-iscsi devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=58 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}